2023-11-27T22:18:06.405 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T22:18:06.405 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --archive /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210 --owner scheduled_yuriw@teuthology --name yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/orig.config.yaml 2023-11-27T22:18:06.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T22:18:06.572 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210 branch: wip-yuri10-testing-2023-11-22-1112 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7468210' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri10-testing-2023-11-22-1112 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-11-22-1112 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8541 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri10-testing-2023-11-22-1112 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3HfNhlm7IIuqF5CEHRvcc3BBpPBo9YpuZPiuNXf3ohYXfRS4eI7VlKuxezkNDYzYT+bgxlIgxLgmK7fQNHKOg= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDmQXHpY+MkIvzd/jPTLJcVE7t1ZTK8x8oh64/w9Ha51Eyz3TDHENJ0yA1Iej8QqnjTaGi1GZhgrEKfI+Rx30Js= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-27_17:14:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-27T22:18:06.573 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa; will attempt to use it 2023-11-27T22:18:06.574 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks 2023-11-27T22:18:06.574 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-27T22:18:06.576 INFO:teuthology.task.internal:Checking packages... 2023-11-27T22:18:06.604 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '369173db14b6995b2bd07c60ec5f63d01cf21631' 2023-11-27T22:18:06.604 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-27T22:18:06.604 INFO:teuthology.packaging:ref: None 2023-11-27T22:18:06.604 INFO:teuthology.packaging:tag: None 2023-11-27T22:18:06.604 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-11-22-1112 2023-11-27T22:18:06.604 INFO:teuthology.packaging:sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T22:18:06.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri10-testing-2023-11-22-1112 2023-11-27T22:18:06.856 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7498.g369173db 2023-11-27T22:18:06.856 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-27T22:18:06.862 INFO:teuthology.task.internal:no buildpackages task found 2023-11-27T22:18:06.863 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-27T22:18:06.887 INFO:teuthology.task.internal:Saving configuration 2023-11-27T22:18:06.907 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-27T22:18:06.913 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T22:18:06.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 22:12:58.254595', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3HfNhlm7IIuqF5CEHRvcc3BBpPBo9YpuZPiuNXf3ohYXfRS4eI7VlKuxezkNDYzYT+bgxlIgxLgmK7fQNHKOg='} 2023-11-27T22:18:06.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 22:12:58.252679', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDmQXHpY+MkIvzd/jPTLJcVE7t1ZTK8x8oh64/w9Ha51Eyz3TDHENJ0yA1Iej8QqnjTaGi1GZhgrEKfI+Rx30Js='} 2023-11-27T22:18:06.979 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-27T22:18:06.993 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-27T22:18:06.993 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-27T22:18:06.993 INFO:teuthology.run_tasks:Running task console_log... 2023-11-27T22:18:07.104 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac6d0a7b80>, signals=[15]) 2023-11-27T22:18:07.105 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-27T22:18:07.127 INFO:teuthology.task.internal:Opening connections... 2023-11-27T22:18:07.127 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:18:07.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:18:07.221 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:18:07.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:18:07.320 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-27T22:18:07.336 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-11-27T22:18:07.356 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-11-27T22:18:07.356 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-11-27T22:18:07.410 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T22:18:07.411 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-11-27T22:18:07.412 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-11-27T22:18:07.412 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T22:18:07.412 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-11-27T22:18:07.412 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T22:18:07.412 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T22:18:07.412 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T22:18:07.413 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-11-27T22:18:07.442 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-11-27T22:18:07.460 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-11-27T22:18:07.460 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-11-27T22:18:07.520 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-11-27T22:18:07.520 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-11-27T22:18:07.521 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-11-27T22:18:07.521 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-11-27T22:18:07.521 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-11-27T22:18:07.521 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-11-27T22:18:07.521 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T22:18:07.521 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-11-27T22:18:07.522 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-11-27T22:18:07.522 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T22:18:07.522 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-11-27T22:18:07.522 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T22:18:07.523 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T22:18:07.523 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T22:18:07.523 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-11-27T22:18:07.551 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-27T22:18:07.562 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-27T22:18:07.597 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-27T22:18:07.598 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-11-27T22:18:07.601 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2023-11-27T22:18:07.618 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-27T22:18:07.659 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-27T22:18:07.659 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-11-27T22:18:07.662 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2023-11-27T22:18:07.773 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-27T22:18:07.836 INFO:teuthology.run_tasks:Running task kernel... 2023-11-27T22:18:07.851 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-27T22:18:07.851 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-27T22:18:07.851 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T22:18:07.852 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T22:18:07.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:18:07.868 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-11-27T22:18:07.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:18:07.869 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2023-11-27T22:18:07.928 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-361.el9.x86_64 2023-11-27T22:18:07.929 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.14.0-361.el9.x86_64 2023-11-27T22:18:07.929 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y kernel 2023-11-27T22:18:07.932 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-361.el9.x86_64 2023-11-27T22:18:07.932 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.14.0-361.el9.x86_64 2023-11-27T22:18:07.933 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2023-11-27T22:18:10.307 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 8.7 MB/s | 6.4 MB 00:00 2023-11-27T22:18:10.412 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS-9 - AppStream 7.4 MB/s | 6.4 MB 00:00 2023-11-27T22:18:11.966 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2023-11-27T22:18:11.988 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2023-11-27T22:18:12.762 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-11-27T22:18:12.857 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 7.9 MB 00:00 2023-11-27T22:18:15.124 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-11-27T22:18:19.700 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 5.8 MB 00:01 2023-11-27T22:18:19.837 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 18 MB 00:05 2023-11-27T22:18:21.284 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-11-27T22:18:22.102 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 29 MB/s | 20 MB 00:00 2023-11-27T22:18:24.021 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 5.8 MB 00:00 2023-11-27T22:18:25.530 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2023-11-27T22:18:26.784 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2023-11-27T22:18:26.901 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-27T22:18:29.283 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-27T22:18:29.283 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-27T22:18:29.384 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 5.14.0-386.el9 baseos 5.5 M 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-11-27T22:18:29.388 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 5.14.0-386.el9 baseos 20 M 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 5.14.0-386.el9 baseos 38 M 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core x86_64 5.14.0-386.el9 baseos 32 M 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2023-11-27T22:18:29.389 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:18:29.390 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 95 M 2023-11-27T22:18:29.390 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 121 M 2023-11-27T22:18:29.390 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-11-27T22:18:30.386 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): kernel-5.14.0-386.el9.x86_64.rpm 6.6 MB/s | 5.5 MB 00:00 2023-11-27T22:18:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-11-27T22:18:33.511 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): kernel-modules-core-5.14.0-386.el9.x86_6 10 MB/s | 32 MB 00:03 2023-11-27T22:18:33.929 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-27T22:18:33.930 INFO:teuthology.orchestra.run.smithi154.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-27T22:18:34.012 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout: Package Architecture Version Repository Size 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout: kernel x86_64 5.14.0-386.el9 baseos 5.5 M 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core x86_64 5.14.0-386.el9 baseos 20 M 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules x86_64 5.14.0-386.el9 baseos 38 M 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core x86_64 5.14.0-386.el9 baseos 32 M 2023-11-27T22:18:34.017 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:18:34.018 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-11-27T22:18:34.018 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-11-27T22:18:34.018 INFO:teuthology.orchestra.run.smithi154.stdout:Install 4 Packages 2023-11-27T22:18:34.018 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:18:34.018 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 95 M 2023-11-27T22:18:34.018 INFO:teuthology.orchestra.run.smithi154.stdout:Installed size: 121 M 2023-11-27T22:18:34.019 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-11-27T22:18:35.211 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): kernel-core-5.14.0-386.el9.x86_64.rpm 3.6 MB/s | 20 MB 00:05 2023-11-27T22:18:35.433 INFO:teuthology.orchestra.run.smithi154.stdout:(1/4): kernel-5.14.0-386.el9.x86_64.rpm 4.3 MB/s | 5.5 MB 00:01 2023-11-27T22:18:36.474 INFO:teuthology.orchestra.run.smithi154.stdout:(2/4): kernel-core-5.14.0-386.el9.x86_64.rpm 8.7 MB/s | 20 MB 00:02 2023-11-27T22:18:37.091 INFO:teuthology.orchestra.run.smithi154.stdout:(3/4): kernel-modules-5.14.0-386.el9.x86_64.rpm 13 MB/s | 38 MB 00:02 2023-11-27T22:18:37.567 INFO:teuthology.orchestra.run.smithi154.stdout:(4/4): kernel-modules-core-5.14.0-386.el9.x86_6 15 MB/s | 32 MB 00:02 2023-11-27T22:18:37.567 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-11-27T22:18:37.567 INFO:teuthology.orchestra.run.smithi154.stdout:Total 27 MB/s | 95 MB 00:03 2023-11-27T22:18:38.415 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-11-27T22:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): kernel-modules-5.14.0-386.el9.x86_64.rpm 4.1 MB/s | 38 MB 00:09 2023-11-27T22:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-11-27T22:18:38.702 INFO:teuthology.orchestra.run.smithi194.stdout:Total 10 MB/s | 95 MB 00:09 2023-11-27T22:18:38.796 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-11-27T22:18:38.796 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-11-27T22:18:39.546 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-11-27T22:18:39.898 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-11-27T22:18:39.898 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-11-27T22:18:40.109 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-11-27T22:18:40.109 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-11-27T22:18:41.223 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-11-27T22:18:41.224 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-11-27T22:18:43.049 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-11-27T22:18:43.701 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-core-5.14.0-386.el9.x86_64 1/4 2023-11-27T22:18:43.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T22:18:43.866 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-11-27T22:18:44.496 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-core-5.14.0-386.el9.x86_64 1/4 2023-11-27T22:18:44.610 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T22:18:46.603 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T22:18:46.781 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T22:18:47.384 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T22:18:47.570 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T22:18:51.393 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T22:18:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:18:52.160 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T22:18:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:18:56.191 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:18:56.991 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:25.187 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:25.230 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-5.14.0-386.el9.x86_64 1/4 2023-11-27T22:19:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T22:19:25.677 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T22:19:25.708 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:25.749 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:26.080 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:26.080 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:19:26.080 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-11-27T22:19:26.081 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.081 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-core-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.081 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.081 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-modules-core-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:19:26.081 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-11-27T22:19:26.130 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:26.130 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-5.14.0-386.el9.x86_64 1/4 2023-11-27T22:19:26.130 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-27T22:19:26.130 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:19:26.556 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-11-27T22:19:26.563 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T22:19:26.713 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.714 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T22:19:26.714 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-386.el9.x86_64 2023-11-27T22:19:26.714 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-27T22:19:26.714 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-27T22:19:26.714 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-27T22:19:26.714 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2023-11-27T22:19:26.714 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T22:19:26.831 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T22:19:26.832 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T22:19:26.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.06 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 68.el9 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Group : Unspecified 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 8264254 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2023-11-27T22:19:26.866 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : builder@centos.org 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : CentOS 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2023-11-27T22:19:26.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:19:26.868 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2023-11-27T22:19:26.868 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-27T22:19:26.868 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 5.14.0-386.el9.x86_64 2023-11-27T22:19:26.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-27T22:19:27.044 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T22:19:27.226 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T22:19:27.227 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T22:19:27.227 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-386.el9.x86_64 2023-11-27T22:19:27.227 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-27T22:19:27.227 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-27T22:19:27.227 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-27T22:19:27.227 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2023-11-27T22:19:27.227 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2023-11-27T22:19:27.344 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-27T22:19:27.344 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-27T22:19:27.344 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2023-11-27T22:19:27.378 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 68.el9 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8264254 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-27T22:19:27.379 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:19:27.380 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2023-11-27T22:19:27.381 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-27T22:19:27.381 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 5.14.0-386.el9.x86_64 2023-11-27T22:19:27.382 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-27T22:19:27.531 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-11-27T22:19:28.093 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2023-11-27T22:19:28.863 INFO:teuthology.orchestra.run.smithi154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-27T22:19:28.901 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-11-27T22:19:28.903 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-11-27T22:19:28.919 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.pXC6KiEWlf 2023-11-27T22:19:28.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pXC6KiEWlf 2023-11-27T22:19:28.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.pXC6KiEWlf 2023-11-27T22:19:29.128 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.pXC6KiEWlf is 6KB 2023-11-27T22:19:29.147 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.pXC6KiEWlf 2023-11-27T22:19:29.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2023-11-27T22:19:29.227 INFO:teuthology.orchestra.run.smithi154.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-27T22:19:29.227 INFO:teuthology.orchestra.run.smithi154.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-27T22:19:29.227 INFO:teuthology.orchestra.run.smithi154.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-27T22:19:29.227 INFO:teuthology.orchestra.run.smithi154.stdout:15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64.conf 2023-11-27T22:19:29.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64 2023-11-27T22:19:29.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2023-11-27T22:19:29.539 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-27T22:19:29.576 INFO:teuthology.orchestra.run.smithi194.stderr:done 2023-11-27T22:19:29.578 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-11-27T22:19:29.634 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.2BY1qqd54t 2023-11-27T22:19:29.634 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2BY1qqd54t 2023-11-27T22:19:29.710 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.2BY1qqd54t 2023-11-27T22:19:29.855 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.2BY1qqd54t is 6KB 2023-11-27T22:19:29.905 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.2BY1qqd54t 2023-11-27T22:19:29.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2023-11-27T22:19:29.986 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-27T22:19:29.987 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-27T22:19:29.987 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-27T22:19:29.987 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64.conf 2023-11-27T22:19:29.988 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64 2023-11-27T22:19:30.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2023-11-27T22:19:59.443 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-27T22:19:59.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-27T22:19:59.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:20:00.146 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-27T22:20:00.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-27T22:20:00.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:20:34.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-11-27T22:20:43.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-27T22:20:43.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:21:00.162 DEBUG:teuthology.orchestra.remote:timed out 2023-11-27T22:21:01.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-11-27T22:21:09.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-27T22:21:09.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:21:09.684 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-11-27T22:21:10.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-27T22:21:10.042 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-386.el9.x86_64"... 2023-11-27T22:21:10.042 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2023-11-27T22:21:10.056 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-386.el9.x86_64 2023-11-27T22:21:10.056 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-386.el9.x86_64 vs 5.14.0-386.el9.x86_64 2023-11-27T22:21:10.056 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T22:21:10.057 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-27T22:21:11.058 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-27T22:21:11.058 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-27T22:21:11.168 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2023-11-27T22:21:11.205 DEBUG:teuthology.parallel:result is None 2023-11-27T22:21:13.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-27T22:21:13.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:21:14.634 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-11-27T22:21:15.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-27T22:21:15.065 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-386.el9.x86_64"... 2023-11-27T22:21:15.065 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-11-27T22:21:15.081 INFO:teuthology.orchestra.run.smithi154.stdout:5.14.0-386.el9.x86_64 2023-11-27T22:21:15.082 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-386.el9.x86_64 vs 5.14.0-386.el9.x86_64 2023-11-27T22:21:15.082 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T22:21:15.082 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-27T22:21:16.083 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-27T22:21:16.083 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-27T22:21:16.208 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2023-11-27T22:21:16.269 DEBUG:teuthology.parallel:result is None 2023-11-27T22:21:16.269 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-27T22:21:16.277 INFO:teuthology.task.internal:Creating test directory... 2023-11-27T22:21:16.277 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T22:21:16.279 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T22:21:16.294 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-27T22:21:16.366 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-27T22:21:16.460 INFO:teuthology.task.internal:Creating archive directory... 2023-11-27T22:21:16.460 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T22:21:16.462 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T22:21:16.507 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-27T22:21:16.532 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-27T22:21:16.533 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T22:21:16.540 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T22:21:16.570 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T22:21:16.581 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T22:21:16.583 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T22:21:16.594 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T22:21:16.595 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-27T22:21:16.603 INFO:teuthology.task.internal:Configuring sudo... 2023-11-27T22:21:16.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T22:21:16.639 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T22:21:16.666 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-27T22:21:16.675 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-27T22:21:16.675 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T22:21:16.707 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T22:21:16.722 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T22:21:16.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T22:21:16.855 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T22:21:16.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T22:21:16.979 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:21:16.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T22:21:17.050 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T22:21:17.093 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T22:21:17.151 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T22:21:17.192 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T22:21:17.234 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:21:17.235 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T22:21:17.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-11-27T22:21:17.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2023-11-27T22:21:17.353 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T22:21:17.389 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-27T22:21:17.643 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-27T22:21:17.651 INFO:teuthology.task.internal:Starting timer... 2023-11-27T22:21:17.651 INFO:teuthology.run_tasks:Running task pcp... 2023-11-27T22:21:17.726 INFO:teuthology.run_tasks:Running task selinux... 2023-11-27T22:21:17.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2023-11-27T22:21:17.833 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2023-11-27T22:21:17.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2023-11-27T22:21:17.909 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2023-11-27T22:21:17.911 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-27T22:21:17.911 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2023-11-27T22:21:17.926 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2023-11-27T22:21:17.927 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2023-11-27T22:21:17.971 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2023-11-27T22:21:17.972 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2023-11-27T22:21:17.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T22:21:17.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:21:18.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-27T22:21:18.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:21:18.040 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-27T22:21:18.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2023-11-27T22:21:18.077 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2023-11-27T22:21:18.112 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-27T22:21:18.125 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-27T22:21:18.130 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-27T22:21:18.291 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-27T22:21:18.307 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-27T22:21:18.308 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi154.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-27T22:26:53.907 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2023-11-27T22:26:53.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-27T22:26:53.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:26:54.024 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-11-27T22:26:54.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-11-27T22:26:54.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-27T22:26:54.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T22:26:54.174 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-11-27T22:26:54.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-27T22:26:54.241 INFO:teuthology.run_tasks:Running task clock... 2023-11-27T22:26:54.253 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-27T22:26:54.253 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T22:26:54.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T22:26:54.256 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T22:26:54.256 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T22:26:54.285 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T22:26:54.302 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T22:26:54.311 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-27T22:26:54.327 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-27T22:26:54.331 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2023-11-27T22:26:54.345 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2023-11-27T22:26:54.361 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T22:26:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2023-11-27T22:26:54.370 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2023-11-27T22:26:54.377 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T22:26:54.387 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-27T22:26:54.404 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-27T22:26:54.421 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2023-11-27T22:26:54.424 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T22:26:54.424 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-11-27T22:26:54.424 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.425 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.425 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.425 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.446 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2023-11-27T22:26:54.449 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-27T22:26:54.449 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-11-27T22:26:54.449 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.449 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.450 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.450 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-27T22:26:54.451 INFO:teuthology.run_tasks:Running task install... 2023-11-27T22:26:54.460 DEBUG:teuthology.task.install:project ceph 2023-11-27T22:26:54.460 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}} 2023-11-27T22:26:54.460 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'} 2023-11-27T22:26:54.460 INFO:teuthology.task.install:Using flavor: default 2023-11-27T22:26:54.466 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-27T22:26:54.466 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-27T22:26:54.466 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T22:26:54.466 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T22:26:54.468 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'tag': None, 'wait_for_package': False} 2023-11-27T22:26:54.468 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T22:26:54.840 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/ 2023-11-27T22:26:54.840 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T22:26:54.849 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/ 2023-11-27T22:26:54.849 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7498.g369173db 2023-11-27T22:26:54.949 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T22:26:54.949 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:26:54.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T22:26:54.978 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T22:26:54.981 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T22:26:55.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T22:26:55.072 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-27T22:26:55.073 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:26:55.073 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-27T22:26:55.101 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-27T22:26:55.102 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/369173db14b6995b2bd07c60ec5f63d01cf21631/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-27T22:26:55.129 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T22:26:55.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-27T22:26:55.196 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2023-11-27T22:26:55.198 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2023-11-27T22:26:55.251 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-27T22:26:55.317 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2023-11-27T22:26:55.318 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2023-11-27T22:26:55.448 INFO:teuthology.orchestra.run.smithi154.stdout:73 files removed 2023-11-27T22:26:55.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T22:26:55.563 INFO:teuthology.orchestra.run.smithi194.stdout:73 files removed 2023-11-27T22:26:55.590 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-27T22:26:56.261 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 168 kB/s | 78 kB 00:00 2023-11-27T22:26:56.488 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 135 kB/s | 78 kB 00:00 2023-11-27T22:26:56.678 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-27T22:26:56.913 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-11-27T22:26:57.103 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-11-27T22:26:57.339 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2023-11-27T22:26:58.139 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS-9 - AppStream 6.4 MB/s | 6.4 MB 00:00 2023-11-27T22:26:58.175 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 8.0 MB/s | 6.4 MB 00:00 2023-11-27T22:26:59.781 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2023-11-27T22:27:00.200 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 2.2 MB/s | 2.0 MB 00:00 2023-11-27T22:27:01.891 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 7.9 MB 00:01 2023-11-27T22:27:05.113 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 7.9 MB 00:05 2023-11-27T22:27:06.350 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 18 MB 00:03 2023-11-27T22:27:07.148 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 20 MB/s | 18 MB 00:00 2023-11-27T22:27:11.182 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 5.8 MB 00:00 2023-11-27T22:27:12.899 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-11-27T22:27:14.809 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-11-27T22:27:15.166 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 5.8 MB 00:05 2023-11-27T22:27:17.192 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-11-27T22:27:18.893 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-27T22:27:19.508 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-11-27T22:27:22.195 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T22:27:22.196 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T22:27:22.209 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-27T22:27:22.210 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-27T22:27:22.211 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T22:27:22.212 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-27T22:27:22.214 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T22:27:22.217 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-27T22:27:22.218 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T22:27:22.290 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-11-27T22:27:22.304 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================================ 2023-11-27T22:27:22.304 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-11-27T22:27:22.304 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================================ 2023-11-27T22:27:22.304 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-11-27T22:27:22.304 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-27T22:27:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el9 ceph 6.5 k 2023-11-27T22:27:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.2 M 2023-11-27T22:27:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 860 k 2023-11-27T22:27:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el9 ceph 141 k 2023-11-27T22:27:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.5 M 2023-11-27T22:27:22.305 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 133 k 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 1.8 M 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 7.4 M 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 50 k 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 8.6 M 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el9 ceph 41 M 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 262 k 2023-11-27T22:27:22.306 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 774 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 217 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 18 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 31 k 2023-11-27T22:27:22.307 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 719 k 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 126 k 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-27T22:27:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el9 ceph 162 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el9 ceph 320 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 297 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 99 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 85 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 170 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-27T22:27:22.309 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.3 M 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T22:27:22.310 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 28 k 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el9 ceph 2.1 M 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 243 k 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.4 M 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el9 ceph 18 M 2023-11-27T22:27:22.311 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 15 k 2023-11-27T22:27:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el9 ceph 24 k 2023-11-27T22:27:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-27T22:27:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-27T22:27:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-27T22:27:22.312 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el9 ceph 164 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 476 k 2023-11-27T22:27:22.313 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.8 M 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-27T22:27:22.314 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el9 ceph 45 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 129 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-27T22:27:22.315 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-27T22:27:22.316 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-27T22:27:22.317 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-27T22:27:22.318 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-27T22:27:22.319 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================================ 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout:Install 132 Packages 2023-11-27T22:27:22.320 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 15 Packages 2023-11-27T22:27:22.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:27:22.321 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 204 M 2023-11-27T22:27:22.321 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-11-27T22:27:23.401 INFO:teuthology.orchestra.run.smithi154.stdout:(1/147): ceph-18.0.0-7498.g369173db.el9.x86_64. 17 kB/s | 6.5 kB 00:00 2023-11-27T22:27:23.618 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-11-27T22:27:23.993 INFO:teuthology.orchestra.run.smithi154.stdout:(2/147): ceph-fuse-18.0.0-7498.g369173db.el9.x8 1.4 MB/s | 860 kB 00:00 2023-11-27T22:27:24.085 INFO:teuthology.orchestra.run.smithi154.stdout:(3/147): ceph-immutable-object-cache-18.0.0-749 1.5 MB/s | 141 kB 00:00 2023-11-27T22:27:24.677 INFO:teuthology.orchestra.run.smithi154.stdout:(4/147): ceph-common-18.0.0-7498.g369173db.el9. 11 MB/s | 19 MB 00:01 2023-11-27T22:27:24.777 INFO:teuthology.orchestra.run.smithi154.stdout:(5/147): ceph-mgr-18.0.0-7498.g369173db.el9.x86 15 MB/s | 1.5 MB 00:00 2023-11-27T22:27:25.036 INFO:teuthology.orchestra.run.smithi154.stdout:(6/147): ceph-mon-18.0.0-7498.g369173db.el9.x86 17 MB/s | 4.4 MB 00:00 2023-11-27T22:27:25.086 INFO:teuthology.orchestra.run.smithi154.stdout:(7/147): ceph-mds-18.0.0-7498.g369173db.el9.x86 2.1 MB/s | 2.1 MB 00:01 2023-11-27T22:27:25.903 INFO:teuthology.orchestra.run.smithi154.stdout:(8/147): ceph-osd-18.0.0-7498.g369173db.el9.x86 20 MB/s | 18 MB 00:00 2023-11-27T22:27:25.970 INFO:teuthology.orchestra.run.smithi154.stdout:(9/147): ceph-base-18.0.0-7498.g369173db.el9.x8 1.8 MB/s | 5.2 MB 00:02 2023-11-27T22:27:25.996 INFO:teuthology.orchestra.run.smithi154.stdout:(10/147): ceph-selinux-18.0.0-7498.g369173db.el 263 kB/s | 24 kB 00:00 2023-11-27T22:27:26.171 INFO:teuthology.orchestra.run.smithi154.stdout:(11/147): cephfs-mirror-18.0.0-7498.g369173db.e 1.2 MB/s | 217 kB 00:00 2023-11-27T22:27:26.279 INFO:teuthology.orchestra.run.smithi154.stdout:(12/147): libcephfs-devel-18.0.0-7498.g369173db 288 kB/s | 31 kB 00:00 2023-11-27T22:27:26.298 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T22:27:26.299 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-27T22:27:26.312 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-27T22:27:26.313 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-27T22:27:26.314 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T22:27:26.315 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-27T22:27:26.317 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T22:27:26.320 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-27T22:27:26.321 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T22:27:26.393 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:18.0.0-7498.g369173db.el9 ceph 6.5 k 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:18.0.0-7498.g369173db.el9 ceph 5.2 M 2023-11-27T22:27:26.410 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 860 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7498.g369173db.el9 ceph 141 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:18.0.0-7498.g369173db.el9 ceph 1.5 M 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 133 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 1.8 M 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 7.4 M 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 50 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 8.6 M 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:18.0.0-7498.g369173db.el9 ceph 41 M 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 262 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 774 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 217 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 18 k 2023-11-27T22:27:26.411 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 31 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 719 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:18.0.0-7498.g369173db.el9 ceph 126 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-27T22:27:26.412 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:18.0.0-7498.g369173db.el9 ceph 162 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:18.0.0-7498.g369173db.el9 ceph 320 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 297 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:18.0.0-7498.g369173db.el9 ceph 99 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:18.0.0-7498.g369173db.el9 ceph 85 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:18.0.0-7498.g369173db.el9 ceph 170 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-27T22:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.3 M 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 3.0 M 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2023-11-27T22:27:26.414 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 19 M 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 28 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:18.0.0-7498.g369173db.el9 ceph 2.1 M 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 243 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.4 M 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:18.0.0-7498.g369173db.el9 ceph 18 M 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7498.g369173db.el9 ceph-noarch 15 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:18.0.0-7498.g369173db.el9 ceph 24 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-27T22:27:26.415 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:18.0.0-7498.g369173db.el9 ceph 164 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:18.0.0-7498.g369173db.el9 ceph 476 k 2023-11-27T22:27:26.416 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:18.0.0-7498.g369173db.el9 ceph 4.8 M 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-27T22:27:26.417 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:18.0.0-7498.g369173db.el9 ceph 45 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:18.0.0-7498.g369173db.el9 ceph 129 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-27T22:27:26.418 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-27T22:27:26.419 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-27T22:27:26.420 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-27T22:27:26.421 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2023-11-27T22:27:26.422 INFO:teuthology.orchestra.run.smithi194.stdout:============================================================================================ 2023-11-27T22:27:26.423 INFO:teuthology.orchestra.run.smithi194.stdout:Install 132 Packages 2023-11-27T22:27:26.423 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 15 Packages 2023-11-27T22:27:26.423 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:27:26.423 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 204 M 2023-11-27T22:27:26.423 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2023-11-27T22:27:26.788 INFO:teuthology.orchestra.run.smithi154.stdout:(13/147): libcephfs2-18.0.0-7498.g369173db.el9. 1.4 MB/s | 719 kB 00:00 2023-11-27T22:27:26.972 INFO:teuthology.orchestra.run.smithi154.stdout:(14/147): libcephsqlite-18.0.0-7498.g369173db.e 893 kB/s | 164 kB 00:00 2023-11-27T22:27:27.072 INFO:teuthology.orchestra.run.smithi154.stdout:(15/147): librados-devel-18.0.0-7498.g369173db. 1.2 MB/s | 126 kB 00:00 2023-11-27T22:27:27.303 INFO:teuthology.orchestra.run.smithi194.stdout:(1/147): ceph-18.0.0-7498.g369173db.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2023-11-27T22:27:27.346 INFO:teuthology.orchestra.run.smithi154.stdout:(16/147): libradosstriper1-18.0.0-7498.g369173d 1.7 MB/s | 476 kB 00:00 2023-11-27T22:27:28.006 INFO:teuthology.orchestra.run.smithi154.stdout:(17/147): ceph-test-18.0.0-7498.g369173db.el9.x 20 MB/s | 41 MB 00:02 2023-11-27T22:27:28.056 INFO:teuthology.orchestra.run.smithi154.stdout:(18/147): python3-ceph-argparse-18.0.0-7498.g36 911 kB/s | 45 kB 00:00 2023-11-27T22:27:28.106 INFO:teuthology.orchestra.run.smithi154.stdout:(19/147): python3-ceph-common-18.0.0-7498.g3691 2.5 MB/s | 129 kB 00:00 2023-11-27T22:27:28.111 INFO:teuthology.orchestra.run.smithi194.stdout:(2/147): ceph-fuse-18.0.0-7498.g369173db.el9.x8 1.0 MB/s | 860 kB 00:00 2023-11-27T22:27:28.165 INFO:teuthology.orchestra.run.smithi154.stdout:(20/147): python3-cephfs-18.0.0-7498.g369173db. 2.7 MB/s | 162 kB 00:00 2023-11-27T22:27:28.223 INFO:teuthology.orchestra.run.smithi154.stdout:(21/147): python3-rados-18.0.0-7498.g369173db.e 5.4 MB/s | 320 kB 00:00 2023-11-27T22:27:28.261 INFO:teuthology.orchestra.run.smithi194.stdout:(3/147): ceph-immutable-object-cache-18.0.0-749 944 kB/s | 141 kB 00:00 2023-11-27T22:27:28.282 INFO:teuthology.orchestra.run.smithi154.stdout:(22/147): python3-rbd-18.0.0-7498.g369173db.el9 5.0 MB/s | 297 kB 00:00 2023-11-27T22:27:28.332 INFO:teuthology.orchestra.run.smithi154.stdout:(23/147): python3-rgw-18.0.0-7498.g369173db.el9 1.9 MB/s | 99 kB 00:00 2023-11-27T22:27:28.382 INFO:teuthology.orchestra.run.smithi154.stdout:(24/147): rbd-fuse-18.0.0-7498.g369173db.el9.x8 1.7 MB/s | 85 kB 00:00 2023-11-27T22:27:28.633 INFO:teuthology.orchestra.run.smithi154.stdout:(25/147): ceph-radosgw-18.0.0-7498.g369173db.el 2.4 MB/s | 8.6 MB 00:03 2023-11-27T22:27:28.684 INFO:teuthology.orchestra.run.smithi154.stdout:(26/147): rbd-mirror-18.0.0-7498.g369173db.el9. 10 MB/s | 3.0 MB 00:00 2023-11-27T22:27:28.708 INFO:teuthology.orchestra.run.smithi154.stdout:(27/147): rbd-nbd-18.0.0-7498.g369173db.el9.x86 2.2 MB/s | 170 kB 00:00 2023-11-27T22:27:28.734 INFO:teuthology.orchestra.run.smithi154.stdout:(28/147): ceph-grafana-dashboards-18.0.0-7498.g 561 kB/s | 28 kB 00:00 2023-11-27T22:27:28.784 INFO:teuthology.orchestra.run.smithi154.stdout:(29/147): ceph-mgr-cephadm-18.0.0-7498.g369173d 1.7 MB/s | 133 kB 00:00 2023-11-27T22:27:28.876 INFO:teuthology.orchestra.run.smithi154.stdout:(30/147): ceph-mgr-dashboard-18.0.0-7498.g36917 12 MB/s | 1.8 MB 00:00 2023-11-27T22:27:28.937 INFO:teuthology.orchestra.run.smithi154.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7498.g36 3.9 MB/s | 243 kB 00:00 2023-11-27T22:27:28.987 INFO:teuthology.orchestra.run.smithi154.stdout:(32/147): ceph-mgr-rook-18.0.0-7498.g369173db.e 1.0 MB/s | 50 kB 00:00 2023-11-27T22:27:29.037 INFO:teuthology.orchestra.run.smithi154.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7498.g3 302 kB/s | 15 kB 00:00 2023-11-27T22:27:29.096 INFO:teuthology.orchestra.run.smithi154.stdout:(34/147): ceph-volume-18.0.0-7498.g369173db.el9 4.4 MB/s | 262 kB 00:00 2023-11-27T22:27:29.161 INFO:teuthology.orchestra.run.smithi194.stdout:(4/147): ceph-mds-18.0.0-7498.g369173db.el9.x86 2.3 MB/s | 2.1 MB 00:00 2023-11-27T22:27:29.196 INFO:teuthology.orchestra.run.smithi154.stdout:(35/147): cephadm-18.0.0-7498.g369173db.el9.noa 7.5 MB/s | 774 kB 00:00 2023-11-27T22:27:29.257 INFO:teuthology.orchestra.run.smithi154.stdout:(36/147): librgw2-18.0.0-7498.g369173db.el9.x86 2.5 MB/s | 4.8 MB 00:01 2023-11-27T22:27:29.280 INFO:teuthology.orchestra.run.smithi154.stdout:(37/147): cephfs-top-18.0.0-7498.g369173db.el9. 217 kB/s | 18 kB 00:00 2023-11-27T22:27:29.481 INFO:teuthology.orchestra.run.smithi154.stdout:(38/147): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 662 kB 00:00 2023-11-27T22:27:29.523 INFO:teuthology.orchestra.run.smithi154.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 920 kB 00:00 2023-11-27T22:27:29.529 INFO:teuthology.orchestra.run.smithi194.stdout:(5/147): ceph-base-18.0.0-7498.g369173db.el9.x8 2.0 MB/s | 5.2 MB 00:02 2023-11-27T22:27:29.548 INFO:teuthology.orchestra.run.smithi154.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-11-27T22:27:29.570 INFO:teuthology.orchestra.run.smithi194.stdout:(6/147): ceph-mgr-18.0.0-7498.g369173db.el9.x86 3.6 MB/s | 1.5 MB 00:00 2023-11-27T22:27:29.573 INFO:teuthology.orchestra.run.smithi154.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 430 kB/s | 21 kB 00:00 2023-11-27T22:27:29.598 INFO:teuthology.orchestra.run.smithi154.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-11-27T22:27:29.624 INFO:teuthology.orchestra.run.smithi154.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 635 kB/s | 32 kB 00:00 2023-11-27T22:27:29.758 INFO:teuthology.orchestra.run.smithi154.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2023-11-27T22:27:29.774 INFO:teuthology.orchestra.run.smithi154.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 114 kB/s | 17 kB 00:00 2023-11-27T22:27:29.816 INFO:teuthology.orchestra.run.smithi154.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2023-11-27T22:27:29.833 INFO:teuthology.orchestra.run.smithi154.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 171 kB/s | 10 kB 00:00 2023-11-27T22:27:29.867 INFO:teuthology.orchestra.run.smithi154.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-11-27T22:27:29.892 INFO:teuthology.orchestra.run.smithi154.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 751 kB/s | 44 kB 00:00 2023-11-27T22:27:29.934 INFO:teuthology.orchestra.run.smithi154.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2023-11-27T22:27:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2023-11-27T22:27:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2023-11-27T22:27:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 922 kB/s | 46 kB 00:00 2023-11-27T22:27:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-11-27T22:27:30.077 INFO:teuthology.orchestra.run.smithi154.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2023-11-27T22:27:30.103 INFO:teuthology.orchestra.run.smithi154.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2023-11-27T22:27:30.261 INFO:teuthology.orchestra.run.smithi154.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-11-27T22:27:30.303 INFO:teuthology.orchestra.run.smithi154.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 7.6 MB/s | 1.5 MB 00:00 2023-11-27T22:27:30.304 INFO:teuthology.orchestra.run.smithi194.stdout:(7/147): ceph-mon-18.0.0-7498.g369173db.el9.x86 5.7 MB/s | 4.4 MB 00:00 2023-11-27T22:27:30.337 INFO:teuthology.orchestra.run.smithi154.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-11-27T22:27:30.362 INFO:teuthology.orchestra.run.smithi154.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-11-27T22:27:30.621 INFO:teuthology.orchestra.run.smithi154.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2023-11-27T22:27:30.763 INFO:teuthology.orchestra.run.smithi154.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-11-27T22:27:30.788 INFO:teuthology.orchestra.run.smithi154.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-11-27T22:27:30.804 INFO:teuthology.orchestra.run.smithi194.stdout:(8/147): ceph-common-18.0.0-7498.g369173db.el9. 4.9 MB/s | 19 MB 00:03 2023-11-27T22:27:30.813 INFO:teuthology.orchestra.run.smithi154.stdout:(64/147): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2023-11-27T22:27:30.839 INFO:teuthology.orchestra.run.smithi154.stdout:(65/147): python3-jsonpointer-2.0-4.el9.noarch. 358 kB/s | 18 kB 00:00 2023-11-27T22:27:30.864 INFO:teuthology.orchestra.run.smithi154.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-11-27T22:27:30.888 INFO:teuthology.orchestra.run.smithi194.stdout:(9/147): ceph-selinux-18.0.0-7498.g369173db.el9 290 kB/s | 24 kB 00:00 2023-11-27T22:27:30.889 INFO:teuthology.orchestra.run.smithi154.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2023-11-27T22:27:31.067 INFO:teuthology.orchestra.run.smithi154.stdout:(68/147): ceph-mgr-diskprediction-local-18.0.0- 3.2 MB/s | 7.4 MB 00:02 2023-11-27T22:27:31.157 INFO:teuthology.orchestra.run.smithi154.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2023-11-27T22:27:31.182 INFO:teuthology.orchestra.run.smithi154.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 744 kB/s | 217 kB 00:00 2023-11-27T22:27:31.207 INFO:teuthology.orchestra.run.smithi154.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-11-27T22:27:31.232 INFO:teuthology.orchestra.run.smithi154.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 553 kB/s | 41 kB 00:00 2023-11-27T22:27:31.258 INFO:teuthology.orchestra.run.smithi154.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-27T22:27:31.283 INFO:teuthology.orchestra.run.smithi154.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-11-27T22:27:31.333 INFO:teuthology.orchestra.run.smithi154.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 47 kB 00:00 2023-11-27T22:27:31.350 INFO:teuthology.orchestra.run.smithi154.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 43 kB 00:00 2023-11-27T22:27:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 129 kB/s | 39 kB 00:00 2023-11-27T22:27:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 975 kB/s | 300 kB 00:00 2023-11-27T22:27:31.755 INFO:teuthology.orchestra.run.smithi194.stdout:(10/147): ceph-radosgw-18.0.0-7498.g369173db.el 5.9 MB/s | 8.6 MB 00:01 2023-11-27T22:27:31.884 INFO:teuthology.orchestra.run.smithi154.stdout:(79/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2023-11-27T22:27:31.901 INFO:teuthology.orchestra.run.smithi154.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 211 kB/s | 56 kB 00:00 2023-11-27T22:27:31.921 INFO:teuthology.orchestra.run.smithi194.stdout:(11/147): ceph-osd-18.0.0-7498.g369173db.el9.x8 7.5 MB/s | 18 MB 00:02 2023-11-27T22:27:31.926 INFO:teuthology.orchestra.run.smithi154.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 321 kB/s | 85 kB 00:00 2023-11-27T22:27:31.943 INFO:teuthology.orchestra.run.smithi154.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2023-11-27T22:27:31.947 INFO:teuthology.orchestra.run.smithi194.stdout:(12/147): cephfs-mirror-18.0.0-7498.g369173db.e 1.1 MB/s | 217 kB 00:00 2023-11-27T22:27:31.969 INFO:teuthology.orchestra.run.smithi154.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-11-27T22:27:31.980 INFO:teuthology.orchestra.run.smithi194.stdout:(13/147): libcephfs-devel-18.0.0-7498.g369173db 533 kB/s | 31 kB 00:00 2023-11-27T22:27:31.994 INFO:teuthology.orchestra.run.smithi154.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2023-11-27T22:27:32.022 INFO:teuthology.orchestra.run.smithi154.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-11-27T22:27:32.048 INFO:teuthology.orchestra.run.smithi154.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-11-27T22:27:32.073 INFO:teuthology.orchestra.run.smithi154.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 241 kB 00:00 2023-11-27T22:27:32.089 INFO:teuthology.orchestra.run.smithi194.stdout:(14/147): libcephsqlite-18.0.0-7498.g369173db.e 1.5 MB/s | 164 kB 00:00 2023-11-27T22:27:32.114 INFO:teuthology.orchestra.run.smithi194.stdout:(15/147): libcephfs2-18.0.0-7498.g369173db.el9. 4.2 MB/s | 719 kB 00:00 2023-11-27T22:27:32.132 INFO:teuthology.orchestra.run.smithi154.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-27T22:27:32.165 INFO:teuthology.orchestra.run.smithi154.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 880 kB/s | 103 kB 00:00 2023-11-27T22:27:32.173 INFO:teuthology.orchestra.run.smithi194.stdout:(16/147): librados-devel-18.0.0-7498.g369173db. 1.5 MB/s | 126 kB 00:00 2023-11-27T22:27:32.191 INFO:teuthology.orchestra.run.smithi154.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 124 kB 00:00 2023-11-27T22:27:32.216 INFO:teuthology.orchestra.run.smithi154.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2023-11-27T22:27:32.223 INFO:teuthology.orchestra.run.smithi194.stdout:(17/147): libradosstriper1-18.0.0-7498.g369173d 4.3 MB/s | 476 kB 00:00 2023-11-27T22:27:32.241 INFO:teuthology.orchestra.run.smithi154.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-27T22:27:32.323 INFO:teuthology.orchestra.run.smithi194.stdout:(18/147): python3-ceph-argparse-18.0.0-7498.g36 452 kB/s | 45 kB 00:00 2023-11-27T22:27:32.366 INFO:teuthology.orchestra.run.smithi154.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2023-11-27T22:27:32.457 INFO:teuthology.orchestra.run.smithi194.stdout:(19/147): python3-ceph-common-18.0.0-7498.g3691 965 kB/s | 129 kB 00:00 2023-11-27T22:27:32.517 INFO:teuthology.orchestra.run.smithi154.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 13 MB/s | 4.1 MB 00:00 2023-11-27T22:27:32.800 INFO:teuthology.orchestra.run.smithi154.stdout:(95/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 552 kB/s | 309 kB 00:00 2023-11-27T22:27:32.825 INFO:teuthology.orchestra.run.smithi154.stdout:(96/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 79 kB/s | 24 kB 00:00 2023-11-27T22:27:32.874 INFO:teuthology.orchestra.run.smithi194.stdout:(20/147): librgw2-18.0.0-7498.g369173db.el9.x86 6.8 MB/s | 4.8 MB 00:00 2023-11-27T22:27:32.951 INFO:teuthology.orchestra.run.smithi154.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2023-11-27T22:27:33.005 INFO:teuthology.orchestra.run.smithi194.stdout:(21/147): python3-rados-18.0.0-7498.g369173db.e 2.4 MB/s | 320 kB 00:00 2023-11-27T22:27:33.101 INFO:teuthology.orchestra.run.smithi154.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 245 kB/s | 67 kB 00:00 2023-11-27T22:27:33.124 INFO:teuthology.orchestra.run.smithi194.stdout:(22/147): python3-rbd-18.0.0-7498.g369173db.el9 2.4 MB/s | 297 kB 00:00 2023-11-27T22:27:33.141 INFO:teuthology.orchestra.run.smithi194.stdout:(23/147): python3-cephfs-18.0.0-7498.g369173db. 237 kB/s | 162 kB 00:00 2023-11-27T22:27:33.233 INFO:teuthology.orchestra.run.smithi194.stdout:(24/147): python3-rgw-18.0.0-7498.g369173db.el9 916 kB/s | 99 kB 00:00 2023-11-27T22:27:33.258 INFO:teuthology.orchestra.run.smithi194.stdout:(25/147): rbd-fuse-18.0.0-7498.g369173db.el9.x8 731 kB/s | 85 kB 00:00 2023-11-27T22:27:33.393 INFO:teuthology.orchestra.run.smithi154.stdout:(99/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.9 MB/s | 837 kB 00:00 2023-11-27T22:27:33.535 INFO:teuthology.orchestra.run.smithi154.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 307 kB/s | 43 kB 00:00 2023-11-27T22:27:33.650 INFO:teuthology.orchestra.run.smithi194.stdout:(26/147): ceph-test-18.0.0-7498.g369173db.el9.x 15 MB/s | 41 MB 00:02 2023-11-27T22:27:33.652 INFO:teuthology.orchestra.run.smithi154.stdout:(101/147): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2023-11-27T22:27:33.675 INFO:teuthology.orchestra.run.smithi194.stdout:(27/147): rbd-nbd-18.0.0-7498.g369173db.el9.x86 408 kB/s | 170 kB 00:00 2023-11-27T22:27:33.734 INFO:teuthology.orchestra.run.smithi194.stdout:(28/147): rbd-mirror-18.0.0-7498.g369173db.el9. 6.0 MB/s | 3.0 MB 00:00 2023-11-27T22:27:33.759 INFO:teuthology.orchestra.run.smithi194.stdout:(29/147): ceph-grafana-dashboards-18.0.0-7498.g 259 kB/s | 28 kB 00:00 2023-11-27T22:27:33.784 INFO:teuthology.orchestra.run.smithi194.stdout:(30/147): ceph-mgr-cephadm-18.0.0-7498.g369173d 1.2 MB/s | 133 kB 00:00 2023-11-27T22:27:33.793 INFO:teuthology.orchestra.run.smithi154.stdout:(102/147): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2023-11-27T22:27:33.893 INFO:teuthology.orchestra.run.smithi194.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7498.g36 2.2 MB/s | 243 kB 00:00 2023-11-27T22:27:33.969 INFO:teuthology.orchestra.run.smithi154.stdout:(103/147): python3-cheroot-8.6.0-4.el9.noarch.r 981 kB/s | 172 kB 00:00 2023-11-27T22:27:33.994 INFO:teuthology.orchestra.run.smithi154.stdout:(104/147): python3-asyncssh-2.13.2-3.el9.noarch 613 kB/s | 548 kB 00:00 2023-11-27T22:27:34.029 INFO:teuthology.orchestra.run.smithi194.stdout:(32/147): ceph-mgr-dashboard-18.0.0-7498.g36917 6.0 MB/s | 1.8 MB 00:00 2023-11-27T22:27:34.052 INFO:teuthology.orchestra.run.smithi194.stdout:(33/147): ceph-mgr-rook-18.0.0-7498.g369173db.e 316 kB/s | 50 kB 00:00 2023-11-27T22:27:34.152 INFO:teuthology.orchestra.run.smithi194.stdout:(34/147): ceph-prometheus-alerts-18.0.0-7498.g3 121 kB/s | 15 kB 00:00 2023-11-27T22:27:34.186 INFO:teuthology.orchestra.run.smithi194.stdout:(35/147): ceph-volume-18.0.0-7498.g369173db.el9 1.9 MB/s | 262 kB 00:00 2023-11-27T22:27:34.228 INFO:teuthology.orchestra.run.smithi154.stdout:(105/147): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2023-11-27T22:27:34.353 INFO:teuthology.orchestra.run.smithi154.stdout:(106/147): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2023-11-27T22:27:34.378 INFO:teuthology.orchestra.run.smithi154.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 514 kB/s | 197 kB 00:00 2023-11-27T22:27:34.462 INFO:teuthology.orchestra.run.smithi154.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2023-11-27T22:27:34.504 INFO:teuthology.orchestra.run.smithi154.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 185 kB/s | 23 kB 00:00 2023-11-27T22:27:34.536 INFO:teuthology.orchestra.run.smithi194.stdout:(36/147): cephadm-18.0.0-7498.g369173db.el9.noa 2.0 MB/s | 774 kB 00:00 2023-11-27T22:27:34.579 INFO:teuthology.orchestra.run.smithi154.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2023-11-27T22:27:34.613 INFO:teuthology.orchestra.run.smithi154.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2023-11-27T22:27:34.620 INFO:teuthology.orchestra.run.smithi194.stdout:(37/147): ceph-mgr-diskprediction-local-18.0.0- 8.6 MB/s | 7.4 MB 00:00 2023-11-27T22:27:34.697 INFO:teuthology.orchestra.run.smithi154.stdout:(112/147): python3-jwt+crypto-2.4.0-1.el9.noarc 77 kB/s | 9.0 kB 00:00 2023-11-27T22:27:34.737 INFO:teuthology.orchestra.run.smithi194.stdout:(38/147): cephfs-top-18.0.0-7498.g369173db.el9. 33 kB/s | 18 kB 00:00 2023-11-27T22:27:34.747 INFO:teuthology.orchestra.run.smithi154.stdout:(113/147): python3-jwt-2.4.0-1.el9.noarch.rpm 306 kB/s | 41 kB 00:00 2023-11-27T22:27:34.880 INFO:teuthology.orchestra.run.smithi154.stdout:(114/147): python3-logutils-0.3.5-21.el9.noarch 347 kB/s | 46 kB 00:00 2023-11-27T22:27:34.887 INFO:teuthology.orchestra.run.smithi194.stdout:(39/147): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2023-11-27T22:27:34.929 INFO:teuthology.orchestra.run.smithi194.stdout:(40/147): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 920 kB 00:00 2023-11-27T22:27:34.963 INFO:teuthology.orchestra.run.smithi194.stdout:(41/147): boost-program-options-1.75.0-8.el9.x8 470 kB/s | 106 kB 00:00 2023-11-27T22:27:34.980 INFO:teuthology.orchestra.run.smithi194.stdout:(42/147): elfutils-libelf-devel-0.190-1.el9.x86 235 kB/s | 21 kB 00:00 2023-11-27T22:27:34.989 INFO:teuthology.orchestra.run.smithi154.stdout:(115/147): python3-more-itertools-8.12.0-2.el9. 728 kB/s | 79 kB 00:00 2023-11-27T22:27:35.005 INFO:teuthology.orchestra.run.smithi194.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 760 kB/s | 32 kB 00:00 2023-11-27T22:27:35.031 INFO:teuthology.orchestra.run.smithi194.stdout:(44/147): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2023-11-27T22:27:35.098 INFO:teuthology.orchestra.run.smithi154.stdout:(116/147): python3-kubernetes-26.1.0-2.el9.noar 2.5 MB/s | 1.0 MB 00:00 2023-11-27T22:27:35.123 INFO:teuthology.orchestra.run.smithi154.stdout:(117/147): python3-natsort-7.1.1-5.el9.noarch.r 432 kB/s | 58 kB 00:00 2023-11-27T22:27:35.173 INFO:teuthology.orchestra.run.smithi194.stdout:(45/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2023-11-27T22:27:35.198 INFO:teuthology.orchestra.run.smithi194.stdout:(46/147): flexiblas-openblas-openmp-3.0.4-8.el9 89 kB/s | 17 kB 00:00 2023-11-27T22:27:35.224 INFO:teuthology.orchestra.run.smithi194.stdout:(47/147): jq-1.6-16.el9.x86_64.rpm 971 kB/s | 186 kB 00:00 2023-11-27T22:27:35.249 INFO:teuthology.orchestra.run.smithi194.stdout:(48/147): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 10 kB 00:00 2023-11-27T22:27:35.282 INFO:teuthology.orchestra.run.smithi194.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-11-27T22:27:35.292 INFO:teuthology.orchestra.run.smithi154.stdout:(118/147): python3-portend-3.1.0-2.el9.noarch.r 97 kB/s | 16 kB 00:00 2023-11-27T22:27:35.307 INFO:teuthology.orchestra.run.smithi194.stdout:(50/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 529 kB/s | 44 kB 00:00 2023-11-27T22:27:35.317 INFO:teuthology.orchestra.run.smithi154.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2023-11-27T22:27:35.341 INFO:teuthology.orchestra.run.smithi194.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 661 kB 00:00 2023-11-27T22:27:35.366 INFO:teuthology.orchestra.run.smithi194.stdout:(52/147): libtool-2.4.6-45.el9.x86_64.rpm 6.7 MB/s | 578 kB 00:00 2023-11-27T22:27:35.391 INFO:teuthology.orchestra.run.smithi194.stdout:(53/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 296 kB/s | 24 kB 00:00 2023-11-27T22:27:35.417 INFO:teuthology.orchestra.run.smithi194.stdout:(54/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 625 kB/s | 46 kB 00:00 2023-11-27T22:27:35.442 INFO:teuthology.orchestra.run.smithi154.stdout:(120/147): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2023-11-27T22:27:35.450 INFO:teuthology.orchestra.run.smithi194.stdout:(55/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-11-27T22:27:35.476 INFO:teuthology.orchestra.run.smithi194.stdout:(56/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2023-11-27T22:27:35.493 INFO:teuthology.orchestra.run.smithi154.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 448 kB/s | 90 kB 00:00 2023-11-27T22:27:35.501 INFO:teuthology.orchestra.run.smithi194.stdout:(57/147): openblas-0.3.21-2.el9.x86_64.rpm 408 kB/s | 34 kB 00:00 2023-11-27T22:27:35.601 INFO:teuthology.orchestra.run.smithi154.stdout:(122/147): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-11-27T22:27:35.643 INFO:teuthology.orchestra.run.smithi154.stdout:(123/147): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2023-11-27T22:27:35.660 INFO:teuthology.orchestra.run.smithi194.stdout:(58/147): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2023-11-27T22:27:35.693 INFO:teuthology.orchestra.run.smithi194.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 4.2 MB/s | 811 kB 00:00 2023-11-27T22:27:35.727 INFO:teuthology.orchestra.run.smithi194.stdout:(60/147): postgresql-13.11-1.el9.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2023-11-27T22:27:35.727 INFO:teuthology.orchestra.run.smithi154.stdout:(124/147): python3-tempora-5.0.0-2.el9.noarch.r 285 kB/s | 36 kB 00:00 2023-11-27T22:27:35.752 INFO:teuthology.orchestra.run.smithi194.stdout:(61/147): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2023-11-27T22:27:35.769 INFO:teuthology.orchestra.run.smithi154.stdout:(125/147): python3-typing-extensions-4.4.0-2.el 408 kB/s | 51 kB 00:00 2023-11-27T22:27:35.886 INFO:teuthology.orchestra.run.smithi154.stdout:(126/147): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2023-11-27T22:27:35.894 INFO:teuthology.orchestra.run.smithi194.stdout:(62/147): postgresql-server-13.11-1.el9.x86_64. 28 MB/s | 5.7 MB 00:00 2023-11-27T22:27:35.928 INFO:teuthology.orchestra.run.smithi154.stdout:(127/147): python3-websocket-client-1.2.3-2.el9 565 kB/s | 90 kB 00:00 2023-11-27T22:27:36.002 INFO:teuthology.orchestra.run.smithi194.stdout:(63/147): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-11-27T22:27:36.027 INFO:teuthology.orchestra.run.smithi194.stdout:(64/147): python3-jinja2-2.11.3-4.el9.noarch.rp 837 kB/s | 228 kB 00:00 2023-11-27T22:27:36.028 INFO:teuthology.orchestra.run.smithi154.stdout:(128/147): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2023-11-27T22:27:36.053 INFO:teuthology.orchestra.run.smithi194.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 156 kB/s | 24 kB 00:00 2023-11-27T22:27:36.078 INFO:teuthology.orchestra.run.smithi194.stdout:(66/147): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2023-11-27T22:27:36.103 INFO:teuthology.orchestra.run.smithi194.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2023-11-27T22:27:36.120 INFO:teuthology.orchestra.run.smithi194.stdout:(68/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-11-27T22:27:36.136 INFO:teuthology.orchestra.run.smithi154.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2023-11-27T22:27:36.262 INFO:teuthology.orchestra.run.smithi194.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-11-27T22:27:36.262 INFO:teuthology.orchestra.run.smithi154.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 820 kB/s | 192 kB 00:00 2023-11-27T22:27:36.287 INFO:teuthology.orchestra.run.smithi194.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-11-27T22:27:36.361 INFO:teuthology.orchestra.run.smithi194.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 728 kB/s | 174 kB 00:00 2023-11-27T22:27:36.388 INFO:teuthology.orchestra.run.smithi194.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 330 kB/s | 41 kB 00:00 2023-11-27T22:27:36.413 INFO:teuthology.orchestra.run.smithi194.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.5 MB/s | 132 kB 00:00 2023-11-27T22:27:36.438 INFO:teuthology.orchestra.run.smithi194.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-11-27T22:27:36.464 INFO:teuthology.orchestra.run.smithi194.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 628 kB/s | 47 kB 00:00 2023-11-27T22:27:36.489 INFO:teuthology.orchestra.run.smithi194.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 43 kB 00:00 2023-11-27T22:27:36.823 INFO:teuthology.orchestra.run.smithi194.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 108 kB/s | 39 kB 00:00 2023-11-27T22:27:36.848 INFO:teuthology.orchestra.run.smithi194.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 838 kB/s | 300 kB 00:00 2023-11-27T22:27:36.937 INFO:teuthology.orchestra.run.smithi154.stdout:(131/147): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2023-11-27T22:27:36.998 INFO:teuthology.orchestra.run.smithi194.stdout:(79/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2023-11-27T22:27:37.012 INFO:teuthology.orchestra.run.smithi154.stdout:(132/147): libarrow-9.0.0-9.el9.x86_64.rpm 974 kB/s | 4.4 MB 00:04 2023-11-27T22:27:37.023 INFO:teuthology.orchestra.run.smithi194.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 282 kB/s | 56 kB 00:00 2023-11-27T22:27:37.048 INFO:teuthology.orchestra.run.smithi194.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 430 kB/s | 85 kB 00:00 2023-11-27T22:27:37.062 INFO:teuthology.orchestra.run.smithi154.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-27T22:27:37.073 INFO:teuthology.orchestra.run.smithi194.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 835 kB/s | 63 kB 00:00 2023-11-27T22:27:37.099 INFO:teuthology.orchestra.run.smithi194.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2023-11-27T22:27:37.124 INFO:teuthology.orchestra.run.smithi194.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-11-27T22:27:37.166 INFO:teuthology.orchestra.run.smithi194.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-11-27T22:27:37.191 INFO:teuthology.orchestra.run.smithi194.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-11-27T22:27:37.213 INFO:teuthology.orchestra.run.smithi154.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 15 MB/s | 2.2 MB 00:00 2023-11-27T22:27:37.216 INFO:teuthology.orchestra.run.smithi194.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-11-27T22:27:37.250 INFO:teuthology.orchestra.run.smithi194.stdout:(88/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-27T22:27:37.275 INFO:teuthology.orchestra.run.smithi194.stdout:(89/147): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-11-27T22:27:37.301 INFO:teuthology.orchestra.run.smithi194.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-11-27T22:27:37.326 INFO:teuthology.orchestra.run.smithi194.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-27T22:27:37.346 INFO:teuthology.orchestra.run.smithi154.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 13 MB/s | 1.8 MB 00:00 2023-11-27T22:27:37.359 INFO:teuthology.orchestra.run.smithi194.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.1 MB/s | 187 kB 00:00 2023-11-27T22:27:37.405 INFO:teuthology.orchestra.run.smithi154.stdout:(136/147): librados2-18.0.0-7498.g369173db.el9. 2.9 MB/s | 3.3 MB 00:01 2023-11-27T22:27:37.422 INFO:teuthology.orchestra.run.smithi154.stdout:(137/147): NetworkManager-team-1.45.6-1.el9.x86 560 kB/s | 42 kB 00:00 2023-11-27T22:27:37.464 INFO:teuthology.orchestra.run.smithi154.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 4.1 MB/s | 245 kB 00:00 2023-11-27T22:27:37.489 INFO:teuthology.orchestra.run.smithi154.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2023-11-27T22:27:37.514 INFO:teuthology.orchestra.run.smithi154.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 729 kB/s | 36 kB 00:00 2023-11-27T22:27:37.548 INFO:teuthology.orchestra.run.smithi154.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2023-11-27T22:27:37.573 INFO:teuthology.orchestra.run.smithi154.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 4.3 MB/s | 255 kB 00:00 2023-11-27T22:27:37.607 INFO:teuthology.orchestra.run.smithi154.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 377 kB/s | 22 kB 00:00 2023-11-27T22:27:37.632 INFO:teuthology.orchestra.run.smithi154.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-11-27T22:27:37.810 INFO:teuthology.orchestra.run.smithi194.stdout:(93/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 686 kB/s | 309 kB 00:00 2023-11-27T22:27:37.910 INFO:teuthology.orchestra.run.smithi194.stdout:(94/147): python3-devel-3.9.17-2.el9.x86_64.rpm 420 kB/s | 245 kB 00:00 2023-11-27T22:27:38.065 INFO:teuthology.orchestra.run.smithi154.stdout:(145/147): librbd1-18.0.0-7498.g369173db.el9.x8 2.7 MB/s | 3.0 MB 00:01 2023-11-27T22:27:38.143 INFO:teuthology.orchestra.run.smithi194.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 104 kB/s | 24 kB 00:00 2023-11-27T22:27:38.252 INFO:teuthology.orchestra.run.smithi194.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2023-11-27T22:27:38.310 INFO:teuthology.orchestra.run.smithi194.stdout:(97/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 4.1 MB/s | 4.1 MB 00:01 2023-11-27T22:27:38.361 INFO:teuthology.orchestra.run.smithi194.stdout:(98/147): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2023-11-27T22:27:38.407 INFO:teuthology.orchestra.run.smithi154.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 1.5 MB/s | 1.2 MB 00:00 2023-11-27T22:27:38.761 INFO:teuthology.orchestra.run.smithi194.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 1.4 MB/s | 548 kB 00:00 2023-11-27T22:27:38.819 INFO:teuthology.orchestra.run.smithi194.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2023-11-27T22:27:38.886 INFO:teuthology.orchestra.run.smithi194.stdout:(101/147): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2023-11-27T22:27:38.953 INFO:teuthology.orchestra.run.smithi194.stdout:(102/147): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2023-11-27T22:27:39.045 INFO:teuthology.orchestra.run.smithi194.stdout:(103/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.1 MB/s | 837 kB 00:00 2023-11-27T22:27:39.095 INFO:teuthology.orchestra.run.smithi194.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-11-27T22:27:39.229 INFO:teuthology.orchestra.run.smithi194.stdout:(105/147): python3-google-auth-2.23.4-1.el9.noa 1.4 MB/s | 197 kB 00:00 2023-11-27T22:27:39.288 INFO:teuthology.orchestra.run.smithi194.stdout:(106/147): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2023-11-27T22:27:39.313 INFO:teuthology.orchestra.run.smithi194.stdout:(107/147): python3-cherrypy-18.6.1-2.el9.noarch 1.3 MB/s | 358 kB 00:00 2023-11-27T22:27:39.346 INFO:teuthology.orchestra.run.smithi194.stdout:(108/147): python3-jaraco-classes-3.2.1-5.el9.n 303 kB/s | 18 kB 00:00 2023-11-27T22:27:39.372 INFO:teuthology.orchestra.run.smithi194.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2023-11-27T22:27:39.405 INFO:teuthology.orchestra.run.smithi194.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2023-11-27T22:27:39.430 INFO:teuthology.orchestra.run.smithi194.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2023-11-27T22:27:39.464 INFO:teuthology.orchestra.run.smithi194.stdout:(112/147): python3-jwt+crypto-2.4.0-1.el9.noarc 155 kB/s | 9.0 kB 00:00 2023-11-27T22:27:39.489 INFO:teuthology.orchestra.run.smithi194.stdout:(113/147): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2023-11-27T22:27:39.548 INFO:teuthology.orchestra.run.smithi194.stdout:(114/147): python3-logutils-0.3.5-21.el9.noarch 795 kB/s | 46 kB 00:00 2023-11-27T22:27:39.566 INFO:teuthology.orchestra.run.smithi154.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.1 MB/s | 2.2 MB 00:01 2023-11-27T22:27:39.571 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-11-27T22:27:39.572 INFO:teuthology.orchestra.run.smithi154.stdout:Total 12 MB/s | 204 MB 00:17 2023-11-27T22:27:39.615 INFO:teuthology.orchestra.run.smithi194.stdout:(115/147): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-11-27T22:27:39.668 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-11-27T22:27:39.682 INFO:teuthology.orchestra.run.smithi194.stdout:(116/147): python3-natsort-7.1.1-5.el9.noarch.r 864 kB/s | 58 kB 00:00 2023-11-27T22:27:39.855 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-11-27T22:27:39.855 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-11-27T22:27:39.883 INFO:teuthology.orchestra.run.smithi194.stdout:(117/147): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2023-11-27T22:27:39.949 INFO:teuthology.orchestra.run.smithi194.stdout:(118/147): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2023-11-27T22:27:40.074 INFO:teuthology.orchestra.run.smithi194.stdout:(119/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 721 kB/s | 90 kB 00:00 2023-11-27T22:27:40.150 INFO:teuthology.orchestra.run.smithi194.stdout:(120/147): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2023-11-27T22:27:40.234 INFO:teuthology.orchestra.run.smithi194.stdout:(121/147): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2023-11-27T22:27:40.309 INFO:teuthology.orchestra.run.smithi194.stdout:(122/147): python3-rsa-4.9-2.el9.noarch.rpm 790 kB/s | 59 kB 00:00 2023-11-27T22:27:40.359 INFO:teuthology.orchestra.run.smithi194.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 903 kB/s | 188 kB 00:00 2023-11-27T22:27:40.384 INFO:teuthology.orchestra.run.smithi194.stdout:(124/147): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2023-11-27T22:27:40.435 INFO:teuthology.orchestra.run.smithi194.stdout:(125/147): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2023-11-27T22:27:40.560 INFO:teuthology.orchestra.run.smithi194.stdout:(126/147): python3-websocket-client-1.2.3-2.el9 719 kB/s | 90 kB 00:00 2023-11-27T22:27:40.635 INFO:teuthology.orchestra.run.smithi194.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 917 kB/s | 230 kB 00:00 2023-11-27T22:27:40.710 INFO:teuthology.orchestra.run.smithi194.stdout:(128/147): python3-zc-lockfile-2.0-10.el9.noarc 267 kB/s | 20 kB 00:00 2023-11-27T22:27:40.769 INFO:teuthology.orchestra.run.smithi194.stdout:(129/147): libarrow-9.0.0-9.el9.x86_64.rpm 1.5 MB/s | 4.4 MB 00:02 2023-11-27T22:27:40.903 INFO:teuthology.orchestra.run.smithi194.stdout:(130/147): re2-20211101-3.el9.x86_64.rpm 998 kB/s | 192 kB 00:00 2023-11-27T22:27:40.944 INFO:teuthology.orchestra.run.smithi194.stdout:(131/147): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2023-11-27T22:27:41.668 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-11-27T22:27:41.669 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-11-27T22:27:41.753 INFO:teuthology.orchestra.run.smithi194.stdout:(132/147): librados2-18.0.0-7498.g369173db.el9. 3.9 MB/s | 3.3 MB 00:00 2023-11-27T22:27:41.803 INFO:teuthology.orchestra.run.smithi194.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-27T22:27:41.895 INFO:teuthology.orchestra.run.smithi194.stdout:(134/147): thrift-0.15.0-2.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2023-11-27T22:27:41.945 INFO:teuthology.orchestra.run.smithi194.stdout:(135/147): NetworkManager-1.45.6-1.el9.x86_64.r 16 MB/s | 2.2 MB 00:00 2023-11-27T22:27:42.004 INFO:teuthology.orchestra.run.smithi194.stdout:(136/147): librbd1-18.0.0-7498.g369173db.el9.x8 2.9 MB/s | 3.0 MB 00:01 2023-11-27T22:27:42.046 INFO:teuthology.orchestra.run.smithi194.stdout:(137/147): NetworkManager-libnm-1.45.6-1.el9.x8 12 MB/s | 1.8 MB 00:00 2023-11-27T22:27:42.071 INFO:teuthology.orchestra.run.smithi194.stdout:(138/147): NetworkManager-team-1.45.6-1.el9.x86 339 kB/s | 42 kB 00:00 2023-11-27T22:27:42.096 INFO:teuthology.orchestra.run.smithi194.stdout:(139/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.7 MB/s | 245 kB 00:00 2023-11-27T22:27:42.122 INFO:teuthology.orchestra.run.smithi194.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 737 kB/s | 36 kB 00:00 2023-11-27T22:27:42.147 INFO:teuthology.orchestra.run.smithi194.stdout:(141/147): acl-2.3.1-4.el9.x86_64.rpm 919 kB/s | 69 kB 00:00 2023-11-27T22:27:42.172 INFO:teuthology.orchestra.run.smithi194.stdout:(142/147): elfutils-libelf-0.190-1.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2023-11-27T22:27:42.197 INFO:teuthology.orchestra.run.smithi194.stdout:(143/147): elfutils-libs-0.190-1.el9.x86_64.rpm 3.3 MB/s | 255 kB 00:00 2023-11-27T22:27:42.223 INFO:teuthology.orchestra.run.smithi194.stdout:(144/147): libacl-2.3.1-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2023-11-27T22:27:42.256 INFO:teuthology.orchestra.run.smithi194.stdout:(145/147): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2023-11-27T22:27:42.423 INFO:teuthology.orchestra.run.smithi194.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2023-11-27T22:27:42.465 INFO:teuthology.orchestra.run.smithi194.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 8.9 MB/s | 2.2 MB 00:00 2023-11-27T22:27:42.472 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2023-11-27T22:27:42.472 INFO:teuthology.orchestra.run.smithi194.stdout:Total 13 MB/s | 204 MB 00:16 2023-11-27T22:27:42.567 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2023-11-27T22:27:42.750 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2023-11-27T22:27:42.751 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2023-11-27T22:27:44.536 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2023-11-27T22:27:44.537 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2023-11-27T22:27:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-11-27T22:27:47.678 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-27T22:27:47.703 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-27T22:27:47.750 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-27T22:27:47.795 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-27T22:27:47.820 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-27T22:27:47.869 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-27T22:27:48.206 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-27T22:27:48.388 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T22:27:48.574 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T22:27:48.598 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T22:27:48.678 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T22:27:48.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T22:27:48.747 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-27T22:27:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-27T22:27:48.987 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-27T22:27:49.011 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T22:27:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T22:27:49.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T22:27:49.215 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T22:27:49.390 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-27T22:27:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T22:27:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T22:27:49.658 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T22:27:49.702 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T22:27:49.980 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T22:27:50.032 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-27T22:27:50.101 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-27T22:27:50.154 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-27T22:27:50.185 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-27T22:27:50.229 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-27T22:27:50.277 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-27T22:27:50.350 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-27T22:27:50.385 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-27T22:27:50.421 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-27T22:27:50.491 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-27T22:27:50.534 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 29/162 2023-11-27T22:27:50.578 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 30/162 2023-11-27T22:27:50.598 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2023-11-27T22:27:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 31/162 2023-11-27T22:27:50.720 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-27T22:27:50.754 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-27T22:27:50.787 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-27T22:27:50.792 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-27T22:27:50.829 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-27T22:27:50.838 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-27T22:27:50.855 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-27T22:27:50.905 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-27T22:27:51.247 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-27T22:27:51.297 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T22:27:51.375 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-27T22:27:51.416 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T22:27:51.450 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-27T22:27:51.456 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T22:27:51.496 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-27T22:27:51.530 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T22:27:51.543 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-27T22:27:51.566 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T22:27:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 38/162 2023-11-27T22:27:51.602 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-27T22:27:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-27T22:27:51.749 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-27T22:27:51.778 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-27T22:27:51.784 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-27T22:27:51.834 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-27T22:27:51.862 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T22:27:51.893 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-27T22:27:51.929 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-27T22:27:51.970 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 14/162 2023-11-27T22:27:51.984 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-27T22:27:51.995 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T22:27:52.049 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 15/162 2023-11-27T22:27:52.065 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-27T22:27:52.097 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-27T22:27:52.133 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-27T22:27:52.179 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-27T22:27:52.225 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-27T22:27:52.226 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-27T22:27:52.267 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-27T22:27:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T22:27:52.399 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-27T22:27:52.409 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-27T22:27:52.445 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-27T22:27:52.485 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-27T22:27:52.507 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T22:27:52.569 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T22:27:52.578 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-27T22:27:52.612 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-27T22:27:52.651 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-27T22:27:52.684 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-27T22:27:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-27T22:27:52.829 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-27T22:27:52.856 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-27T22:27:52.877 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-27T22:27:52.890 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-27T22:27:52.932 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-27T22:27:52.959 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-27T22:27:53.021 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-27T22:27:53.052 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-27T22:27:53.096 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-27T22:27:53.122 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-27T22:27:53.146 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-27T22:27:53.166 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-27T22:27:53.216 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-27T22:27:53.251 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-27T22:27:53.279 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-27T22:27:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-27T22:27:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-27T22:27:53.348 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-27T22:27:53.373 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-27T22:27:53.384 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 29/162 2023-11-27T22:27:53.406 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-27T22:27:53.427 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 30/162 2023-11-27T22:27:53.439 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-27T22:27:53.470 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-27T22:27:53.498 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-27T22:27:53.499 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 31/162 2023-11-27T22:27:53.602 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-27T22:27:53.635 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-27T22:27:53.636 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-27T22:27:53.666 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-27T22:27:53.687 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-27T22:27:53.734 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-27T22:27:53.767 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-27T22:27:53.801 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-27T22:27:53.842 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-27T22:27:53.876 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-27T22:27:53.973 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-27T22:27:54.012 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-27T22:27:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-27T22:27:54.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-27T22:27:54.212 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-27T22:27:54.297 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-27T22:27:54.345 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-27T22:27:54.397 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-27T22:27:54.434 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 38/162 2023-11-27T22:27:54.476 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-27T22:27:54.628 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-27T22:27:54.676 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-27T22:27:54.782 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-27T22:27:54.820 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-27T22:27:54.875 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-27T22:27:54.889 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-27T22:27:54.927 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-27T22:27:54.939 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-27T22:27:54.960 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-27T22:27:54.971 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-27T22:27:54.993 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-27T22:27:55.008 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-27T22:27:55.053 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-27T22:27:55.099 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-27T22:27:55.142 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-27T22:27:55.163 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-27T22:27:55.191 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-27T22:27:55.270 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-27T22:27:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-27T22:27:55.310 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-27T22:27:55.350 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-27T22:27:55.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-27T22:27:55.486 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-27T22:27:55.526 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-27T22:27:55.550 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-27T22:27:55.644 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-27T22:27:55.686 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-27T22:27:55.734 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-27T22:27:55.798 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-27T22:27:55.932 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-27T22:27:55.987 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-27T22:27:56.032 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-27T22:27:56.046 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-27T22:27:56.160 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-27T22:27:56.201 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-27T22:27:56.222 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-27T22:27:56.255 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-27T22:27:56.315 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-27T22:27:56.561 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-27T22:27:56.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-27T22:27:56.644 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-27T22:27:56.685 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-27T22:27:56.715 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-27T22:27:56.793 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-27T22:27:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-27T22:27:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-27T22:27:56.907 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-27T22:27:56.942 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-27T22:27:57.030 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-27T22:27:57.061 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-27T22:27:57.162 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-27T22:27:57.211 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-27T22:27:57.301 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-27T22:27:57.391 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-27T22:27:57.422 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-27T22:27:57.453 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-27T22:27:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-27T22:27:57.515 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-27T22:27:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-27T22:27:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T22:27:57.924 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-27T22:27:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T22:27:57.957 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 100/162 2023-11-27T22:27:57.981 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-27T22:27:57.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-27T22:27:58.015 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-27T22:27:58.047 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-27T22:27:58.249 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-27T22:27:58.279 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-27T22:27:58.357 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-27T22:27:58.419 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-27T22:27:58.447 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T22:27:58.518 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T22:27:58.540 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 104/162 2023-11-27T22:27:59.001 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-27T22:27:59.126 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-27T22:28:00.342 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-27T22:28:00.437 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-27T22:28:00.471 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-27T22:28:00.498 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-27T22:28:00.527 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-27T22:28:00.560 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-27T22:28:00.576 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T22:28:00.612 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T22:28:00.872 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-27T22:28:00.898 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T22:28:00.987 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 99/162 2023-11-27T22:28:01.019 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 100/162 2023-11-27T22:28:01.055 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-27T22:28:01.147 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T22:28:01.219 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T22:28:01.481 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-27T22:28:01.509 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T22:28:01.537 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T22:28:01.537 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-27T22:28:01.537 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-27T22:28:01.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:01.563 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 103/162 2023-11-27T22:28:01.586 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 104/162 2023-11-27T22:28:01.733 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T22:28:03.648 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T22:28:03.682 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T22:28:04.234 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 105/162 2023-11-27T22:28:04.269 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T22:28:04.354 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 106/162 2023-11-27T22:28:04.355 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-27T22:28:04.355 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-27T22:28:04.355 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:04.395 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2023-11-27T22:28:13.270 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2023-11-27T22:28:13.271 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2023-11-27T22:28:13.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T22:28:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T22:28:13.453 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:13.453 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-27T22:28:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:15.030 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T22:28:15.056 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T22:28:15.056 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:15.056 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-27T22:28:15.056 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T22:28:15.056 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T22:28:15.057 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:15.264 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T22:28:15.286 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T22:28:15.286 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:15.287 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-27T22:28:15.287 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T22:28:15.287 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T22:28:15.287 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T22:28:15.762 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T22:28:15.763 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:15.763 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-27T22:28:15.763 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T22:28:15.763 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T22:28:15.763 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:15.850 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-27T22:28:16.264 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 107/162 2023-11-27T22:28:16.264 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2023-11-27T22:28:16.264 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2023-11-27T22:28:16.264 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2023-11-27T22:28:16.265 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2023-11-27T22:28:16.265 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2023-11-27T22:28:16.265 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2023-11-27T22:28:16.265 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2023-11-27T22:28:16.265 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:16.288 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T22:28:16.340 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T22:28:16.370 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 114/162 2023-11-27T22:28:16.429 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T22:28:16.431 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 115/162 2023-11-27T22:28:16.444 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 108/162 2023-11-27T22:28:16.445 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:16.445 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-27T22:28:16.445 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:16.455 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T22:28:16.678 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T22:28:16.706 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T22:28:17.673 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T22:28:17.697 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T22:28:17.797 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T22:28:17.947 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 119/162 2023-11-27T22:28:17.974 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T22:28:17.996 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T22:28:17.996 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:17.997 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-27T22:28:17.997 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T22:28:17.997 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T22:28:17.997 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:18.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T22:28:18.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T22:28:18.049 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 109/162 2023-11-27T22:28:18.049 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:18.049 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-27T22:28:18.049 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T22:28:18.049 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-27T22:28:18.050 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:18.053 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T22:28:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el9.x86_64 122/162 2023-11-27T22:28:18.249 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T22:28:18.271 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 110/162 2023-11-27T22:28:18.271 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:18.271 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-27T22:28:18.271 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T22:28:18.272 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-27T22:28:18.272 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:18.708 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T22:28:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 111/162 2023-11-27T22:28:18.731 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:18.731 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-27T22:28:18.731 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T22:28:18.731 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-27T22:28:18.731 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:18.835 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-27T22:28:18.896 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-27T22:28:18.928 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T22:28:18.949 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T22:28:18.950 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:18.950 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-27T22:28:18.950 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T22:28:18.950 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T22:28:18.950 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:18.986 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T22:28:19.008 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T22:28:19.008 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:19.008 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-27T22:28:19.008 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:19.070 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T22:28:19.092 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T22:28:19.092 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:19.092 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-27T22:28:19.092 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T22:28:19.093 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T22:28:19.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:19.221 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T22:28:19.250 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:18.0.0-7498.g369173db.el9.noarch 113/162 2023-11-27T22:28:19.279 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 114/162 2023-11-27T22:28:19.340 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 115/162 2023-11-27T22:28:19.364 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T22:28:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T22:28:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T22:28:19.410 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:19.410 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-27T22:28:19.410 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T22:28:19.410 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T22:28:19.410 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:19.587 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 116/162 2023-11-27T22:28:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T22:28:20.583 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 117/162 2023-11-27T22:28:20.616 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T22:28:20.716 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 118/162 2023-11-27T22:28:20.865 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 119/162 2023-11-27T22:28:20.901 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T22:28:20.924 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 120/162 2023-11-27T22:28:20.924 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:20.924 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-27T22:28:20.924 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T22:28:20.924 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-27T22:28:20.925 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:20.969 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T22:28:20.979 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 121/162 2023-11-27T22:28:21.027 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:18.0.0-7498.g369173db.el9.x86_64 122/162 2023-11-27T22:28:21.807 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-27T22:28:21.845 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T22:28:21.867 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 124/162 2023-11-27T22:28:21.868 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:21.868 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-27T22:28:21.868 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T22:28:21.868 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-27T22:28:21.868 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:21.937 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T22:28:21.959 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7498.g36917 125/162 2023-11-27T22:28:21.959 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:21.959 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-27T22:28:21.959 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:22.005 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T22:28:22.027 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 126/162 2023-11-27T22:28:22.027 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:22.028 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-27T22:28:22.028 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T22:28:22.028 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-27T22:28:22.028 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:22.330 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T22:28:22.353 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 127/162 2023-11-27T22:28:22.353 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-27T22:28:22.354 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-27T22:28:22.354 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T22:28:22.354 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-27T22:28:22.354 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:23.232 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 128/162 2023-11-27T22:28:23.282 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 129/162 2023-11-27T22:28:23.322 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 130/162 2023-11-27T22:28:23.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-27T22:28:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-27T22:28:23.654 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-27T22:28:23.686 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 134/162 2023-11-27T22:28:23.722 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 135/162 2023-11-27T22:28:23.760 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-27T22:28:23.789 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-27T22:28:23.870 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-27T22:28:23.924 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-27T22:28:23.962 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-27T22:28:24.562 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T22:28:24.603 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T22:28:24.623 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T22:28:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 142/162 2023-11-27T22:28:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-27T22:28:25.625 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-27T22:28:25.666 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-27T22:28:25.748 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-27T22:28:25.779 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-27T22:28:25.804 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-27T22:28:25.830 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-27T22:28:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-27T22:28:25.856 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T22:28:25.932 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T22:28:25.960 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-27T22:28:25.990 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-27T22:28:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-27T22:28:26.016 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T22:28:26.085 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T22:28:26.108 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-27T22:28:26.116 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T22:28:26.116 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T22:28:26.150 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 128/162 2023-11-27T22:28:26.191 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 129/162 2023-11-27T22:28:26.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 130/162 2023-11-27T22:28:26.264 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-27T22:28:26.303 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T22:28:26.303 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T22:28:26.387 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T22:28:26.411 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-27T22:28:26.444 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-27T22:28:26.446 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-27T22:28:26.471 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-27T22:28:26.534 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T22:28:26.561 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-27T22:28:26.603 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 134/162 2023-11-27T22:28:26.636 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 135/162 2023-11-27T22:28:26.676 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-27T22:28:26.706 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-27T22:28:26.810 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-27T22:28:26.863 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-27T22:28:26.898 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-27T22:28:27.529 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T22:28:27.561 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T22:28:27.581 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-27T22:28:28.386 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 142/162 2023-11-27T22:28:28.483 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-27T22:28:28.523 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-27T22:28:28.564 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-27T22:28:28.652 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-27T22:28:28.687 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-27T22:28:28.712 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-27T22:28:28.738 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-27T22:28:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-27T22:28:28.764 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T22:28:28.848 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-27T22:28:28.876 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-27T22:28:28.907 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-27T22:28:28.932 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-27T22:28:28.932 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T22:28:29.016 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-27T22:28:29.041 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-27T22:28:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T22:28:29.048 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T22:28:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-27T22:28:29.236 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T22:28:29.319 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-27T22:28:29.352 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-27T22:28:29.377 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-27T22:28:29.404 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-27T22:28:29.468 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el9.x86_64 1/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 3/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 4/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 5/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 6/162 2023-11-27T22:28:31.042 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 7/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 11/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 12/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 13/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 14/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 15/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 16/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 17/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 18/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 19/162 2023-11-27T22:28:31.043 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 20/162 2023-11-27T22:28:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 21/162 2023-11-27T22:28:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 22/162 2023-11-27T22:28:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 23/162 2023-11-27T22:28:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 24/162 2023-11-27T22:28:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 25/162 2023-11-27T22:28:31.044 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 26/162 2023-11-27T22:28:31.045 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 27/162 2023-11-27T22:28:31.056 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 28/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 29/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 30/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 31/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 32/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 33/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 34/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 35/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 36/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el9.noarch 37/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 38/162 2023-11-27T22:28:31.057 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-27T22:28:31.058 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-27T22:28:31.059 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-27T22:28:31.060 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-27T22:28:31.061 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-27T22:28:31.062 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-27T22:28:31.063 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-27T22:28:31.064 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el9.x86_64 133/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 135/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-27T22:28:31.065 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-27T22:28:31.066 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-27T22:28:31.067 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-27T22:28:31.068 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-27T22:28:33.736 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-27T22:28:33.736 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:33.736 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-11-27T22:28:33.736 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:33.736 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: acl-2.3.1-4.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-27T22:28:33.737 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.738 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.739 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-27T22:28:33.740 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.6-16.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.741 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-27T22:28:33.742 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.11-1.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-27T22:28:33.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-27T22:28:33.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-27T22:28:33.747 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-3.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-27T22:28:33.748 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:33.749 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:18.0.0-7498.g369173db.el9.x86_64 1/162 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2/162 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 3/162 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 4/162 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7498.g36917 5/162 2023-11-27T22:28:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 6/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 7/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 8/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 9/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 10/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 11/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 12/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 13/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_ 14/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 15/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 16/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:18.0.0-7498.g369173db.el9.x86_6 17/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:18.0.0-7498.g369173db.el9.x86 18/162 2023-11-27T22:28:33.803 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:18.0.0-7498.g369173db.el9.x86_64 19/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7498.g369173db.el 20/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:18.0.0-7498.g369173db.el9. 21/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_6 22/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 23/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 24/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 25/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 26/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 27/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 28/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7498.g369173db. 29/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noa 30/162 2023-11-27T22:28:33.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.n 31/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7498.g369 32/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el 33/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 34/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7498.g369173db.e 35/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 36/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:18.0.0-7498.g369173db.el9.noarch 37/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 38/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-27T22:28:33.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-27T22:28:33.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-27T22:28:33.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-27T22:28:33.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-27T22:28:33.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-27T22:28:33.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-27T22:28:33.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-27T22:28:33.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:18.0.0-7498.g369173db.el9.x86_64 133/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:18.0.0-7498.g369173db.el9.x86_64 135/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-27T22:28:33.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-27T22:28:33.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-27T22:28:33.815 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-27T22:28:34.304 DEBUG:teuthology.parallel:result is None 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:36.247 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: acl-2.3.1-4.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-27T22:28:36.248 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.249 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.250 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:18.0.0-7498.g369173db.el9.noarch 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-27T22:28:36.251 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-16.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-27T22:28:36.252 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-27T22:28:36.253 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.11-1.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.254 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-27T22:28:36.255 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-27T22:28:36.256 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-27T22:28:36.257 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-27T22:28:36.258 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:18.0.0-7498.g369173db.el9.x86_64 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-3.el9.x86_64 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-27T22:28:36.259 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-27T22:28:36.260 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-27T22:28:36.260 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-27T22:28:36.260 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-27T22:28:36.260 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:36.260 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2023-11-27T22:28:36.870 DEBUG:teuthology.parallel:result is None 2023-11-27T22:28:36.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T22:28:37.021 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T22:28:37.047 INFO:teuthology.orchestra.run.smithi154.stdout:18.0.0-7498.g369173db.el9 2023-11-27T22:28:37.047 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el9 2023-11-27T22:28:37.047 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T22:28:37.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T22:28:37.184 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-27T22:28:37.205 INFO:teuthology.orchestra.run.smithi194.stdout:18.0.0-7498.g369173db.el9 2023-11-27T22:28:37.206 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498.g369173db.el9 2023-11-27T22:28:37.206 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498.g369173db is installed. 2023-11-27T22:28:37.206 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-27T22:28:37.206 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:37.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T22:28:37.241 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:37.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T22:28:37.276 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-27T22:28:37.276 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:37.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T22:28:37.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T22:28:37.382 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:37.382 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T22:28:37.410 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T22:28:37.477 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-27T22:28:37.477 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:37.477 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T22:28:37.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T22:28:37.577 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:37.578 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T22:28:37.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T22:28:37.672 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-27T22:28:37.672 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:37.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T22:28:37.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T22:28:37.772 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:37.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T22:28:37.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T22:28:37.865 INFO:teuthology.run_tasks:Running task ceph... 2023-11-27T22:28:37.932 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-27T22:28:37.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-11-27T22:28:37.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2023-11-27T22:28:37.962 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-27T22:28:37.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T22:28:38.005 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T22:28:38.032 INFO:tasks.ceph:Creating extra log directories... 2023-11-27T22:28:38.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T22:28:38.075 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T22:28:38.108 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-27T22:28:38.108 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-27T22:28:38.108 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-27T22:28:38.109 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:38.109 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T22:28:38.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:38.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:38.304 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:38.304 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T22:28:38.319 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:38.437 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:38.469 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-27T22:28:38.469 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-27T22:28:38.469 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210', 'branch': 'wip-yuri10-testing-2023-11-22-1112', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7468210', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-11-22-1112'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-11-22-1112', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8541, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-11-22-1112', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3HfNhlm7IIuqF5CEHRvcc3BBpPBo9YpuZPiuNXf3ohYXfRS4eI7VlKuxezkNDYzYT+bgxlIgxLgmK7fQNHKOg=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDmQXHpY+MkIvzd/jPTLJcVE7t1ZTK8x8oh64/w9Ha51Eyz3TDHENJ0yA1Iej8QqnjTaGi1GZhgrEKfI+Rx30Js='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-27_17:14:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-27T22:28:38.470 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T22:28:38.472 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T22:28:38.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T22:28:38.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T22:28:38.585 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:38.585 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T22:28:38.607 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T22:28:38.607 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-27 22:28:26.842808438 +0000 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-27 22:26:23.693473655 +0000 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-27 22:26:23.693473655 +0000 2023-11-27T22:28:38.662 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-27 22:26:23.693473655 +0000 2023-11-27T22:28:38.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T22:28:38.727 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-27T22:28:38.728 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-27T22:28:38.728 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00017613 s, 2.9 MB/s 2023-11-27T22:28:38.729 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T22:28:38.785 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-11-27T22:28:38.840 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-27 22:28:26.842808438 +0000 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-27 22:26:24.192460273 +0000 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-27 22:26:24.192460273 +0000 2023-11-27T22:28:38.841 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-27 22:26:24.192460273 +0000 2023-11-27T22:28:38.841 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T22:28:38.906 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-27T22:28:38.906 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-27T22:28:38.906 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000204704 s, 2.5 MB/s 2023-11-27T22:28:38.907 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T22:28:38.963 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-11-27T22:28:39.018 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T22:28:39.018 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:39.018 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-27T22:28:39.018 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:39.018 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:39.018 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-27 22:28:26.843808413 +0000 2023-11-27T22:28:39.019 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-27 22:26:24.689446944 +0000 2023-11-27T22:28:39.019 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-27 22:26:24.689446944 +0000 2023-11-27T22:28:39.019 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-27 22:26:24.689446944 +0000 2023-11-27T22:28:39.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T22:28:39.084 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-27T22:28:39.084 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-27T22:28:39.084 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000227087 s, 2.3 MB/s 2023-11-27T22:28:39.085 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T22:28:39.141 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-11-27T22:28:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T22:28:39.196 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:39.196 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-27T22:28:39.196 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:39.196 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:39.196 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-11-27 22:28:26.843808413 +0000 2023-11-27T22:28:39.197 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-11-27 22:26:25.178433829 +0000 2023-11-27T22:28:39.197 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-11-27 22:26:25.178433829 +0000 2023-11-27T22:28:39.197 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-11-27 22:26:25.178433829 +0000 2023-11-27T22:28:39.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T22:28:39.262 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-11-27T22:28:39.262 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-11-27T22:28:39.262 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000200255 s, 2.6 MB/s 2023-11-27T22:28:39.263 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T22:28:39.319 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:39.319 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:39.319 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T22:28:39.336 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T22:28:39.336 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-11-27 22:28:29.796398153 +0000 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-11-27 22:26:23.675487930 +0000 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-11-27 22:26:23.675487930 +0000 2023-11-27T22:28:39.392 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-11-27 22:26:23.675487930 +0000 2023-11-27T22:28:39.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T22:28:39.459 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-11-27T22:28:39.459 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-11-27T22:28:39.459 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000188961 s, 2.7 MB/s 2023-11-27T22:28:39.460 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T22:28:39.516 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-11-27 22:28:29.796398153 +0000 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-11-27 22:26:24.172477645 +0000 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-11-27 22:26:24.172477645 +0000 2023-11-27T22:28:39.572 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-11-27 22:26:24.172477645 +0000 2023-11-27T22:28:39.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T22:28:39.637 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-11-27T22:28:39.638 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-11-27T22:28:39.638 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000172096 s, 3.0 MB/s 2023-11-27T22:28:39.639 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T22:28:39.694 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2023-11-27T22:28:39.749 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-11-27 22:28:29.797398133 +0000 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-11-27 22:26:24.670467340 +0000 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-11-27 22:26:24.670467340 +0000 2023-11-27T22:28:39.750 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-11-27 22:26:24.670467340 +0000 2023-11-27T22:28:39.750 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T22:28:39.815 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-11-27T22:28:39.815 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-11-27T22:28:39.815 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.0001814 s, 2.8 MB/s 2023-11-27T22:28:39.816 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T22:28:39.871 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2023-11-27T22:28:39.925 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T22:28:39.925 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T22:28:39.925 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-11-27T22:28:39.926 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T22:28:39.926 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2023-11-27T22:28:39.926 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2023-11-27 22:28:29.797398133 +0000 2023-11-27T22:28:39.926 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2023-11-27 22:26:25.166457076 +0000 2023-11-27T22:28:39.926 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2023-11-27 22:26:25.166457076 +0000 2023-11-27T22:28:39.926 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2023-11-27 22:26:25.166457076 +0000 2023-11-27T22:28:39.926 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T22:28:39.991 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2023-11-27T22:28:39.991 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2023-11-27T22:28:39.991 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000266238 s, 1.9 MB/s 2023-11-27T22:28:39.992 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T22:28:40.048 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:40.048 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T22:28:40.048 INFO:tasks.ceph:Generating config... 2023-11-27T22:28:40.049 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-27T22:28:40.049 INFO:tasks.ceph:[client] debug client = 20 2023-11-27T22:28:40.049 INFO:tasks.ceph:[client] debug ms = 1 2023-11-27T22:28:40.050 INFO:tasks.ceph:[client] pid file = 2023-11-27T22:28:40.050 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-27T22:28:40.050 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-27T22:28:40.050 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-27T22:28:40.050 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-27T22:28:40.050 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-27T22:28:40.050 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-27T22:28:40.050 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-27T22:28:40.050 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-27T22:28:40.051 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-27T22:28:40.051 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-27T22:28:40.052 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-27T22:28:40.053 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-27T22:28:40.053 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-27T22:28:40.053 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-27T22:28:40.053 INFO:tasks.ceph:Setting up mon.a... 2023-11-27T22:28:40.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-27T22:28:40.106 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.keyring 2023-11-27T22:28:40.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-27T22:28:40.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T22:28:40.180 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.154'), ('mon.b', '172.21.15.194'), ('mon.c', '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]')] 2023-11-27T22:28:40.180 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.154,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-27T22:28:40.181 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:40.181 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T22:28:40.235 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.154 --add b 172.21.15.194 --addv c '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:40.319 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: generated fsid 480179ad-e540-429b-b1ff-bfa2150dc1f7 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:setting min_mon_release = quincy 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:epoch 0 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:fsid 480179ad-e540-429b-b1ff-bfa2150dc1f7 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:last_changed 2023-11-27T22:28:40.318833+0000 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:created 2023-11-27T22:28:40.318833+0000 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:min_mon_release 17 (quincy) 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:election_strategy: 1 2023-11-27T22:28:40.320 INFO:teuthology.orchestra.run.smithi154.stdout:0: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.a 2023-11-27T22:28:40.321 INFO:teuthology.orchestra.run.smithi154.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2023-11-27T22:28:40.321 INFO:teuthology.orchestra.run.smithi154.stdout:2: [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] mon.c 2023-11-27T22:28:40.321 INFO:teuthology.orchestra.run.smithi154.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-27T22:28:40.322 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T22:28:40.337 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 480179ad-e540-429b-b1ff-bfa2150dc1f7... 2023-11-27T22:28:40.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T22:28:40.379 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T22:28:40.427 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-11-27T22:28:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-11-27T22:28:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T22:28:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-11-27T22:28:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-11-27T22:28:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-11-27T22:28:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-11-27T22:28:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.154,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 480179ad-e540-429b-b1ff-bfa2150dc1f7 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-11-27T22:28:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-11-27T22:28:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-11-27T22:28:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-27T22:28:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T22:28:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-11-27T22:28:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-11-27T22:28:40.438 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-11-27T22:28:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-11-27T22:28:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-11-27T22:28:40.440 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2023-11-27T22:28:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2023-11-27T22:28:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T22:28:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2023-11-27T22:28:40.440 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T22:28:40.441 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2023-11-27T22:28:40.442 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2023-11-27T22:28:40.443 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.154,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 480179ad-e540-429b-b1ff-bfa2150dc1f7 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.444 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2023-11-27T22:28:40.445 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2023-11-27T22:28:40.446 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2023-11-27T22:28:40.447 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2023-11-27T22:28:40.448 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T22:28:40.449 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2023-11-27T22:28:40.450 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = "" 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2023-11-27T22:28:40.451 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2023-11-27T22:28:40.452 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2023-11-27T22:28:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2023-11-27T22:28:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2023-11-27T22:28:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2023-11-27T22:28:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2023-11-27T22:28:40.453 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2023-11-27T22:28:40.454 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-27T22:28:40.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-27T22:28:40.511 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-27T22:28:40.511 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:40.511 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-27T22:28:40.526 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:40.526 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-27T22:28:40.581 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:28:40.581 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:40.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T22:28:40.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T22:28:40.661 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:28:40.661 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:40.716 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:28:40.716 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:40.716 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T22:28:40.716 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T22:28:40.756 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:28:40.756 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:40.810 INFO:tasks.ceph:Setting up mon nodes... 2023-11-27T22:28:40.811 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-27T22:28:40.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T22:28:40.866 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T22:28:40.868 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T22:28:40.936 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T22:28:40.939 INFO:tasks.ceph:Setting up mds nodes... 2023-11-27T22:28:40.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T22:28:40.994 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T22:28:40.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-27T22:28:41.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T22:28:41.118 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T22:28:41.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-27T22:28:41.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T22:28:41.202 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T22:28:41.205 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-27T22:28:41.232 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T22:28:41.326 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-27T22:28:41.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-27T22:28:41.355 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-27T22:28:41.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-27T22:28:41.398 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-27T22:28:41.413 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-27T22:28:41.495 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-27T22:28:41.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-27T22:28:41.551 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-27T22:28:41.566 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-27T22:28:41.650 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-27T22:28:41.664 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-27T22:28:41.665 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T22:28:41.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-27T22:28:41.692 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:41.692 INFO:tasks.ceph:role: osd.0 2023-11-27T22:28:41.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:28:41.693 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T22:28:41.766 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:41.766 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:41.767 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:42.284 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-27T22:28:42.286 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-27T22:28:42.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-27T22:28:42.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-27T22:28:42.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-27T22:28:42.530 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:42.530 INFO:tasks.ceph:role: osd.1 2023-11-27T22:28:42.530 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:28:42.530 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T22:28:42.604 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:42.605 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:43.058 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-27T22:28:43.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-27T22:28:43.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-27T22:28:43.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-27T22:28:43.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-27T22:28:43.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:43.255 INFO:tasks.ceph:role: osd.2 2023-11-27T22:28:43.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:28:43.256 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T22:28:43.330 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:43.331 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:43.821 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-27T22:28:43.823 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-27T22:28:43.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-27T22:28:43.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-27T22:28:44.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-27T22:28:44.071 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:44.071 INFO:tasks.ceph:role: osd.3 2023-11-27T22:28:44.071 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:28:44.071 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:44.146 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:44.147 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:44.654 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-11-27T22:28:44.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-11-27T22:28:44.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-27T22:28:44.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-27T22:28:44.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:44.937+0000 7fcbc7b4a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-27T22:28:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:44.937+0000 7fcbc7b4a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-27T22:28:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:44.937+0000 7fcbc7b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T22:28:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:44.937+0000 7fcbc7b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T22:28:44.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:44.937+0000 7fcbc7b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T22:28:44.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:44.938+0000 7fcbc7b4a500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-27T22:28:47.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-27T22:28:47.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:47.912+0000 7f5826e10500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-27T22:28:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:47.912+0000 7f5826e10500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-27T22:28:47.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:47.912+0000 7f5826e10500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T22:28:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:47.912+0000 7f5826e10500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T22:28:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:47.912+0000 7f5826e10500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T22:28:47.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:47.913+0000 7f5826e10500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-27T22:28:50.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-27T22:28:50.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:50.887+0000 7f2814c1e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-27T22:28:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:50.887+0000 7f2814c1e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-27T22:28:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:50.887+0000 7f2814c1e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T22:28:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:50.887+0000 7f2814c1e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T22:28:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:50.887+0000 7f2814c1e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T22:28:50.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:50.888+0000 7f2814c1e500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-27T22:28:53.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-27T22:28:53.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:28:53.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:53.859+0000 7f408ab8d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-27T22:28:53.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:53.860+0000 7f408ab8d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-27T22:28:53.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:53.860+0000 7f408ab8d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T22:28:53.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:53.860+0000 7f408ab8d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T22:28:53.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:53.860+0000 7f408ab8d500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T22:28:53.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:28:53.860+0000 7f408ab8d500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-27T22:28:56.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-27T22:28:56.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-27T22:28:56.777 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:56.777 INFO:tasks.ceph:role: osd.4 2023-11-27T22:28:56.778 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:28:56.778 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T22:28:56.856 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:56.858 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:57.352 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-11-27T22:28:57.354 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-11-27T22:28:57.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-27T22:28:57.500 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-27T22:28:57.535 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-27T22:28:57.603 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:57.603 INFO:tasks.ceph:role: osd.5 2023-11-27T22:28:57.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:28:57.603 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:57.677 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:57.678 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:57.678 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:58.125 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-11-27T22:28:58.127 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-11-27T22:28:58.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-27T22:28:58.217 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-27T22:28:58.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-27T22:28:58.315 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:58.315 INFO:tasks.ceph:role: osd.6 2023-11-27T22:28:58.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:28:58.315 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:58.388 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:58.389 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:58.389 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:58.389 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:58.872 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-11-27T22:28:58.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-11-27T22:28:58.875 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-27T22:28:59.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-27T22:28:59.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-27T22:28:59.137 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T22:28:59.137 INFO:tasks.ceph:role: osd.7 2023-11-27T22:28:59.137 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:28:59.137 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T22:28:59.212 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T22:28:59.213 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T22:28:59.720 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2023-11-27T22:28:59.722 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2023-11-27T22:28:59.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-27T22:28:59.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-27T22:28:59.911 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:29:00.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:00.017+0000 7fdf06c12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-27T22:29:00.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:00.018+0000 7fdf06c12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-27T22:29:00.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:00.018+0000 7fdf06c12500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T22:29:00.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:00.018+0000 7fdf06c12500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T22:29:00.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:00.018+0000 7fdf06c12500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T22:29:00.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:00.018+0000 7fdf06c12500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-27T22:29:02.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-27T22:29:02.900 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:29:02.989 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:02.988+0000 7f3fb4618500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-27T22:29:02.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:02.988+0000 7f3fb4618500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-27T22:29:02.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:02.988+0000 7f3fb4618500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T22:29:02.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:02.988+0000 7f3fb4618500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T22:29:02.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:02.988+0000 7f3fb4618500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T22:29:02.991 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:02.988+0000 7f3fb4618500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-27T22:29:05.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-27T22:29:05.876 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:29:05.968 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:05.965+0000 7fd45c416500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-27T22:29:05.968 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:05.966+0000 7fd45c416500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-27T22:29:05.968 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:05.966+0000 7fd45c416500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T22:29:05.968 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:05.966+0000 7fd45c416500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T22:29:05.968 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:05.966+0000 7fd45c416500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T22:29:05.969 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:05.966+0000 7fd45c416500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-27T22:29:08.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:08.474 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:08.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-27T22:29:08.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:29:08.956 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:08.954+0000 7f782b60c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-27T22:29:08.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:08.954+0000 7f782b60c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-27T22:29:08.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:08.954+0000 7f782b60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T22:29:08.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:08.954+0000 7f782b60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T22:29:08.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:08.954+0000 7f782b60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T22:29:08.957 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:08.955+0000 7f782b60c500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-27T22:29:11.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-27T22:29:11.844 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-27T22:29:11.845 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:11.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-27T22:29:11.879 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:11.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-27T22:29:11.949 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:11.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-27T22:29:12.019 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:12.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-27T22:29:12.088 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:12.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-27T22:29:12.157 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:12.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-27T22:29:12.228 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:12.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-27T22:29:12.296 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.296 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-27T22:29:12.328 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-27T22:29:12.399 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.400 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-27T22:29:12.470 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-27T22:29:12.539 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.540 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-27T22:29:12.608 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.608 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-27T22:29:12.677 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.677 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-27T22:29:12.745 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:12.745 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-27T22:29:12.761 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:12.761 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-27T22:29:12.816 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.816 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-27T22:29:12.832 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:12.832 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-27T22:29:12.887 INFO:tasks.ceph:Adding keys to all mons... 2023-11-27T22:29:12.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T22:29:12.889 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAYGGVlIWOXMxAAG4LnC1Jz1fiKWPPltToLqw== 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAYGGVlBks2OxAA4bQrCOU+i7B8hITtibvYBg== 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlDNn7BhAAtZaY+ycdpmuztUZzti3T+A== 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAcGGVlcF3oNxAAO2F7uGgoxLhQd83SbEAiPw== 2023-11-27T22:29:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAfGGVlmhJuNhAAeOR+kMb5Ze6TXE0DgmrDUg== 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAiGGVlm0LsNBAAbSoRgp4qUWPQlG40AYoVcA== 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAlGGVl9VlIMxAAjrajQu2F1ObPZjTfp1cCZg== 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAYGGVlpKfFNxAAJxXO0Mff3j2s4fBmq/uWqA== 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlKNoCDBAA1QR6HUt+vhEmUJC6g4YdYw== 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-11-27T22:29:12.931 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlLeNiExAAFZh7V7wGUUXIT4sCGIHs1g== 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAsGGVlaeIfARAAT4HcGx60gjMX0oElkwuXDA== 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAuGGVlib7zOhAAjbkYKJSRVrLr/zS18CiibQ== 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAxGGVlk0mgORAAay/uSWKO+TE/re1yLktz+w== 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQA0GGVlQR70OBAAUOSb/7P2GFbZ++nZic7Q9A== 2023-11-27T22:29:12.932 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlAhSrFxAA3iO+CO56glsDGfCwT7XFtw== 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVl6gF2HRAAzNuqgj5114hlvZVp+3icMg== 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlDPzWIBAAPi+hZOUaD0dsIEUGc+WxBQ== 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2023-11-27T22:29:12.933 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlkXmvJhAABkeC/4DLUK1Ooc6VCjJMdw== 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAYGGVlIWOXMxAAG4LnC1Jz1fiKWPPltToLqw== 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAYGGVlBks2OxAA4bQrCOU+i7B8hITtibvYBg== 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVlDNn7BhAAtZaY+ycdpmuztUZzti3T+A== 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAcGGVlcF3oNxAAO2F7uGgoxLhQd83SbEAiPw== 2023-11-27T22:29:12.953 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAfGGVlmhJuNhAAeOR+kMb5Ze6TXE0DgmrDUg== 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAiGGVlm0LsNBAAbSoRgp4qUWPQlG40AYoVcA== 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAlGGVl9VlIMxAAjrajQu2F1ObPZjTfp1cCZg== 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAYGGVlpKfFNxAAJxXO0Mff3j2s4fBmq/uWqA== 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVlKNoCDBAA1QR6HUt+vhEmUJC6g4YdYw== 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVlLeNiExAAFZh7V7wGUUXIT4sCGIHs1g== 2023-11-27T22:29:12.954 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAsGGVlaeIfARAAT4HcGx60gjMX0oElkwuXDA== 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAuGGVlib7zOhAAjbkYKJSRVrLr/zS18CiibQ== 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAxGGVlk0mgORAAay/uSWKO+TE/re1yLktz+w== 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQA0GGVlQR70OBAAUOSb/7P2GFbZ++nZic7Q9A== 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVlAhSrFxAA3iO+CO56glsDGfCwT7XFtw== 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout:[client.2] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVl6gF2HRAAzNuqgj5114hlvZVp+3icMg== 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2023-11-27T22:29:12.955 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVlDPzWIBAAPi+hZOUaD0dsIEUGc+WxBQ== 2023-11-27T22:29:12.956 INFO:teuthology.orchestra.run.smithi194.stdout:[client.3] 2023-11-27T22:29:12.956 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQAZGGVlkXmvJhAABkeC/4DLUK1Ooc6VCjJMdw== 2023-11-27T22:29:12.956 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T22:29:12.977 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T22:29:13.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.218 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.274 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.329 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T22:29:13.382 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T22:29:13.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T22:29:13.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.550 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.606 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.661 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.715 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T22:29:13.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.770 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.827 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.884 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.940 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T22:29:13.995 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-27T22:29:13.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-27T22:29:14.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T22:29:14.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-27T22:29:14.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-27T22:29:14.172 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T22:29:14.270 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-27T22:29:14.298 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-27T22:29:14.366 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T22:29:14.462 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-27T22:29:14.489 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:29:14.491 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T22:29:14.543 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-27T22:29:14.544 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-27T22:29:14.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-27T22:29:14.546 INFO:tasks.ceph.mon.a:Started 2023-11-27T22:29:14.547 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-27T22:29:14.547 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-27T22:29:14.586 INFO:tasks.ceph.mon.b:Started 2023-11-27T22:29:14.586 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-27T22:29:14.586 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-27T22:29:14.588 INFO:tasks.ceph.mon.c:Started 2023-11-27T22:29:14.588 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-27T22:29:14.588 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-27T22:29:14.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-27T22:29:14.591 INFO:tasks.ceph.mgr.y:Started 2023-11-27T22:29:14.591 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-27T22:29:14.591 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-27T22:29:14.593 INFO:tasks.ceph.mgr.x:Started 2023-11-27T22:29:14.593 INFO:tasks.ceph:Setting crush tunables to default 2023-11-27T22:29:14.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd crush tunables default 2023-11-27T22:29:14.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.690+0000 7f4136061640 1 Processor -- start 2023-11-27T22:29:14.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f4136061640 1 -- start start 2023-11-27T22:29:14.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f4136061640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f413015e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f4136061640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 0x7f41300b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f4136061640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41300ad470 con 0x7f4130071b60 2023-11-27T22:29:14.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f4136061640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41300b2740 con 0x7f413006bbf0 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f4136061640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300ad750 con 0x7f4130157ab0 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.691+0000 7f412ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 0x7f41300b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 0x7f41300b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44276/0 (socket says 172.21.15.154:44276) 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412ffff640 1 -- 172.21.15.154:0/3255070927 learned_addr learned my addr 172.21.15.154:0/3255070927 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412f7fe640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f413015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412ffff640 1 -- 172.21.15.154:0/3255070927 >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 msgr2=0x7f41300b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412ffff640 1 -- 172.21.15.154:0/3255070927 >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 msgr2=0x7f41300b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412ffff640 1 --2- 172.21.15.154:0/3255070927 >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 0x7f41300b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412ffff640 1 --2- 172.21.15.154:0/3255070927 >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 0x7f41300b2b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412f7fe640 1 -- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 msgr2=0x7f413015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412f7fe640 1 -- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 msgr2=0x7f413015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T22:29:14.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412f7fe640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f413015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T22:29:14.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.692+0000 7f412f7fe640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f413015e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T22:29:14.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482060078 0 0) 0x7f41300ad470 con 0x7f4130071b60 2023-11-27T22:29:14.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4118003520 con 0x7f4130071b60 2023-11-27T22:29:14.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747698707 0 0) 0x7f4118003520 con 0x7f4130071b60 2023-11-27T22:29:14.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 msgr2=0x7f413015e270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T22:29:14.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f413015e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 msgr2=0x7f41300b2b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 --2- 172.21.15.154:0/3255070927 >> v2:172.21.15.154:3300/0 conn(0x7f413006bbf0 0x7f41300b2b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130071810 con 0x7f4130071b60 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f4124001670 con 0x7f4130071b60 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 >> v1:172.21.15.194:6789/0 conn(0x7f4130071b60 legacy=0x7f413006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4118003970 0x7f4118003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41180047c0 0x7f4118004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f4118005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300b2740 con 0x7f41180047c0 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300ad750 con 0x7f4118003970 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411800bae0 con 0x7f4130157ab0 2023-11-27T22:29:14.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412effd640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41180047c0 0x7f4118004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.883+0000 7f412f7fe640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4118003970 0x7f4118003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412ffff640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f4118005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412effd640 1 -- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 msgr2=0x7f4118005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412effd640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4130157ab0 0x7f4118005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412effd640 1 -- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4118003970 msgr2=0x7f4118003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412effd640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4118003970 0x7f4118003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412effd640 1 -- 172.21.15.154:0/3255070927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4118003520 con 0x7f41180047c0 2023-11-27T22:29:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.884+0000 7f412f7fe640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4118003970 0x7f4118003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.885+0000 7f412effd640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41180047c0 0x7f4118004c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f412400c0e0 tx=0x7f41180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d5eb223329fc11 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.885+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412402c9c0 con 0x7f41180047c0 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.885+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412402cb40 con 0x7f41180047c0 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.885+0000 7f412e7fc640 1 -- 172.21.15.154:0/3255070927 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124034440 con 0x7f41180047c0 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f4136061640 1 -- 172.21.15.154:0/3255070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41180047c0 msgr2=0x7f4118004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f4136061640 1 --2- 172.21.15.154:0/3255070927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41180047c0 0x7f4118004c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f412400c0e0 tx=0x7f41180057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f412ffff640 1 -- 172.21.15.154:0/3255070927 reap_dead start 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f4136061640 1 -- 172.21.15.154:0/3255070927 shutdown_connections 2023-11-27T22:29:14.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f4136061640 1 -- 172.21.15.154:0/3255070927 >> 172.21.15.154:0/3255070927 conn(0x7f4130070b30 msgr2=0x7f4130070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f4136061640 1 -- 172.21.15.154:0/3255070927 shutdown_connections 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.886+0000 7f4136061640 1 -- 172.21.15.154:0/3255070927 wait complete. 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.888+0000 7f4136061640 1 Processor -- start 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.888+0000 7f4136061640 1 -- start start 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.888+0000 7f4136061640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41180047c0 0x7f4130150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4130151f30 0x7f4130153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41301403d0 0x7f4130153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130152a60 con 0x7f4130151f30 2023-11-27T22:29:14.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41301f2f50 con 0x7f41180047c0 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41301524a0 con 0x7f41301403d0 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41180047c0 0x7f4130150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41180047c0 0x7f4130150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:59010/0 (socket says 172.21.15.154:59010) 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412f7fe640 1 -- 172.21.15.154:0/4220346315 learned_addr learned my addr 172.21.15.154:0/4220346315 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4130151f30 0x7f4130153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412ffff640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41301403d0 0x7f4130153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 -- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41301403d0 msgr2=0x7f4130153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41301403d0 0x7f4130153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 -- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41180047c0 msgr2=0x7f4130150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41180047c0 0x7f4130150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 -- 172.21.15.154:0/4220346315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130152780 con 0x7f4130151f30 2023-11-27T22:29:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f412effd640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4130151f30 0x7f4130153200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4124033000 tx=0x7f4124000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412402ccd0 con 0x7f4130151f30 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4124034870 con 0x7f4130151f30 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413014e0d0 con 0x7f4130151f30 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124034c20 con 0x7f4130151f30 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.889+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41301509d0 con 0x7f4130151f30 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.890+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f412403b070 con 0x7f4130151f30 2023-11-27T22:29:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.890+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4124006b60 con 0x7f4130151f30 2023-11-27T22:29:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.891+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130069320 con 0x7f4130151f30 2023-11-27T22:29:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.893+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f4124039070 con 0x7f4130151f30 2023-11-27T22:29:14.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.959+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4130067660 con 0x7f4130151f30 2023-11-27T22:29:14.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.960+0000 7f4117fff640 1 -- 172.21.15.154:0/4220346315 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4124007c30 con 0x7f4130151f30 2023-11-27T22:29:14.963 INFO:teuthology.orchestra.run.smithi154.stderr:adjusted tunables profile to default 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4130151f30 msgr2=0x7f4130153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4130151f30 0x7f4130153200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4124033000 tx=0x7f4124000fe0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 shutdown_connections 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41301403d0 0x7f4130153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4130151f30 0x7f4130153200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 --2- 172.21.15.154:0/4220346315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41180047c0 0x7f4130150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:14.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 >> 172.21.15.154:0/4220346315 conn(0x7f4130070b30 msgr2=0x7f41300b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:14.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 shutdown_connections 2023-11-27T22:29:14.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:14.961+0000 7f4136061640 1 -- 172.21.15.154:0/4220346315 wait complete. 2023-11-27T22:29:14.975 INFO:tasks.ceph:check_enable_crimson: False 2023-11-27T22:29:14.975 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-27T22:29:14.975 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:14.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-27T22:29:15.002 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:15.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-27T22:29:15.069 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:15.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-27T22:29:15.136 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:29:15.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-27T22:29:15.204 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:15.204 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-27T22:29:15.232 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:15.232 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-27T22:29:15.300 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:15.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-27T22:29:15.331 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:15.329+0000 7f663f60f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T22:29:15.358 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:29:15.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-27T22:29:15.362 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:15.359+0000 7f2bf923c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T22:29:15.386 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:15.384+0000 7f663f60f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T22:29:15.412 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 660e47f5-88f5-4658-82b2-2f3bc1aa0425 0 2023-11-27T22:29:15.413 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:15.411+0000 7f2bf923c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T22:29:15.560 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.550+0000 7fa59837c640 1 Processor -- start 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.550+0000 7fa59837c640 1 -- start start 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa59837c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 0x7fa5900b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa59837c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59015e2a0 con 0x7fa59015abf0 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa59837c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59015b240 con 0x7fa59015e730 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa59837c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59015b520 con 0x7fa590143490 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa596118640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 0x7fa5900b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa595917640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa59015e730 0x7fa59015a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:41370/0 (socket says 172.21.15.194:41370) 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa596118640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 0x7fa5900b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55382/0 (socket says 172.21.15.194:55382) 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa595917640 1 -- 172.21.15.194:0/3162496619 learned_addr learned my addr 172.21.15.194:0/3162496619 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa595116640 1 -- 172.21.15.194:0/3162496619 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303657482 0 0) 0x7fa59015b240 con 0x7fa59015e730 2023-11-27T22:29:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa596118640 1 -- 172.21.15.194:0/3162496619 >> v1:172.21.15.194:6789/0 conn(0x7fa59015e730 legacy=0x7fa59015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.551+0000 7fa596118640 1 -- 172.21.15.194:0/3162496619 >> v1:172.21.15.154:6789/0 conn(0x7fa59015abf0 legacy=0x7fa5900b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.552+0000 7fa596118640 1 -- 172.21.15.194:0/3162496619 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59015dc50 con 0x7fa590143490 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.552+0000 7fa596118640 1 --2- 172.21.15.194:0/3162496619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 0x7fa5900b0cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0097d0 tx=0x7fa58c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b7a20416fd03bdd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.552+0000 7fa595116640 1 -- 172.21.15.194:0/3162496619 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c031890 con 0x7fa590143490 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.552+0000 7fa595116640 1 -- 172.21.15.194:0/3162496619 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c0319f0 con 0x7fa590143490 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.552+0000 7fa595116640 1 -- 172.21.15.194:0/3162496619 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c031d80 con 0x7fa590143490 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 -- 172.21.15.194:0/3162496619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 msgr2=0x7fa5900b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 --2- 172.21.15.194:0/3162496619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 0x7fa5900b0cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0097d0 tx=0x7fa58c02b930 comp rx=0 tx=0).stop 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 -- 172.21.15.194:0/3162496619 shutdown_connections 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 --2- 172.21.15.194:0/3162496619 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa590143490 0x7fa5900b0cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.562 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 -- 172.21.15.194:0/3162496619 >> 172.21.15.194:0/3162496619 conn(0x7fa59006a4d0 msgr2=0x7fa59006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 -- 172.21.15.194:0/3162496619 shutdown_connections 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.553+0000 7fa59837c640 1 -- 172.21.15.194:0/3162496619 wait complete. 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.554+0000 7fa59837c640 1 Processor -- start 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.554+0000 7fa59837c640 1 -- start start 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa59837c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 0x7fa5900adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa59837c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59015abf0 0x7fa5900a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa59837c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 0x7fa5900a9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa59837c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5901362b0 con 0x7fa59015abf0 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa59837c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900a9ac0 con 0x7fa590143490 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa59837c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900a9da0 con 0x7fa59015e730 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 0x7fa5900a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596118640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 0x7fa5900adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 0x7fa5900a9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55392/0 (socket says 172.21.15.194:55392) 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596118640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 0x7fa5900adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57014/0 (socket says 172.21.15.194:57014) 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 -- 172.21.15.194:0/1508141474 learned_addr learned my addr 172.21.15.194:0/1508141474 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa595917640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59015abf0 0x7fa5900a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 -- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 msgr2=0x7fa5900adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 0x7fa5900adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 -- 172.21.15.194:0/1508141474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59015abf0 msgr2=0x7fa5900a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59015abf0 0x7fa5900a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596919640 1 -- 172.21.15.194:0/1508141474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c009400 con 0x7fa59015e730 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa596118640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 0x7fa5900adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.555+0000 7fa595917640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59015abf0 0x7fa5900a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa596919640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 0x7fa5900a9420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c7a0 tx=0x7fa58800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588003b70 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa588003cf0 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588003ea0 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa590133450 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590133a10 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa5880050d0 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.556+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa588012bf0 con 0x7fa59015e730 2023-11-27T22:29:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.557+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa590069400 con 0x7fa59015e730 2023-11-27T22:29:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.559+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa588012e00 con 0x7fa59015e730 2023-11-27T22:29:15.703 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.701+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "660e47f5-88f5-4658-82b2-2f3bc1aa0425", "id": 0} v 0) v1 -- 0x7fa5900b2820 con 0x7fa59015e730 2023-11-27T22:29:15.707 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.705+0000 7fa582ffd640 1 -- 172.21.15.194:0/1508141474 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "660e47f5-88f5-4658-82b2-2f3bc1aa0425", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa588005560 con 0x7fa59015e730 2023-11-27T22:29:15.707 INFO:teuthology.orchestra.run.smithi194.stdout:0 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 msgr2=0x7fa5900a9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 0x7fa5900a9420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c7a0 tx=0x7fa58800cc60 comp rx=0 tx=0).stop 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 shutdown_connections 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa59015e730 0x7fa5900a9420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59015abf0 0x7fa5900a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 --2- 172.21.15.194:0/1508141474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa590143490 0x7fa5900adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.708 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 >> 172.21.15.194:0/1508141474 conn(0x7fa59006a4d0 msgr2=0x7fa59015a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:15.709 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 shutdown_connections 2023-11-27T22:29:15.709 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.706+0000 7fa59837c640 1 -- 172.21.15.194:0/1508141474 wait complete. 2023-11-27T22:29:15.719 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 5a64a2f5-2127-41d8-be29-8a94f7478320 1 2023-11-27T22:29:15.820 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.818+0000 7f8722061640 1 Processor -- start 2023-11-27T22:29:15.821 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.818+0000 7f8722061640 1 -- start start 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f8722061640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f871c06e960 0x7f871c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f8722061640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c06d1b0 con 0x7f871c0cdbd0 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f8722061640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c06d490 con 0x7f871c15afe0 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f8722061640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c06d770 con 0x7f871c06e960 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f871affd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f871c06e960 0x7f871c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f871b7fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f871c15afe0 0x7f871c06e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:41372/0 (socket says 172.21.15.194:41372) 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.819+0000 7f871b7fe640 1 -- 172.21.15.194:0/3629966806 learned_addr learned my addr 172.21.15.194:0/3629966806 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871affd640 1 -- 172.21.15.194:0/3629966806 >> v1:172.21.15.194:6789/0 conn(0x7f871c15afe0 legacy=0x7f871c06e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871affd640 1 -- 172.21.15.194:0/3629966806 >> v1:172.21.15.154:6789/0 conn(0x7f871c0cdbd0 legacy=0x7f871c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871a7fc640 1 -- 172.21.15.194:0/3629966806 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836979061 0 0) 0x7f871c06d1b0 con 0x7f871c0cdbd0 2023-11-27T22:29:15.823 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871affd640 1 -- 172.21.15.194:0/3629966806 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c06da50 con 0x7f871c06e960 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871affd640 1 --2- 172.21.15.194:0/3629966806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c06e960 0x7f871c06b4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f870c009720 tx=0x7f870c02b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da5a43db4ee4885 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871a7fc640 1 -- 172.21.15.194:0/3629966806 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c030710 con 0x7f871c06e960 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871a7fc640 1 -- 172.21.15.194:0/3629966806 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c02e050 con 0x7f871c06e960 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.820+0000 7f871a7fc640 1 -- 172.21.15.194:0/3629966806 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c030a90 con 0x7f871c06e960 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 -- 172.21.15.194:0/3629966806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c06e960 msgr2=0x7f871c06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 --2- 172.21.15.194:0/3629966806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c06e960 0x7f871c06b4e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f870c009720 tx=0x7f870c02b730 comp rx=0 tx=0).stop 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 -- 172.21.15.194:0/3629966806 shutdown_connections 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 --2- 172.21.15.194:0/3629966806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c06e960 0x7f871c06b4e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.824 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 -- 172.21.15.194:0/3629966806 >> 172.21.15.194:0/3629966806 conn(0x7f871c0b1bc0 msgr2=0x7f871c070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:15.825 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 -- 172.21.15.194:0/3629966806 shutdown_connections 2023-11-27T22:29:15.825 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.821+0000 7f8722061640 1 -- 172.21.15.194:0/3629966806 wait complete. 2023-11-27T22:29:15.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.822+0000 7f8722061640 1 Processor -- start 2023-11-27T22:29:15.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 -- start start 2023-11-27T22:29:15.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871c06e960 0x7f871c14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 0x7f871c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 0x7f871c149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:15.827 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c14b840 con 0x7f871c06e960 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c14a260 con 0x7f871c0cdbd0 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f8722061640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c14a540 con 0x7f871c15afe0 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f871affd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 0x7f871c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f871bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 0x7f871c149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f871affd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 0x7f871c148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57026/0 (socket says 172.21.15.194:57026) 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.823+0000 7f871bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 0x7f871c149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55394/0 (socket says 172.21.15.194:55394) 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871affd640 1 -- 172.21.15.194:0/2109869150 learned_addr learned my addr 172.21.15.194:0/2109869150 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871b7fe640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871c06e960 0x7f871c14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871bfff640 1 -- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 msgr2=0x7f871c148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871bfff640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 0x7f871c148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871bfff640 1 -- 172.21.15.194:0/2109869150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871c06e960 msgr2=0x7f871c14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871bfff640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871c06e960 0x7f871c14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871bfff640 1 -- 172.21.15.194:0/2109869150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c009400 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871affd640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 0x7f871c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f871bfff640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 0x7f871c149a10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8714001d60 tx=0x7f8714010050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714013070 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400e2e0 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c14a820 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714003b90 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c14ade0 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f8714010c00 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.824+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f871400c970 con 0x7f871c15afe0 2023-11-27T22:29:15.829 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.825+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c067420 con 0x7f871c15afe0 2023-11-27T22:29:15.830 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.827+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f871400cb80 con 0x7f871c15afe0 2023-11-27T22:29:15.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.900+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a64a2f5-2127-41d8-be29-8a94f7478320", "id": 1} v 0) v1 -- 0x7f871c071940 con 0x7f871c15afe0 2023-11-27T22:29:15.906 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.904+0000 7f8703fff640 1 -- 172.21.15.194:0/2109869150 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a64a2f5-2127-41d8-be29-8a94f7478320", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8714005070 con 0x7f871c15afe0 2023-11-27T22:29:15.906 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-11-27T22:29:15.907 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 msgr2=0x7f871c149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:15.907 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 0x7f871c149a10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8714001d60 tx=0x7f8714010050 comp rx=0 tx=0).stop 2023-11-27T22:29:15.907 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 shutdown_connections 2023-11-27T22:29:15.908 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f871c0cdbd0 0x7f871c148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.908 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871c15afe0 0x7f871c149a10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.908 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 --2- 172.21.15.194:0/2109869150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f871c06e960 0x7f871c14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:15.908 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 >> 172.21.15.194:0/2109869150 conn(0x7f871c0b1bc0 msgr2=0x7f871c15a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:15.908 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 shutdown_connections 2023-11-27T22:29:15.908 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:15.905+0000 7f8722061640 1 -- 172.21.15.194:0/2109869150 wait complete. 2023-11-27T22:29:15.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 1e14ec85-3b64-4de3-ae11-8b86befd036b 2 2023-11-27T22:29:15.947 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:15.946+0000 7f2bf923c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T22:29:15.990 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:15.988+0000 7f663f60f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T22:29:15.999 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:15.998+0000 7f2bf923c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T22:29:16.017 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.015+0000 7f156b9d0640 1 Processor -- start 2023-11-27T22:29:16.017 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.015+0000 7f156b9d0640 1 -- start start 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f156b9d0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15640714c0 0x7f1564071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f156b9d0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640b4180 con 0x7f1564143820 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f156b9d0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640cd1d0 con 0x7f15640ce8a0 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f156b9d0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1564071eb0 con 0x7f15640714c0 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f1569f6d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f15640ce8a0 0x7f15640ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:41382/0 (socket says 172.21.15.194:41382) 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f1569f6d640 1 -- 172.21.15.194:0/3578608542 learned_addr learned my addr 172.21.15.194:0/3578608542 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.016+0000 7f1568f6b640 1 --2- 172.21.15.194:0/3578608542 >> v2:172.21.15.154:3300/0 conn(0x7f15640714c0 0x7f1564071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.017+0000 7f1557fff640 1 -- 172.21.15.194:0/3578608542 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870599228 0 0) 0x7f15640cd1d0 con 0x7f15640ce8a0 2023-11-27T22:29:16.019 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.017+0000 7f1557fff640 1 -- 172.21.15.194:0/3578608542 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1550003520 con 0x7f15640ce8a0 2023-11-27T22:29:16.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.017+0000 7f1568f6b640 1 -- 172.21.15.194:0/3578608542 >> v1:172.21.15.194:6789/0 conn(0x7f15640ce8a0 legacy=0x7f15640ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.017+0000 7f1568f6b640 1 -- 172.21.15.194:0/3578608542 >> v1:172.21.15.154:6789/0 conn(0x7f1564143820 legacy=0x7f15640ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.017+0000 7f1557fff640 1 -- 172.21.15.194:0/3578608542 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207089362 0 0) 0x7f15640b4180 con 0x7f1564143820 2023-11-27T22:29:16.020 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.017+0000 7f1568f6b640 1 -- 172.21.15.194:0/3578608542 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15640cd430 con 0x7f15640714c0 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f1568f6b640 1 --2- 172.21.15.194:0/3578608542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15640714c0 0x7f1564071970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15600097a0 tx=0x7f156002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a0079d5a2b369e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f1557fff640 1 -- 172.21.15.194:0/3578608542 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560030610 con 0x7f15640714c0 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f1557fff640 1 -- 172.21.15.194:0/3578608542 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560030770 con 0x7f15640714c0 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f1557fff640 1 -- 172.21.15.194:0/3578608542 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560030b00 con 0x7f15640714c0 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 -- 172.21.15.194:0/3578608542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15640714c0 msgr2=0x7f1564071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 --2- 172.21.15.194:0/3578608542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15640714c0 0x7f1564071970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15600097a0 tx=0x7f156002b960 comp rx=0 tx=0).stop 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 -- 172.21.15.194:0/3578608542 shutdown_connections 2023-11-27T22:29:16.021 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 --2- 172.21.15.194:0/3578608542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15640714c0 0x7f1564071970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.022 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 -- 172.21.15.194:0/3578608542 >> 172.21.15.194:0/3578608542 conn(0x7f15640b1de0 msgr2=0x7f15640b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.022 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 -- 172.21.15.194:0/3578608542 shutdown_connections 2023-11-27T22:29:16.022 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.018+0000 7f156b9d0640 1 -- 172.21.15.194:0/3578608542 wait complete. 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 Processor -- start 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 -- start start 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 0x7f156406a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15640ce8a0 0x7f15641595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564143820 0x7f1564159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156413efc0 con 0x7f1564143820 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156413f2a0 con 0x7f15640714c0 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156b9d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156413f580 con 0x7f15640ce8a0 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156976c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 0x7f156406a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f1568f6b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15640ce8a0 0x7f15641595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156976c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 0x7f156406a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57030/0 (socket says 172.21.15.194:57030) 2023-11-27T22:29:16.024 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.020+0000 7f156976c640 1 -- 172.21.15.194:0/115380582 learned_addr learned my addr 172.21.15.194:0/115380582 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f1569f6d640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564143820 0x7f1564159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156976c640 1 -- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15640ce8a0 msgr2=0x7f15641595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156976c640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15640ce8a0 0x7f15641595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156976c640 1 -- 172.21.15.194:0/115380582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564143820 msgr2=0x7f1564159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156976c640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564143820 0x7f1564159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156976c640 1 -- 172.21.15.194:0/115380582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560009400 con 0x7f15640714c0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156976c640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 0x7f156406a740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f155800c410 tx=0x7f155800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580035f0 con 0x7f15640714c0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1558003770 con 0x7f15640714c0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558003b20 con 0x7f15640714c0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156413f860 con 0x7f15640714c0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f1558012400 con 0x7f15640714c0 2023-11-27T22:29:16.025 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156406ac80 con 0x7f15640714c0 2023-11-27T22:29:16.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.021+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f155801b3b0 con 0x7f15640714c0 2023-11-27T22:29:16.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.022+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156406ae70 con 0x7f15640714c0 2023-11-27T22:29:16.026 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.024+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f1558017070 con 0x7f15640714c0 2023-11-27T22:29:16.044 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.043+0000 7f2bf923c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T22:29:16.046 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.044+0000 7f663f60f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T22:29:16.092 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.090+0000 7f663f60f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T22:29:16.097 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.095+0000 7f2bf923c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T22:29:16.101 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.097+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1e14ec85-3b64-4de3-ae11-8b86befd036b", "id": 2} v 0) v1 -- 0x7f1564067420 con 0x7f15640714c0 2023-11-27T22:29:16.104 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.102+0000 7f1555ffb640 1 -- 172.21.15.194:0/115380582 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e14ec85-3b64-4de3-ae11-8b86befd036b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f15580128e0 con 0x7f15640714c0 2023-11-27T22:29:16.105 INFO:teuthology.orchestra.run.smithi194.stdout:2 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.103+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 msgr2=0x7f156406a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.103+0000 7f156b9d0640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 0x7f156406a740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f155800c410 tx=0x7f155800c8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.103+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 shutdown_connections 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.103+0000 7f156b9d0640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1564143820 0x7f1564159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.103+0000 7f156b9d0640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15640ce8a0 0x7f15641595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.103+0000 7f156b9d0640 1 --2- 172.21.15.194:0/115380582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15640714c0 0x7f156406a740 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.104+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 >> 172.21.15.194:0/115380582 conn(0x7f15640b1de0 msgr2=0x7f156406e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.104+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 shutdown_connections 2023-11-27T22:29:16.106 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.104+0000 7f156b9d0640 1 -- 172.21.15.194:0/115380582 wait complete. 2023-11-27T22:29:16.116 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 8f0db288-fd6e-469b-819a-01696349bb99 3 2023-11-27T22:29:16.139 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.138+0000 7f2bf923c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T22:29:16.150 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.148+0000 7f663f60f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T22:29:16.194 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.192+0000 7f663f60f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T22:29:16.216 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.214+0000 7f82a42c2640 1 Processor -- start 2023-11-27T22:29:16.216 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.214+0000 7f82a42c2640 1 -- start start 2023-11-27T22:29:16.225 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a42c2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f829c06d360 0x7f829c0d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.225 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a42c2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c070180 con 0x7f829c15af00 2023-11-27T22:29:16.226 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a42c2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c070460 con 0x7f829c15d890 2023-11-27T22:29:16.226 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a42c2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c15b2e0 con 0x7f829c06d360 2023-11-27T22:29:16.226 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a285f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f829c06d360 0x7f829c0d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.226 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a185d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f829c15d890 0x7f829c06cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:41386/0 (socket says 172.21.15.194:41386) 2023-11-27T22:29:16.226 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a185d640 1 -- 172.21.15.194:0/3485598850 learned_addr learned my addr 172.21.15.194:0/3485598850 (peer_addr_for_me v1:172.21.15.194:0/0) 2023-11-27T22:29:16.226 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a105c640 1 -- 172.21.15.194:0/3485598850 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487961992 0 0) 0x7f829c070460 con 0x7f829c15d890 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a105c640 1 -- 172.21.15.194:0/3485598850 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8288003520 con 0x7f829c15d890 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a285f640 1 -- 172.21.15.194:0/3485598850 >> v1:172.21.15.194:6789/0 conn(0x7f829c15d890 legacy=0x7f829c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a285f640 1 -- 172.21.15.194:0/3485598850 >> v1:172.21.15.154:6789/0 conn(0x7f829c15af00 legacy=0x7f829c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.215+0000 7f82a105c640 1 -- 172.21.15.194:0/3485598850 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448837741 0 0) 0x7f829c070180 con 0x7f829c15af00 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.216+0000 7f82a285f640 1 -- 172.21.15.194:0/3485598850 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c070740 con 0x7f829c06d360 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.216+0000 7f82a285f640 1 --2- 172.21.15.194:0/3485598850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c06d360 0x7f829c0d08f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8294009d90 tx=0x7f829402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a66f7b0d2848f7e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.227 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.216+0000 7f82a105c640 1 -- 172.21.15.194:0/3485598850 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829402cc60 con 0x7f829c06d360 2023-11-27T22:29:16.228 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.216+0000 7f82a105c640 1 -- 172.21.15.194:0/3485598850 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829402cdc0 con 0x7f829c06d360 2023-11-27T22:29:16.228 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.216+0000 7f82a105c640 1 -- 172.21.15.194:0/3485598850 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294034660 con 0x7f829c06d360 2023-11-27T22:29:16.231 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 -- 172.21.15.194:0/3485598850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c06d360 msgr2=0x7f829c0d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.231 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 --2- 172.21.15.194:0/3485598850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c06d360 0x7f829c0d08f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8294009d90 tx=0x7f829402beb0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.231 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 -- 172.21.15.194:0/3485598850 shutdown_connections 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 --2- 172.21.15.194:0/3485598850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c06d360 0x7f829c0d08f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 -- 172.21.15.194:0/3485598850 >> 172.21.15.194:0/3485598850 conn(0x7f829c0b2c10 msgr2=0x7f829c0b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 -- 172.21.15.194:0/3485598850 shutdown_connections 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.217+0000 7f82a42c2640 1 -- 172.21.15.194:0/3485598850 wait complete. 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.218+0000 7f82a42c2640 1 Processor -- start 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.218+0000 7f82a42c2640 1 -- start start 2023-11-27T22:29:16.232 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a42c2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 0x7f829c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a42c2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c15af00 0x7f829c0c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a42c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f829c15d890 0x7f829c1e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a42c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0cf460 con 0x7f829c15d890 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a42c2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c152f10 con 0x7f829c15af00 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a42c2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0c6970 con 0x7f829c06d360 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a205e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 0x7f829c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.233 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a185d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c15af00 0x7f829c0c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.234 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a205e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 0x7f829c1529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55412/0 (socket says 172.21.15.194:55412) 2023-11-27T22:29:16.236 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a205e640 1 -- 172.21.15.194:0/1782564611 learned_addr learned my addr 172.21.15.194:0/1782564611 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.236 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a285f640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f829c15d890 0x7f829c1e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.237 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a185d640 1 -- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 msgr2=0x7f829c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.237 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a185d640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 0x7f829c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.237 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a185d640 1 -- 172.21.15.194:0/1782564611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f829c15d890 msgr2=0x7f829c1e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.238 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.219+0000 7f82a185d640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f829c15d890 0x7f829c1e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.238 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f82a185d640 1 -- 172.21.15.194:0/1782564611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009a70 con 0x7f829c15af00 2023-11-27T22:29:16.239 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f82a205e640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 0x7f829c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:16.239 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f82a185d640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c15af00 0x7f829c0c6e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f829c15dc70 tx=0x7f8298001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.239 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298005ce0 con 0x7f829c15af00 2023-11-27T22:29:16.239 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298005e40 con 0x7f829c15af00 2023-11-27T22:29:16.240 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c161640 con 0x7f829c15af00 2023-11-27T22:29:16.240 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980072f0 con 0x7f829c15af00 2023-11-27T22:29:16.240 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0c6040 con 0x7f829c15af00 2023-11-27T22:29:16.240 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f829801c440 con 0x7f829c15af00 2023-11-27T22:29:16.241 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.220+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8298012c50 con 0x7f829c15af00 2023-11-27T22:29:16.241 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.221+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c067fc0 con 0x7f829c15af00 2023-11-27T22:29:16.241 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.223+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f8298017070 con 0x7f829c15af00 2023-11-27T22:29:16.242 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.239+0000 7f2bf923c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T22:29:16.296 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.294+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f0db288-fd6e-469b-819a-01696349bb99", "id": 3} v 0) v1 -- 0x7f829c067420 con 0x7f829c15af00 2023-11-27T22:29:16.300 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.299+0000 7f663f60f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-27T22:29:16.302 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.300+0000 7f828effd640 1 -- 172.21.15.194:0/1782564611 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f0db288-fd6e-469b-819a-01696349bb99", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82980127c0 con 0x7f829c15af00 2023-11-27T22:29:16.302 INFO:teuthology.orchestra.run.smithi194.stdout:3 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c15af00 msgr2=0x7f829c0c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c15af00 0x7f829c0c6e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f829c15dc70 tx=0x7f8298001e70 comp rx=0 tx=0).stop 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 shutdown_connections 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f829c15af00 0x7f829c0c6e00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f829c15d890 0x7f829c1e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 --2- 172.21.15.194:0/1782564611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f829c06d360 0x7f829c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 >> 172.21.15.194:0/1782564611 conn(0x7f829c0b2c10 msgr2=0x7f829c158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.306 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 shutdown_connections 2023-11-27T22:29:16.307 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.301+0000 7f82a42c2640 1 -- 172.21.15.194:0/1782564611 wait complete. 2023-11-27T22:29:16.309 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.308+0000 7f2bf923c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T22:29:16.313 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 250928a5-f1a8-4488-8e26-96ee99a8fc38 4 2023-11-27T22:29:16.354 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.353+0000 7f2bf923c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T22:29:16.374 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.372+0000 7f663f60f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T22:29:16.406 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.405+0000 7f2bf923c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T22:29:16.422 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.420+0000 7f663f60f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T22:29:16.453 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.451+0000 7f2bf923c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T22:29:16.454 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.451+0000 7f769d010640 1 Processor -- start 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.451+0000 7f769d010640 1 -- start start 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769d010640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f769815af00 0x7f76980d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769d010640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f769815d890 0x7f76980cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769d010640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f769806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769d010640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769815b2e0 con 0x7f769815d890 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769d010640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76980cf460 con 0x7f769815af00 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769d010640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769806d600 con 0x7f769806cc50 2023-11-27T22:29:16.455 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f769806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f7696d9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f769815af00 0x7f76980d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f769806d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55416/0 (socket says 172.21.15.194:55416) 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 -- 172.21.15.194:0/3374719247 learned_addr learned my addr 172.21.15.194:0/3374719247 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769659c640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.154:3300/0 conn(0x7f769815d890 0x7f76980cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 -- 172.21.15.194:0/3374719247 >> v2:172.21.15.194:3300/0 conn(0x7f769815af00 msgr2=0x7f76980d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.194:3300/0 conn(0x7f769815af00 0x7f76980d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 -- 172.21.15.194:0/3374719247 >> v2:172.21.15.154:3300/0 conn(0x7f769815d890 msgr2=0x7f76980cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.154:3300/0 conn(0x7f769815d890 0x7f76980cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769759e640 1 -- 172.21.15.194:0/3374719247 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7698070180 con 0x7f769806cc50 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f7696d9d640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.194:3300/0 conn(0x7f769815af00 0x7f76980d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:16.456 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.452+0000 7f769659c640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.154:3300/0 conn(0x7f769815d890 0x7f76980cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.453+0000 7f769759e640 1 --2- 172.21.15.194:0/3374719247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f769806d0c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76980710a0 tx=0x7f769002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f50c44521ca176e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.453+0000 7f7695d9b640 1 -- 172.21.15.194:0/3374719247 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769002ca70 con 0x7f769806cc50 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.453+0000 7f7695d9b640 1 -- 172.21.15.194:0/3374719247 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769002cbd0 con 0x7f769806cc50 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.453+0000 7f7695d9b640 1 -- 172.21.15.194:0/3374719247 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76900343f0 con 0x7f769806cc50 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 -- 172.21.15.194:0/3374719247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 msgr2=0x7f769806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 --2- 172.21.15.194:0/3374719247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f769806d0c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76980710a0 tx=0x7f769002bed0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 -- 172.21.15.194:0/3374719247 shutdown_connections 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 --2- 172.21.15.194:0/3374719247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f769806d0c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.154:3300/0 conn(0x7f769815d890 0x7f76980cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.460 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 --2- 172.21.15.194:0/3374719247 >> v2:172.21.15.194:3300/0 conn(0x7f769815af00 0x7f76980d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 -- 172.21.15.194:0/3374719247 >> 172.21.15.194:0/3374719247 conn(0x7f76980b2c10 msgr2=0x7f76980b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 -- 172.21.15.194:0/3374719247 shutdown_connections 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.454+0000 7f769d010640 1 -- 172.21.15.194:0/3374719247 wait complete. 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.455+0000 7f769d010640 1 Processor -- start 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.455+0000 7f769d010640 1 -- start start 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769d010640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f76980ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769d010640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769815af00 0x7f769814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769d010640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 0x7f76981f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769d010640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769814e9f0 con 0x7f769815af00 2023-11-27T22:29:16.461 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769d010640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76981587d0 con 0x7f769815d890 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769d010640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76980ae880 con 0x7f769806cc50 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 0x7f76981f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f7696d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f76980ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 0x7f76981f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57072/0 (socket says 172.21.15.194:57072) 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 -- 172.21.15.194:0/3018130063 learned_addr learned my addr 172.21.15.194:0/3018130063 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769659c640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769815af00 0x7f769814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.462 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 -- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 msgr2=0x7f76980ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f76980ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 -- 172.21.15.194:0/3018130063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769815af00 msgr2=0x7f769814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769815af00 0x7f769814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.456+0000 7f769759e640 1 -- 172.21.15.194:0/3018130063 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c009400 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f769759e640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 0x7f76981f3330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7690036040 tx=0x7f7690004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690009510 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769003e450 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7690009b30 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769003e800 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76980aee40 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f769003e960 con 0x7f769815d890 2023-11-27T22:29:16.463 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.457+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f769003f400 con 0x7f769815d890 2023-11-27T22:29:16.464 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.458+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7698067fc0 con 0x7f769815d890 2023-11-27T22:29:16.464 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.460+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f7690066ce0 con 0x7f769815d890 2023-11-27T22:29:16.479 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.476+0000 7f663f60f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T22:29:16.526 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.524+0000 7f663f60f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T22:29:16.533 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.531+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "250928a5-f1a8-4488-8e26-96ee99a8fc38", "id": 4} v 0) v1 -- 0x7f7698067420 con 0x7f769815d890 2023-11-27T22:29:16.539 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.537+0000 7f767f7fe640 1 -- 172.21.15.194:0/3018130063 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "250928a5-f1a8-4488-8e26-96ee99a8fc38", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7690055030 con 0x7f769815d890 2023-11-27T22:29:16.539 INFO:teuthology.orchestra.run.smithi194.stdout:4 2023-11-27T22:29:16.540 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 msgr2=0x7f76981f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.540 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 0x7f76981f3330 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7690036040 tx=0x7f7690004a40 comp rx=0 tx=0).stop 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 shutdown_connections 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f769815d890 0x7f76981f3330 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769815af00 0x7f769814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 --2- 172.21.15.194:0/3018130063 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f769806cc50 0x7f76980ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 >> 172.21.15.194:0/3018130063 conn(0x7f76980b2c10 msgr2=0x7f769815b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 shutdown_connections 2023-11-27T22:29:16.541 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.538+0000 7f769d010640 1 -- 172.21.15.194:0/3018130063 wait complete. 2023-11-27T22:29:16.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 038313a0-a52b-4ac3-b461-90ef1cee37cf 5 2023-11-27T22:29:16.692 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.689+0000 7f5ad9c90640 1 Processor -- start 2023-11-27T22:29:16.692 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad9c90640 1 -- start start 2023-11-27T22:29:16.693 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad9c90640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad415b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.693 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad9c90640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5ad40cb770 0x7f5ad415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.693 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad9c90640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad415fc00 con 0x7f5ad40cd970 2023-11-27T22:29:16.693 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad9c90640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40d0730 con 0x7f5ad40cb770 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad9c90640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40cd110 con 0x7f5ad415b130 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad2ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5ad40cb770 0x7f5ad415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55440/0 (socket says 172.21.15.194:55440) 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.690+0000 7f5ad37fe640 1 -- 172.21.15.194:0/1076952841 learned_addr learned my addr 172.21.15.194:0/1076952841 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.691+0000 7f5ad37fe640 1 -- 172.21.15.194:0/1076952841 >> v2:172.21.15.194:3300/0 conn(0x7f5ad40cb770 msgr2=0x7f5ad415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.691+0000 7f5ad37fe640 1 --2- 172.21.15.194:0/1076952841 >> v2:172.21.15.194:3300/0 conn(0x7f5ad40cb770 0x7f5ad415f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.694 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.691+0000 7f5ad37fe640 1 -- 172.21.15.194:0/1076952841 >> v1:172.21.15.154:6789/0 conn(0x7f5ad40cd970 legacy=0x7f5ad40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.695 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.691+0000 7f5ad37fe640 1 -- 172.21.15.194:0/1076952841 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40cd3b0 con 0x7f5ad415b130 2023-11-27T22:29:16.695 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.691+0000 7f5ad2ffd640 1 --2- 172.21.15.194:0/1076952841 >> v2:172.21.15.194:3300/0 conn(0x7f5ad40cb770 0x7f5ad415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:16.695 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.691+0000 7f5ad37fe640 1 --2- 172.21.15.194:0/1076952841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad415b510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009870 tx=0x7f5ac802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb43ecc483d8e2e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad27fc640 1 -- 172.21.15.194:0/1076952841 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8031640 con 0x7f5ad415b130 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad27fc640 1 -- 172.21.15.194:0/1076952841 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac80317a0 con 0x7f5ad415b130 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad27fc640 1 -- 172.21.15.194:0/1076952841 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8031b30 con 0x7f5ad415b130 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1076952841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 msgr2=0x7f5ad415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1076952841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad415b510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009870 tx=0x7f5ac802b8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1076952841 shutdown_connections 2023-11-27T22:29:16.698 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1076952841 >> v2:172.21.15.194:3300/0 conn(0x7f5ad40cb770 0x7f5ad415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1076952841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad415b510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1076952841 >> 172.21.15.194:0/1076952841 conn(0x7f5ad40b2c10 msgr2=0x7f5ad40b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1076952841 shutdown_connections 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.692+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1076952841 wait complete. 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.693+0000 7f5ad9c90640 1 Processor -- start 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 -- start start 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad40cb770 0x7f5ad40c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad40cd970 0x7f5ad41432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad4159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad415a2f0 con 0x7f5ad40cd970 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40c5cf0 con 0x7f5ad40cb770 2023-11-27T22:29:16.699 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad9c90640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40c5fd0 con 0x7f5ad415b130 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad37fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad40cb770 0x7f5ad40c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad4159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55456/0 (socket says 172.21.15.194:55456) 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.694+0000 7f5ad3fff640 1 -- 172.21.15.194:0/1839552035 learned_addr learned my addr 172.21.15.194:0/1839552035 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad2ffd640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad40cd970 0x7f5ad41432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad3fff640 1 -- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad40cb770 msgr2=0x7f5ad40c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad3fff640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad40cb770 0x7f5ad40c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad3fff640 1 -- 172.21.15.194:0/1839552035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad40cd970 msgr2=0x7f5ad41432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad3fff640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad40cd970 0x7f5ad41432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad3fff640 1 -- 172.21.15.194:0/1839552035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac4009400 con 0x7f5ad415b130 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad2ffd640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad40cd970 0x7f5ad41432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad3fff640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad4159970 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c7a0 tx=0x7f5acc00cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc003b70 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc003cf0 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac80094d0 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc003ea0 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40c6590 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f5acc0050d0 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.695+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5acc0127e0 con 0x7f5ad415b130 2023-11-27T22:29:16.701 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.696+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad4067fc0 con 0x7f5ad415b130 2023-11-27T22:29:16.702 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.698+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f5acc012ac0 con 0x7f5ad415b130 2023-11-27T22:29:16.772 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.770+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "038313a0-a52b-4ac3-b461-90ef1cee37cf", "id": 5} v 0) v1 -- 0x7f5ad4067420 con 0x7f5ad415b130 2023-11-27T22:29:16.778 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.776+0000 7f5abbfff640 1 -- 172.21.15.194:0/1839552035 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "038313a0-a52b-4ac3-b461-90ef1cee37cf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5acc012c60 con 0x7f5ad415b130 2023-11-27T22:29:16.778 INFO:teuthology.orchestra.run.smithi194.stdout:5 2023-11-27T22:29:16.780 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.776+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 msgr2=0x7f5ad4159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.780 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad4159970 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c7a0 tx=0x7f5acc00cc60 comp rx=0 tx=0).stop 2023-11-27T22:29:16.781 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 shutdown_connections 2023-11-27T22:29:16.781 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad415b130 0x7f5ad4159970 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.781 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad40cd970 0x7f5ad41432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.781 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 --2- 172.21.15.194:0/1839552035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad40cb770 0x7f5ad40c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.781 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 >> 172.21.15.194:0/1839552035 conn(0x7f5ad40b2c10 msgr2=0x7f5ad40b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.782 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 shutdown_connections 2023-11-27T22:29:16.782 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.777+0000 7f5ad9c90640 1 -- 172.21.15.194:0/1839552035 wait complete. 2023-11-27T22:29:16.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 2539ff84-b615-4650-87fa-8b5551c1978e 6 2023-11-27T22:29:16.830 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.828+0000 7f2bf923c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T22:29:16.892 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.889+0000 7f28222e5640 1 Processor -- start 2023-11-27T22:29:16.892 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f28222e5640 1 -- start start 2023-11-27T22:29:16.893 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f28222e5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f281c15b1b0 0x7f281c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.894 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f28222e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 0x7f281c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.894 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f28222e5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c15bdf0 con 0x7f281c15b590 2023-11-27T22:29:16.894 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f28222e5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0ce7d0 con 0x7f281c15b1b0 2023-11-27T22:29:16.894 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f28222e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0ce210 con 0x7f281c0cdd70 2023-11-27T22:29:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f281b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 0x7f281c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f281b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 0x7f281c0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55462/0 (socket says 172.21.15.194:55462) 2023-11-27T22:29:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f281b7fe640 1 -- 172.21.15.194:0/1177832686 learned_addr learned my addr 172.21.15.194:0/1177832686 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.890+0000 7f281bfff640 1 --2- 172.21.15.194:0/1177832686 >> v2:172.21.15.154:3300/0 conn(0x7f281c15b1b0 0x7f281c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.891+0000 7f281b7fe640 1 -- 172.21.15.194:0/1177832686 >> v2:172.21.15.154:3300/0 conn(0x7f281c15b1b0 msgr2=0x7f281c0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.891+0000 7f281b7fe640 1 --2- 172.21.15.194:0/1177832686 >> v2:172.21.15.154:3300/0 conn(0x7f281c15b1b0 0x7f281c0cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.891+0000 7f281b7fe640 1 -- 172.21.15.194:0/1177832686 >> v1:172.21.15.154:6789/0 conn(0x7f281c15b590 legacy=0x7f281c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.891+0000 7f281b7fe640 1 -- 172.21.15.194:0/1177832686 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0ce4f0 con 0x7f281c0cdd70 2023-11-27T22:29:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.891+0000 7f281b7fe640 1 --2- 172.21.15.194:0/1177832686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 0x7f281c0b2320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708e5353ddc9cdfb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f281affd640 1 -- 172.21.15.194:0/1177832686 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810030840 con 0x7f281c0cdd70 2023-11-27T22:29:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f281affd640 1 -- 172.21.15.194:0/1177832686 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28100309a0 con 0x7f281c0cdd70 2023-11-27T22:29:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f281affd640 1 -- 172.21.15.194:0/1177832686 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810030d30 con 0x7f281c0cdd70 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 -- 172.21.15.194:0/1177832686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 msgr2=0x7f281c0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 --2- 172.21.15.194:0/1177832686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 0x7f281c0b2320 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2810009870 tx=0x7f281002b980 comp rx=0 tx=0).stop 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 -- 172.21.15.194:0/1177832686 shutdown_connections 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 --2- 172.21.15.194:0/1177832686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0cdd70 0x7f281c0b2320 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 --2- 172.21.15.194:0/1177832686 >> v2:172.21.15.154:3300/0 conn(0x7f281c15b1b0 0x7f281c0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 -- 172.21.15.194:0/1177832686 >> 172.21.15.194:0/1177832686 conn(0x7f281c066270 msgr2=0x7f281c066650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 -- 172.21.15.194:0/1177832686 shutdown_connections 2023-11-27T22:29:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.892+0000 7f28222e5640 1 -- 172.21.15.194:0/1177832686 wait complete. 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.893+0000 7f28222e5640 1 Processor -- start 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 -- start start 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 0x7f281c140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c15b1b0 0x7f281c152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 0x7f281c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c14ed00 con 0x7f281c0cdd70 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c14efe0 con 0x7f281c15b1b0 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f28222e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c14f2c0 con 0x7f281c15b590 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f281b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c15b1b0 0x7f281c152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f2820882640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 0x7f281c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f281bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 0x7f281c140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:16.900 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f2820882640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 0x7f281c13ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55476/0 (socket says 172.21.15.194:55476) 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f281bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 0x7f281c140b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.194:56606/0 (socket says 172.21.15.194:56606) 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.894+0000 7f2820882640 1 -- 172.21.15.194:0/1997278845 learned_addr learned my addr 172.21.15.194:0/1997278845 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2820882640 1 -- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c15b1b0 msgr2=0x7f281c152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2820882640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c15b1b0 0x7f281c152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2820882640 1 -- 172.21.15.194:0/1997278845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 msgr2=0x7f281c140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2820882640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 0x7f281c140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2820882640 1 -- 172.21.15.194:0/1997278845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28100094d0 con 0x7f281c15b590 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f281bfff640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 0x7f281c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2820882640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 0x7f281c13ed60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f281400c730 tx=0x7f281400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814003b70 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814003cd0 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c14f5a0 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814005310 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c152fc0 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f281400a640 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.895+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2814012c90 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.896+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c14fac0 con 0x7f281c15b590 2023-11-27T22:29:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.898+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f281c14fac0 con 0x7f281c15b590 2023-11-27T22:29:16.931 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:16.929+0000 7f663f60f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-27T22:29:16.965 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:16.963+0000 7f2bf923c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T22:29:16.972 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.970+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2539ff84-b615-4650-87fa-8b5551c1978e", "id": 6} v 0) v1 -- 0x7f281c153150 con 0x7f281c15b590 2023-11-27T22:29:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.975+0000 7f2818ff9640 1 -- 172.21.15.194:0/1997278845 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2539ff84-b615-4650-87fa-8b5551c1978e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2814012e50 con 0x7f281c15b590 2023-11-27T22:29:16.977 INFO:teuthology.orchestra.run.smithi194.stdout:6 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 msgr2=0x7f281c13ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 0x7f281c13ed60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f281400c730 tx=0x7f281400cbf0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 shutdown_connections 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c15b1b0 0x7f281c152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15b590 0x7f281c13ed60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 --2- 172.21.15.194:0/1997278845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f281c0cdd70 0x7f281c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 >> 172.21.15.194:0/1997278845 conn(0x7f281c066270 msgr2=0x7f281c0b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.976+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 shutdown_connections 2023-11-27T22:29:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:16.977+0000 7f28222e5640 1 -- 172.21.15.194:0/1997278845 wait complete. 2023-11-27T22:29:16.989 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new da39cc8a-67ce-490f-a9be-1e93bb7b1e48 7 2023-11-27T22:29:17.073 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.071+0000 7f663f60f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T22:29:17.087 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.085+0000 7f2bf923c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T22:29:17.089 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.087+0000 7f95c9456640 1 Processor -- start 2023-11-27T22:29:17.089 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.087+0000 7f95c9456640 1 -- start start 2023-11-27T22:29:17.090 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c9456640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95c40b5370 0x7f95c40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c9456640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95c40d2040 0x7f95c40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c9456640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40ce4c0 con 0x7f95c415d2d0 2023-11-27T22:29:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c9456640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40d1bb0 con 0x7f95c40d2040 2023-11-27T22:29:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c9456640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c415d6b0 con 0x7f95c40b5370 2023-11-27T22:29:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c27fc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95c40b5370 0x7f95c40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c27fc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95c40b5370 0x7f95c40cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57094/0 (socket says 172.21.15.194:57094) 2023-11-27T22:29:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c27fc640 1 -- 172.21.15.194:0/366948636 learned_addr learned my addr 172.21.15.194:0/366948636 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c37fe640 1 --2- 172.21.15.194:0/366948636 >> v2:172.21.15.154:3300/0 conn(0x7f95c40d2040 0x7f95c40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c37fe640 1 -- 172.21.15.194:0/366948636 >> v2:172.21.15.194:3300/0 conn(0x7f95c40b5370 msgr2=0x7f95c40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c37fe640 1 --2- 172.21.15.194:0/366948636 >> v2:172.21.15.194:3300/0 conn(0x7f95c40b5370 0x7f95c40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c37fe640 1 -- 172.21.15.194:0/366948636 >> v1:172.21.15.154:6789/0 conn(0x7f95c415d2d0 legacy=0x7f95c40b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c37fe640 1 -- 172.21.15.194:0/366948636 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40ce700 con 0x7f95c40d2040 2023-11-27T22:29:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.088+0000 7f95c1ffb640 1 -- 172.21.15.194:0/366948636 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744868756 0 0) 0x7f95b8001110 con 0x7f95c415d2d0 2023-11-27T22:29:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.089+0000 7f95c37fe640 1 --2- 172.21.15.194:0/366948636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c40d2040 0x7f95c40cdf80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f95c40b2c10 tx=0x7f95bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c83826989c4285 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.089+0000 7f95c1ffb640 1 -- 172.21.15.194:0/366948636 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc02cc80 con 0x7f95c40d2040 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.089+0000 7f95c1ffb640 1 -- 172.21.15.194:0/366948636 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc02cde0 con 0x7f95c40d2040 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.089+0000 7f95c1ffb640 1 -- 172.21.15.194:0/366948636 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc034660 con 0x7f95c40d2040 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 -- 172.21.15.194:0/366948636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c40d2040 msgr2=0x7f95c40cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 --2- 172.21.15.194:0/366948636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c40d2040 0x7f95c40cdf80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f95c40b2c10 tx=0x7f95bc02bed0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 -- 172.21.15.194:0/366948636 shutdown_connections 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 --2- 172.21.15.194:0/366948636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c40d2040 0x7f95c40cdf80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 --2- 172.21.15.194:0/366948636 >> v2:172.21.15.194:3300/0 conn(0x7f95c40b5370 0x7f95c40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 -- 172.21.15.194:0/366948636 >> 172.21.15.194:0/366948636 conn(0x7f95c4072050 msgr2=0x7f95c4072460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 -- 172.21.15.194:0/366948636 shutdown_connections 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.090+0000 7f95c9456640 1 -- 172.21.15.194:0/366948636 wait complete. 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.091+0000 7f95c9456640 1 Processor -- start 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.091+0000 7f95c9456640 1 -- start start 2023-11-27T22:29:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c9456640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95c40b5370 0x7f95c41f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c9456640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 0x7f95c414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c9456640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c415d2d0 0x7f95c40c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c9456640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cc2f0 con 0x7f95c415d2d0 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c9456640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cb670 con 0x7f95c40b5370 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c9456640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cb950 con 0x7f95c40d2040 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c27fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 0x7f95c414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c2ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95c40b5370 0x7f95c41f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c27fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 0x7f95c414c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:55480/0 (socket says 172.21.15.194:55480) 2023-11-27T22:29:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c27fc640 1 -- 172.21.15.194:0/1718364961 learned_addr learned my addr 172.21.15.194:0/1718364961 (peer_addr_for_me v2:172.21.15.194:0/0) 2023-11-27T22:29:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c37fe640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c415d2d0 0x7f95c40c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c27fc640 1 -- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95c40b5370 msgr2=0x7f95c41f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.092+0000 7f95c27fc640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95c40b5370 0x7f95c41f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c27fc640 1 -- 172.21.15.194:0/1718364961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c415d2d0 msgr2=0x7f95c40c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c27fc640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c415d2d0 0x7f95c40c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c27fc640 1 -- 172.21.15.194:0/1718364961 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc009a70 con 0x7f95c40d2040 2023-11-27T22:29:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c2ffd640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95c40b5370 0x7f95c41f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c37fe640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c415d2d0 0x7f95c40c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c27fc640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 0x7f95c414c580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f95b400e8b0 tx=0x7f95b400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400c940 con 0x7f95c40d2040 2023-11-27T22:29:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b400caa0 con 0x7f95c40d2040 2023-11-27T22:29:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c40cbc30 con 0x7f95c40d2040 2023-11-27T22:29:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b400ce30 con 0x7f95c40d2040 2023-11-27T22:29:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c41f36d0 con 0x7f95c40d2040 2023-11-27T22:29:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f95b4005990 con 0x7f95c40d2040 2023-11-27T22:29:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.093+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f95b4013ad0 con 0x7f95c40d2040 2023-11-27T22:29:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.094+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c40b8510 con 0x7f95c40d2040 2023-11-27T22:29:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.096+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f95b4021060 con 0x7f95c40d2040 2023-11-27T22:29:17.132 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.130+0000 7f2bf923c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T22:29:17.168 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.166+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "da39cc8a-67ce-490f-a9be-1e93bb7b1e48", "id": 7} v 0) v1 -- 0x7f95c40cc430 con 0x7f95c40d2040 2023-11-27T22:29:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.175+0000 7f95ab7fe640 1 -- 172.21.15.194:0/1718364961 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da39cc8a-67ce-490f-a9be-1e93bb7b1e48", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95c40cc430 con 0x7f95c40d2040 2023-11-27T22:29:17.177 INFO:teuthology.orchestra.run.smithi194.stdout:7 2023-11-27T22:29:17.178 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 msgr2=0x7f95c414c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 0x7f95c414c580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f95b400e8b0 tx=0x7f95b400ed70 comp rx=0 tx=0).stop 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 shutdown_connections 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c415d2d0 0x7f95c40c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95c40d2040 0x7f95c414c580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 --2- 172.21.15.194:0/1718364961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95c40b5370 0x7f95c41f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 >> 172.21.15.194:0/1718364961 conn(0x7f95c4072050 msgr2=0x7f95c40b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 shutdown_connections 2023-11-27T22:29:17.179 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:29:17.176+0000 7f95c9456640 1 -- 172.21.15.194:0/1718364961 wait complete. 2023-11-27T22:29:17.184 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.182+0000 7f663f60f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T22:29:17.188 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-27T22:29:17.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-27T22:29:17.191 INFO:tasks.ceph.osd.0:Started 2023-11-27T22:29:17.191 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-27T22:29:17.191 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-27T22:29:17.193 INFO:tasks.ceph.osd.1:Started 2023-11-27T22:29:17.193 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-27T22:29:17.193 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-27T22:29:17.195 INFO:tasks.ceph.osd.2:Started 2023-11-27T22:29:17.196 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-27T22:29:17.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-27T22:29:17.198 INFO:tasks.ceph.osd.3:Started 2023-11-27T22:29:17.199 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-27T22:29:17.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-27T22:29:17.201 INFO:tasks.ceph.osd.4:Started 2023-11-27T22:29:17.201 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-27T22:29:17.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-27T22:29:17.203 INFO:tasks.ceph.osd.5:Started 2023-11-27T22:29:17.203 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-27T22:29:17.203 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-27T22:29:17.205 INFO:tasks.ceph.osd.6:Started 2023-11-27T22:29:17.205 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-27T22:29:17.206 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-27T22:29:17.209 INFO:tasks.ceph.osd.7:Started 2023-11-27T22:29:17.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:17.241 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.239+0000 7f663f60f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T22:29:17.257 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.255+0000 7f2bf923c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T22:29:17.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.335+0000 7fda9db2c640 1 Processor -- start 2023-11-27T22:29:17.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.335+0000 7fda9db2c640 1 -- start start 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.335+0000 7fda9db2c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fda9815d330 0x7fda980b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.335+0000 7fda9db2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980b2b10 con 0x7fda980d2910 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.335+0000 7fda9db2c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda980d1590 con 0x7fda980d3900 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.335+0000 7fda9db2c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda980d1870 con 0x7fda9815d330 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda96ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fda980d2910 0x7fda980d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43960/0 (socket says 172.21.15.154:43960) 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda96ffd640 1 -- 172.21.15.154:0/3883746575 learned_addr learned my addr 172.21.15.154:0/3883746575 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda977fe640 1 --2- 172.21.15.154:0/3883746575 >> v2:172.21.15.194:3300/0 conn(0x7fda9815d330 0x7fda980b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda967fc640 1 -- 172.21.15.154:0/3883746575 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15619656 0 0) 0x7fda980b2b10 con 0x7fda980d2910 2023-11-27T22:29:17.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda967fc640 1 -- 172.21.15.154:0/3883746575 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda80003520 con 0x7fda980d2910 2023-11-27T22:29:17.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda967fc640 1 -- 172.21.15.154:0/3883746575 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1399958797 0 0) 0x7fda80003520 con 0x7fda980d2910 2023-11-27T22:29:17.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda977fe640 1 -- 172.21.15.154:0/3883746575 >> v1:172.21.15.194:6789/0 conn(0x7fda980d3900 legacy=0x7fda980b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda977fe640 1 -- 172.21.15.154:0/3883746575 >> v1:172.21.15.154:6789/0 conn(0x7fda980d2910 legacy=0x7fda980d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.336+0000 7fda977fe640 1 -- 172.21.15.154:0/3883746575 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980d1b50 con 0x7fda9815d330 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.337+0000 7fda977fe640 1 --2- 172.21.15.154:0/3883746575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980b8b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0097a0 tx=0x7fda8c02b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0275194ea204a7c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.337+0000 7fda967fc640 1 -- 172.21.15.154:0/3883746575 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88001670 con 0x7fda9815d330 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.337+0000 7fda967fc640 1 -- 172.21.15.154:0/3883746575 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c02e050 con 0x7fda9815d330 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.337+0000 7fda967fc640 1 -- 172.21.15.154:0/3883746575 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c030510 con 0x7fda9815d330 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 -- 172.21.15.154:0/3883746575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 msgr2=0x7fda980b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 --2- 172.21.15.154:0/3883746575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980b8b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0097a0 tx=0x7fda8c02b600 comp rx=0 tx=0).stop 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 -- 172.21.15.154:0/3883746575 shutdown_connections 2023-11-27T22:29:17.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 --2- 172.21.15.154:0/3883746575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980b8b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 -- 172.21.15.154:0/3883746575 >> 172.21.15.154:0/3883746575 conn(0x7fda98072020 msgr2=0x7fda98072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:17.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 -- 172.21.15.154:0/3883746575 shutdown_connections 2023-11-27T22:29:17.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.338+0000 7fda9db2c640 1 -- 172.21.15.154:0/3883746575 wait complete. 2023-11-27T22:29:17.343 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.339+0000 7fda9db2c640 1 Processor -- start 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.339+0000 7fda9db2c640 1 -- start start 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda9db2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 0x7fda980ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda9db2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980d3900 0x7fda981f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda9db2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda9db2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981f3e40 con 0x7fda980d2910 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda9db2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda981f3880 con 0x7fda9815d330 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda9db2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda981f3b60 con 0x7fda980d3900 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 0x7fda980ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 0x7fda980ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44356/0 (socket says 172.21.15.154:44356) 2023-11-27T22:29:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 -- 172.21.15.154:0/3956423839 learned_addr learned my addr 172.21.15.154:0/3956423839 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda96ffd640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980d3900 0x7fda981f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda97fff640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 -- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980d3900 msgr2=0x7fda981f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980d3900 0x7fda981f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 -- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 msgr2=0x7fda980c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 -- 172.21.15.154:0/3956423839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009400 con 0x7fda980d2910 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda96ffd640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980d3900 0x7fda981f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda97fff640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.340+0000 7fda977fe640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 0x7fda980ccfc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0097a0 tx=0x7fda8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c03c880 con 0x7fda980d2910 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c03c9e0 con 0x7fda980d2910 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9815f030 con 0x7fda980d2910 2023-11-27T22:29:17.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c03cd90 con 0x7fda980d2910 2023-11-27T22:29:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda980c7d00 con 0x7fda980d2910 2023-11-27T22:29:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fda8c039040 con 0x7fda980d2910 2023-11-27T22:29:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.341+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fda8c032ad0 con 0x7fda980d2910 2023-11-27T22:29:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.342+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9815ee90 con 0x7fda980d2910 2023-11-27T22:29:17.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.344+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fda9815ee90 con 0x7fda980d2910 2023-11-27T22:29:17.348 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.346+0000 7f663f60f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T22:29:17.369 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.367+0000 7f2bf923c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T22:29:17.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.403+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda98069400 con 0x7fda980d2910 2023-11-27T22:29:17.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.404+0000 7fda7ffff640 1 -- 172.21.15.154:0/3956423839 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fda8c04d060 con 0x7fda980d2910 2023-11-27T22:29:17.406 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:17.406 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":10,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:17.168050+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 msgr2=0x7fda980ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 0x7fda980ccfc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0097a0 tx=0x7fda8c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 shutdown_connections 2023-11-27T22:29:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda9815d330 0x7fda980c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980d3900 0x7fda981f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 --2- 172.21.15.154:0/3956423839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980d2910 0x7fda980ccfc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 >> 172.21.15.154:0/3956423839 conn(0x7fda98072020 msgr2=0x7fda98072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 shutdown_connections 2023-11-27T22:29:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:17.405+0000 7fda9db2c640 1 -- 172.21.15.154:0/3956423839 wait complete. 2023-11-27T22:29:17.418 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-27T22:29:17.418 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-27T22:29:17.443 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.441+0000 7f663f60f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T22:29:17.512 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.511+0000 7f2bf923c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T22:29:17.555 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.554+0000 7f2bf923c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T22:29:17.583 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.581+0000 7f663f60f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T22:29:17.625 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.623+0000 7f663f60f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T22:29:17.696 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:17.695+0000 7f2bf923c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T22:29:17.762 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:17.760+0000 7f663f60f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T22:29:17.799 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T22:29:17.797+0000 7f838ff10500 -1 Falling back to public interface 2023-11-27T22:29:17.807 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T22:29:17.805+0000 7f02cf010500 -1 Falling back to public interface 2023-11-27T22:29:17.808 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T22:29:17.806+0000 7f78e9d6c500 -1 Falling back to public interface 2023-11-27T22:29:17.811 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T22:29:17.809+0000 7f31b3e20500 -1 Falling back to public interface 2023-11-27T22:29:17.821 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T22:29:17.819+0000 7f5967e25500 -1 Falling back to public interface 2023-11-27T22:29:17.821 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T22:29:17.820+0000 7febf89fb500 -1 Falling back to public interface 2023-11-27T22:29:17.822 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T22:29:17.820+0000 7f0a229a9500 -1 Falling back to public interface 2023-11-27T22:29:17.825 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T22:29:17.823+0000 7fb3d2e02500 -1 Falling back to public interface 2023-11-27T22:29:18.222 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:18.315 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.313+0000 7feafdd39640 1 Processor -- start 2023-11-27T22:29:18.315 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.313+0000 7feafdd39640 1 -- start start 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feafdd39640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feafdd39640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feaf8146d70 0x7feaf80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feafdd39640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf806adf0 con 0x7feaf80b3590 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feafdd39640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80b46b0 con 0x7feaf8146d70 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feafdd39640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80b3a30 con 0x7feaf806a4d0 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feaeeffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feaf8146d70 0x7feaf80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feaf7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feaf80b3590 0x7feaf80713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:43964/0 (socket says 172.21.15.154:43964) 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feaf7fff640 1 -- 172.21.15.154:0/2149044905 learned_addr learned my addr 172.21.15.154:0/2149044905 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.314+0000 7feaf77fe640 1 --2- 172.21.15.154:0/2149044905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.315+0000 7feaeeffd640 1 -- 172.21.15.154:0/2149044905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 msgr2=0x7feaf806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.315+0000 7feaeeffd640 1 --2- 172.21.15.154:0/2149044905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf806a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.317 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.315+0000 7feaeeffd640 1 -- 172.21.15.154:0/2149044905 >> v1:172.21.15.154:6789/0 conn(0x7feaf80b3590 legacy=0x7feaf80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:18.318 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.315+0000 7feaf6ffd640 1 -- 172.21.15.154:0/2149044905 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947551416 0 0) 0x7feaf806adf0 con 0x7feaf80b3590 2023-11-27T22:29:18.318 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.315+0000 7feaeeffd640 1 -- 172.21.15.154:0/2149044905 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80b3d10 con 0x7feaf8146d70 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.316+0000 7feaeeffd640 1 --2- 172.21.15.154:0/2149044905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf80b3050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feae0009790 tx=0x7feae002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a24f52b983d6de server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.316+0000 7feaf6ffd640 1 -- 172.21.15.154:0/2149044905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0031800 con 0x7feaf8146d70 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.316+0000 7feaf6ffd640 1 -- 172.21.15.154:0/2149044905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae0031960 con 0x7feaf8146d70 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.316+0000 7feaf6ffd640 1 -- 172.21.15.154:0/2149044905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0031cf0 con 0x7feaf8146d70 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.316+0000 7feafdd39640 1 -- 172.21.15.154:0/2149044905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 msgr2=0x7feaf80b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.316+0000 7feafdd39640 1 --2- 172.21.15.154:0/2149044905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf80b3050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feae0009790 tx=0x7feae002b8a0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.317+0000 7feafdd39640 1 -- 172.21.15.154:0/2149044905 shutdown_connections 2023-11-27T22:29:18.319 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.317+0000 7feafdd39640 1 --2- 172.21.15.154:0/2149044905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf80b3050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.320 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.317+0000 7feafdd39640 1 --2- 172.21.15.154:0/2149044905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf806a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.320 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.317+0000 7feafdd39640 1 -- 172.21.15.154:0/2149044905 >> 172.21.15.154:0/2149044905 conn(0x7feaf806d2a0 msgr2=0x7feaf806d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:18.320 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.317+0000 7feafdd39640 1 -- 172.21.15.154:0/2149044905 shutdown_connections 2023-11-27T22:29:18.320 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.317+0000 7feafdd39640 1 -- 172.21.15.154:0/2149044905 wait complete. 2023-11-27T22:29:18.320 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.318+0000 7feafdd39640 1 Processor -- start 2023-11-27T22:29:18.322 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.318+0000 7feafdd39640 1 -- start start 2023-11-27T22:29:18.322 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:18.322 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf80b3590 0x7feaf815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:18.322 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf8160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:18.322 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf815e950 con 0x7feaf8146d70 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf815ff80 con 0x7feaf80b3590 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8160950 con 0x7feaf806a4d0 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf8160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf8160410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44374/0 (socket says 172.21.15.154:44374) 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 -- 172.21.15.154:0/1261224905 learned_addr learned my addr 172.21.15.154:0/1261224905 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf77fe640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaeeffd640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf80b3590 0x7feaf815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 -- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 msgr2=0x7feaf815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf815cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 -- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf80b3590 msgr2=0x7feaf815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf80b3590 0x7feaf815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 -- 172.21.15.154:0/1261224905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00093a0 con 0x7feaf8146d70 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf7fff640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf8160410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feaf0001560 tx=0x7feaf000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:18.323 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000a640 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf000a7a0 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf000ab30 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.319+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf815f370 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.320+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf815f930 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.320+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7feaf0007450 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.320+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feaf001b360 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.320+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf8067420 con 0x7feaf8146d70 2023-11-27T22:29:18.324 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.322+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7feaf0018070 con 0x7feaf8146d70 2023-11-27T22:29:18.385 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.384+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaf81600c0 con 0x7feaf8146d70 2023-11-27T22:29:18.386 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.384+0000 7feaf4ff9640 1 -- 172.21.15.154:0/1261224905 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7feaf0012400 con 0x7feaf8146d70 2023-11-27T22:29:18.386 INFO:teuthology.misc.health.smithi154.stdout: 2023-11-27T22:29:18.386 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":10,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:17.168050+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:18.387 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 msgr2=0x7feaf8160410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:18.387 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf8160410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feaf0001560 tx=0x7feaf000cc70 comp rx=0 tx=0).stop 2023-11-27T22:29:18.387 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 shutdown_connections 2023-11-27T22:29:18.387 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf80b3590 0x7feaf815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.387 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf8146d70 0x7feaf8160410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.387 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 --2- 172.21.15.154:0/1261224905 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feaf806a4d0 0x7feaf815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:18.388 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 >> 172.21.15.154:0/1261224905 conn(0x7feaf806d2a0 msgr2=0x7feaf80ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:18.388 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 shutdown_connections 2023-11-27T22:29:18.388 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:18.385+0000 7feafdd39640 1 -- 172.21.15.154:0/1261224905 wait complete. 2023-11-27T22:29:18.396 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T22:29:18.513 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:18.511+0000 7f2bf923c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T22:29:18.591 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:18.588+0000 7f663f60f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T22:29:18.785 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:18.784+0000 7f2bf923c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T22:29:18.836 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:18.835+0000 7f2bf923c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T22:29:18.862 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:18.860+0000 7f663f60f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T22:29:18.915 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:18.913+0000 7f663f60f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T22:29:18.940 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:18.938+0000 7f2bf923c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T22:29:19.020 INFO:tasks.ceph.mgr.x.smithi194.stderr:2023-11-27T22:29:19.018+0000 7f663f60f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T22:29:19.967 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:19.965+0000 7f2b99d5d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-27T22:29:19.967 INFO:tasks.ceph.mgr.y.smithi154.stderr:2023-11-27T22:29:19.965+0000 7f2b99d5d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-27T22:29:21.309 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T22:29:21.307+0000 7f838ff10500 -1 osd.4 0 log_to_monitors true 2023-11-27T22:29:21.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T22:29:21.322+0000 7f78e9d6c500 -1 osd.5 0 log_to_monitors true 2023-11-27T22:29:21.324 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T22:29:21.322+0000 7f0a229a9500 -1 osd.6 0 log_to_monitors true 2023-11-27T22:29:21.330 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T22:29:21.328+0000 7fb3d2e02500 -1 osd.7 0 log_to_monitors true 2023-11-27T22:29:21.332 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T22:29:21.331+0000 7f02cf010500 -1 osd.1 0 log_to_monitors true 2023-11-27T22:29:21.342 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T22:29:21.341+0000 7f31b3e20500 -1 osd.0 0 log_to_monitors true 2023-11-27T22:29:21.345 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T22:29:21.344+0000 7febf89fb500 -1 osd.3 0 log_to_monitors true 2023-11-27T22:29:21.362 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T22:29:21.360+0000 7f5967e25500 -1 osd.2 0 log_to_monitors true 2023-11-27T22:29:24.892 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T22:29:24.889+0000 7fb3ce56d640 -1 osd.7 0 waiting for initial osdmap 2023-11-27T22:29:24.902 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T22:29:24.900+0000 7fb3c6ba5640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.054 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T22:29:25.052+0000 7febf599e640 -1 osd.3 0 waiting for initial osdmap 2023-11-27T22:29:25.063 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T22:29:25.062+0000 7febec79e640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.066 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T22:29:25.064+0000 7f0a1f94c640 -1 osd.6 0 waiting for initial osdmap 2023-11-27T22:29:25.072 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T22:29:25.071+0000 7f5964dca640 -1 osd.2 0 waiting for initial osdmap 2023-11-27T22:29:25.074 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T22:29:25.073+0000 7f0a1674c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.082 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T22:29:25.081+0000 7f595bbca640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.087 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T22:29:25.085+0000 7f31aef42640 -1 osd.0 0 waiting for initial osdmap 2023-11-27T22:29:25.094 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T22:29:25.092+0000 7f838b67b640 -1 osd.4 0 waiting for initial osdmap 2023-11-27T22:29:25.100 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T22:29:25.098+0000 7f78e54d7640 -1 osd.5 0 waiting for initial osdmap 2023-11-27T22:29:25.101 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T22:29:25.099+0000 7f31a757a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.108 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T22:29:25.107+0000 7f02ca0bc640 -1 osd.1 0 waiting for initial osdmap 2023-11-27T22:29:25.116 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T22:29:25.114+0000 7f8383cb3640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.120 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T22:29:25.118+0000 7f78ddb0f640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.128 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T22:29:25.127+0000 7f02c26f4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T22:29:25.201 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.290+0000 7f8865656640 1 Processor -- start 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.290+0000 7f8865656640 1 -- start start 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f8865656640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88600d2f50 0x7f88600d33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f8865656640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88600ce0e0 con 0x7f8860161b90 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f8865656640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88600cddb0 con 0x7f886015d4f0 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f8865656640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88600d21c0 con 0x7f88600d2f50 2023-11-27T22:29:25.293 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88600d2f50 0x7f88600d33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8860161b90 0x7f88600d1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:47778/0 (socket says 172.21.15.154:47778) 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f88600d2f50 0x7f88600d33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41312/0 (socket says 172.21.15.154:41312) 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885e7fc640 1 -- 172.21.15.154:0/355213044 learned_addr learned my addr 172.21.15.154:0/355213044 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885f7fe640 1 -- 172.21.15.154:0/355213044 >> v1:172.21.15.194:6789/0 conn(0x7f886015d4f0 legacy=0x7f88600b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885f7fe640 1 -- 172.21.15.154:0/355213044 >> v1:172.21.15.154:6789/0 conn(0x7f8860161b90 legacy=0x7f88600d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885f7fe640 1 -- 172.21.15.154:0/355213044 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88600d3920 con 0x7f88600d2f50 2023-11-27T22:29:25.294 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.291+0000 7f885dffb640 1 -- 172.21.15.154:0/355213044 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475188409 0 0) 0x7f88600ce0e0 con 0x7f8860161b90 2023-11-27T22:29:25.295 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.292+0000 7f885f7fe640 1 --2- 172.21.15.154:0/355213044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88600d33e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8858009d90 tx=0x7f885802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f38b1bc89587fe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:25.295 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.292+0000 7f885dffb640 1 -- 172.21.15.154:0/355213044 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885802cd00 con 0x7f88600d2f50 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.292+0000 7f885dffb640 1 -- 172.21.15.154:0/355213044 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885802ce60 con 0x7f88600d2f50 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.292+0000 7f885dffb640 1 -- 172.21.15.154:0/355213044 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858034660 con 0x7f88600d2f50 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 -- 172.21.15.154:0/355213044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 msgr2=0x7f88600d33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 --2- 172.21.15.154:0/355213044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88600d33e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8858009d90 tx=0x7f885802bf50 comp rx=0 tx=0).stop 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 -- 172.21.15.154:0/355213044 shutdown_connections 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 --2- 172.21.15.154:0/355213044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88600d33e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 -- 172.21.15.154:0/355213044 >> 172.21.15.154:0/355213044 conn(0x7f886008cbf0 msgr2=0x7f886009c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 -- 172.21.15.154:0/355213044 shutdown_connections 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.293+0000 7f8865656640 1 -- 172.21.15.154:0/355213044 wait complete. 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.294+0000 7f8865656640 1 Processor -- start 2023-11-27T22:29:25.296 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.294+0000 7f8865656640 1 -- start start 2023-11-27T22:29:25.298 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88601600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886015d4f0 0x7f88601f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860161b90 0x7f88601f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886015afa0 con 0x7f88600d2f50 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600ccbd0 con 0x7f8860161b90 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88601f2c10 con 0x7f886015d4f0 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88601600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88601600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:41322/0 (socket says 172.21.15.154:41322) 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 -- 172.21.15.154:0/1726347495 learned_addr learned my addr 172.21.15.154:0/1726347495 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885f7fe640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860161b90 0x7f88601f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885e7fc640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886015d4f0 0x7f88601f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 -- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886015d4f0 msgr2=0x7f88601f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.299 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886015d4f0 0x7f88601f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 -- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860161b90 msgr2=0x7f88601f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860161b90 0x7f88601f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 -- 172.21.15.154:0/1726347495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858009a70 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885f7fe640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860161b90 0x7f88601f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f885effd640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88601600c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f885000c480 tx=0x7f885000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500052d0 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850005430 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88600cce20 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850012870 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.295+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886015f5e0 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.296+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8860069320 con 0x7f88600d2f50 2023-11-27T22:29:25.300 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.297+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 4) v1 ==== 89314+0+0 (secure 0 0 0) 0x7f88500129d0 con 0x7f88600d2f50 2023-11-27T22:29:25.301 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.297+0000 7f88477fe640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f884c06b130 0x7f884c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:25.301 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.297+0000 7f885e7fc640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f884c06b130 0x7f884c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:25.301 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.297+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8850088680 con 0x7f88600d2f50 2023-11-27T22:29:25.301 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.298+0000 7f885e7fc640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f884c06b130 0x7f884c06d5f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f88601f6220 tx=0x7f8854007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:25.303 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.302+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f88500542b0 con 0x7f88600d2f50 2023-11-27T22:29:25.469 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.468+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88600d4020 con 0x7f88600d2f50 2023-11-27T22:29:25.470 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.468+0000 7f88477fe640 1 -- 172.21.15.154:0/1726347495 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f88500578d0 con 0x7f88600d2f50 2023-11-27T22:29:25.470 INFO:teuthology.misc.health.smithi154.stdout: 2023-11-27T22:29:25.470 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":12,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:22.966387+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:25.472 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f884c06b130 msgr2=0x7f884c06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.472 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f884c06b130 0x7f884c06d5f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f88601f6220 tx=0x7f8854007d00 comp rx=0 tx=0).stop 2023-11-27T22:29:25.472 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 msgr2=0x7f88601600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88601600c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f885000c480 tx=0x7f885000c940 comp rx=0 tx=0).stop 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 shutdown_connections 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860161b90 0x7f88601f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f884c06b130 0x7f884c06d5f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f886015d4f0 0x7f88601f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 --2- 172.21.15.154:0/1726347495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88600d2f50 0x7f88601600c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 >> 172.21.15.154:0/1726347495 conn(0x7f886008cbf0 msgr2=0x7f88600b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 shutdown_connections 2023-11-27T22:29:25.473 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:25.470+0000 7f8865656640 1 -- 172.21.15.154:0/1726347495 wait complete. 2023-11-27T22:29:25.482 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T22:29:32.289 DEBUG:teuthology.orchestra.run.smithi154:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:32.389 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.387+0000 7f20ca17d640 1 Processor -- start 2023-11-27T22:29:32.389 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.387+0000 7f20ca17d640 1 -- start start 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.388+0000 7f20ca17d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 0x7f20c415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.388+0000 7f20ca17d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c415f450 con 0x7f20c40b33b0 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.388+0000 7f20ca17d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c415f730 con 0x7f20c4143e50 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.388+0000 7f20ca17d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40ccf50 con 0x7f20c40b1f60 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.388+0000 7f20c2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f20c40b33b0 0x7f20c40cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34222/0 (socket says 172.21.15.154:34222) 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.388+0000 7f20c2ffd640 1 -- 172.21.15.154:0/3051666183 learned_addr learned my addr 172.21.15.154:0/3051666183 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404205173 0 0) 0x7f20c415f450 con 0x7f20c40b33b0 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ac003520 con 0x7f20c40b33b0 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 0x7f20c415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.392 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3813268058 0 0) 0x7f20ac003520 con 0x7f20c40b33b0 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 msgr2=0x7f20c415ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 0x7f20c415ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 >> v1:172.21.15.194:6789/0 conn(0x7f20c4143e50 legacy=0x7f20c40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c415fa10 con 0x7f20c40b33b0 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f20b8001670 con 0x7f20c40b33b0 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 >> v1:172.21.15.154:6789/0 conn(0x7f20c40b33b0 legacy=0x7f20c40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 0x7f20ac0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac003f20 0x7f20ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ac004d00 0x7f20ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40ccf50 con 0x7f20ac004d00 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac00ba60 con 0x7f20ac003f20 2023-11-27T22:29:32.393 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac00bc20 con 0x7f20c40b1f60 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ac004d00 0x7f20ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c2ffd640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac003f20 0x7f20ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c37fe640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 0x7f20ac0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 -- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 msgr2=0x7f20ac0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b1f60 0x7f20ac0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 -- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac003f20 msgr2=0x7f20ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac003f20 0x7f20ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.389+0000 7f20c3fff640 1 -- 172.21.15.154:0/3051666183 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac003520 con 0x7f20ac004d00 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.390+0000 7f20c3fff640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ac004d00 0x7f20ac005180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009fc0 tx=0x7f20ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6c755eeb6a3d61 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.390+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc02cc20 con 0x7f20ac004d00 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.390+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc00f040 con 0x7f20ac004d00 2023-11-27T22:29:32.394 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.390+0000 7f20c27fc640 1 -- 172.21.15.154:0/3051666183 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc034440 con 0x7f20ac004d00 2023-11-27T22:29:32.397 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20ca17d640 1 -- 172.21.15.154:0/3051666183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ac004d00 msgr2=0x7f20ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.397 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20ca17d640 1 --2- 172.21.15.154:0/3051666183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20ac004d00 0x7f20ac005180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009fc0 tx=0x7f20ac0057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20c3fff640 1 -- 172.21.15.154:0/3051666183 reap_dead start 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20ca17d640 1 -- 172.21.15.154:0/3051666183 shutdown_connections 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20ca17d640 1 -- 172.21.15.154:0/3051666183 >> 172.21.15.154:0/3051666183 conn(0x7f20c40b0c60 msgr2=0x7f20c40b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20ca17d640 1 -- 172.21.15.154:0/3051666183 shutdown_connections 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.391+0000 7f20ca17d640 1 -- 172.21.15.154:0/3051666183 wait complete. 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.392+0000 7f20ca17d640 1 Processor -- start 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.392+0000 7f20ca17d640 1 -- start start 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20ca17d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac004d00 0x7f20c41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20ca17d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 0x7f20c40afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.398 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20ca17d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b0350 0x7f20c41f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20ca17d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41f58f0 con 0x7f20c41f13e0 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20ca17d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40b07b0 con 0x7f20ac004d00 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20ca17d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41399e0 con 0x7f20c40b0350 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 0x7f20c40afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 0x7f20c40afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52468/0 (socket says 172.21.15.154:52468) 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 -- 172.21.15.154:0/366331224 learned_addr learned my addr 172.21.15.154:0/366331224 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c3fff640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b0350 0x7f20c41f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c37fe640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac004d00 0x7f20c41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 -- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b0350 msgr2=0x7f20c41f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b0350 0x7f20c41f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 -- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac004d00 msgr2=0x7f20c41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.399 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac004d00 0x7f20c41596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.393+0000 7f20c2ffd640 1 -- 172.21.15.154:0/366331224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4139cc0 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.394+0000 7f20c2ffd640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 0x7f20c40afe10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20b8007290 tx=0x7f20b8007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.394+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800fa00 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.394+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b800fb80 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.394+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c4139fa0 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.394+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80133f0 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.394+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c4159c00 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.395+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c413a4c0 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.395+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f20b8013550 con 0x7f20c41f13e0 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.395+0000 7f20abfff640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20b006b1c0 0x7f20b006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.400 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.396+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f20b80898e0 con 0x7f20c41f13e0 2023-11-27T22:29:32.401 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.396+0000 7f20c37fe640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20b006b1c0 0x7f20b006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.401 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.396+0000 7f20c37fe640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20b006b1c0 0x7f20b006d680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f20b40017e0 tx=0x7f20b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:32.402 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.400+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f20c413a4c0 con 0x7f20c41f13e0 2023-11-27T22:29:32.568 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.567+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c413a4c0 con 0x7f20c41f13e0 2023-11-27T22:29:32.569 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.568+0000 7f20abfff640 1 -- 172.21.15.154:0/366331224 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12875 (secure 0 0 0) 0x7f20c413a4c0 con 0x7f20c41f13e0 2023-11-27T22:29:32.569 INFO:teuthology.misc.health.smithi154.stdout: 2023-11-27T22:29:32.570 INFO:teuthology.misc.health.smithi154.stdout:{"epoch":16,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:29.238931+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:32.571 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.569+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20b006b1c0 msgr2=0x7f20b006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.571 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.569+0000 7f20ca17d640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20b006b1c0 0x7f20b006d680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f20b40017e0 tx=0x7f20b4009040 comp rx=0 tx=0).stop 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 msgr2=0x7f20c40afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 0x7f20c40afe10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f20b8007290 tx=0x7f20b8007690 comp rx=0 tx=0).stop 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 shutdown_connections 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20b006b1c0 0x7f20b006d680 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20c40b0350 0x7f20c41f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20c41f13e0 0x7f20c40afe10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 --2- 172.21.15.154:0/366331224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20ac004d00 0x7f20c41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 >> 172.21.15.154:0/366331224 conn(0x7f20c40b0c60 msgr2=0x7f20c415b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 shutdown_connections 2023-11-27T22:29:32.572 INFO:teuthology.misc.health.smithi154.stderr:2023-11-27T22:29:32.570+0000 7f20ca17d640 1 -- 172.21.15.154:0/366331224 wait complete. 2023-11-27T22:29:32.581 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-27T22:29:32.581 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-27T22:29:32.582 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T22:29:32.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T22:29:32.586 INFO:tasks.ceph.mds.a:Started 2023-11-27T22:29:32.586 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T22:29:32.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T22:29:32.589 INFO:tasks.ceph.mds.c:Started 2023-11-27T22:29:32.589 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T22:29:32.590 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T22:29:32.593 INFO:tasks.ceph.mds.b:Started 2023-11-27T22:29:32.593 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T22:29:32.593 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T22:29:32.595 INFO:tasks.ceph.mds.d:Started 2023-11-27T22:29:32.595 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-27T22:29:32.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:32.662 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-11-27T22:29:32.663 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-11-27T22:29:32.677 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2023-11-27T22:29:32.678 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2023-11-27T22:29:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.699+0000 7f94911ea640 1 Processor -- start 2023-11-27T22:29:32.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.699+0000 7f94911ea640 1 -- start start 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f94911ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f948c143b50 0x7f948c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f94911ea640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f94911ea640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0cf260 con 0x7f948c06ee30 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f94911ea640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c0cfde0 con 0x7f948c143b50 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f94911ea640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c06f2c0 con 0x7f948c06f630 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f948c143b50 0x7f948c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f948c143b50 0x7f948c0ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52512/0 (socket says 172.21.15.154:52512) 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 -- 172.21.15.154:0/1853325333 learned_addr learned my addr 172.21.15.154:0/1853325333 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:32.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948a59c640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 -- 172.21.15.154:0/1853325333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 msgr2=0x7f948c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 -- 172.21.15.154:0/1853325333 >> v1:172.21.15.194:6789/0 conn(0x7f948c06ee30 legacy=0x7f948c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948ad9d640 1 -- 172.21.15.154:0/1853325333 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0cf540 con 0x7f948c143b50 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.700+0000 7f948a59c640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.701+0000 7f948ad9d640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0ce8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f947c009870 tx=0x7f947c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250061a2e41309b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.701+0000 7f9489d9b640 1 -- 172.21.15.154:0/1853325333 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c031640 con 0x7f948c143b50 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.701+0000 7f9489d9b640 1 -- 172.21.15.154:0/1853325333 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c0317a0 con 0x7f948c143b50 2023-11-27T22:29:32.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.701+0000 7f9489d9b640 1 -- 172.21.15.154:0/1853325333 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c031b30 con 0x7f948c143b50 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 -- 172.21.15.154:0/1853325333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 msgr2=0x7f948c0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0ce8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f947c009870 tx=0x7f947c02b8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 -- 172.21.15.154:0/1853325333 shutdown_connections 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 --2- 172.21.15.154:0/1853325333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0ce8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 -- 172.21.15.154:0/1853325333 >> 172.21.15.154:0/1853325333 conn(0x7f948c06d3b0 msgr2=0x7f948c06d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:32.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 -- 172.21.15.154:0/1853325333 shutdown_connections 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.702+0000 7f94911ea640 1 -- 172.21.15.154:0/1853325333 wait complete. 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.703+0000 7f94911ea640 1 Processor -- start 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.703+0000 7f94911ea640 1 -- start start 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f94911ea640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 0x7f948c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f94911ea640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f94911ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f94911ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c142a90 con 0x7f948c143b50 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f94911ea640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1414b0 con 0x7f948c06ee30 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f94911ea640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c141790 con 0x7f948c06f630 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 0x7f948c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:45014/0 (socket says 172.21.15.154:45014) 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 0x7f948c142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:47538/0 (socket says 172.21.15.154:47538) 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948b59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52520/0 (socket says 172.21.15.154:52520) 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.704+0000 7f948ad9d640 1 -- 172.21.15.154:0/3903328621 learned_addr learned my addr 172.21.15.154:0/3903328621 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948a59c640 1 -- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 msgr2=0x7f948c142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948a59c640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 0x7f948c142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948a59c640 1 -- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 msgr2=0x7f948c0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948a59c640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948a59c640 1 -- 172.21.15.154:0/3903328621 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0094d0 con 0x7f948c06f630 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948b59e640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948ad9d640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 0x7f948c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:32.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f948a59c640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c140bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9480009a60 tx=0x7f9480009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:32.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480015070 con 0x7f948c06f630 2023-11-27T22:29:32.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800102e0 con 0x7f948c06f630 2023-11-27T22:29:32.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480004270 con 0x7f948c06f630 2023-11-27T22:29:32.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c141a70 con 0x7f948c06f630 2023-11-27T22:29:32.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.705+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c142030 con 0x7f948c06f630 2023-11-27T22:29:32.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.706+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c067420 con 0x7f948c06f630 2023-11-27T22:29:32.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.706+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f94800043d0 con 0x7f948c06f630 2023-11-27T22:29:32.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.707+0000 7f94737fe640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f947806b1c0 0x7f947806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.707+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f948008ccc0 con 0x7f948c06f630 2023-11-27T22:29:32.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.707+0000 7f948ad9d640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f947806b1c0 0x7f947806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.707+0000 7f948ad9d640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f947806b1c0 0x7f947806d680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f947c0090b0 tx=0x7f947c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:32.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.711+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9480057d50 con 0x7f948c06f630 2023-11-27T22:29:32.879 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.878+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f948c1418d0 con 0x7f948c06f630 2023-11-27T22:29:32.880 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.879+0000 7f94737fe640 1 -- 172.21.15.154:0/3903328621 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12875 (secure 0 0 0) 0x7f948c1418d0 con 0x7f948c06f630 2023-11-27T22:29:32.880 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:32.881 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:29.238931+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f947806b1c0 msgr2=0x7f947806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f947806b1c0 0x7f947806d680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f947c0090b0 tx=0x7f947c03c040 comp rx=0 tx=0).stop 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 msgr2=0x7f948c140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c140bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9480009a60 tx=0x7f9480009f20 comp rx=0 tx=0).stop 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 shutdown_connections 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f947806b1c0 0x7f947806d680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f948c143b50 0x7f948c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f948c06f630 0x7f948c140bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 --2- 172.21.15.154:0/3903328621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f948c06ee30 0x7f948c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 >> 172.21.15.154:0/3903328621 conn(0x7f948c06d3b0 msgr2=0x7f948c071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:32.883 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 shutdown_connections 2023-11-27T22:29:32.884 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.881+0000 7f94911ea640 1 -- 172.21.15.154:0/3903328621 wait complete. 2023-11-27T22:29:32.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:29:32.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:29:32.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.996+0000 7facb644f640 1 Processor -- start 2023-11-27T22:29:32.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.996+0000 7facb644f640 1 -- start start 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facb644f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7facb015d2e0 0x7facb00d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facb644f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb006ce00 con 0x7facb006bbd0 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facb644f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb006c1f0 con 0x7facb015d6c0 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facb644f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb006c4d0 con 0x7facb015d2e0 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facaffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7facb015d2e0 0x7facb00d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facb49ec640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7facb006bbd0 0x7facb00afee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34234/0 (socket says 172.21.15.154:34234) 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facb49ec640 1 -- 172.21.15.154:0/1638481075 learned_addr learned my addr 172.21.15.154:0/1638481075 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facaffff640 1 -- 172.21.15.154:0/1638481075 >> v1:172.21.15.194:6789/0 conn(0x7facb015d6c0 legacy=0x7facb006b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facaffff640 1 -- 172.21.15.154:0/1638481075 >> v1:172.21.15.154:6789/0 conn(0x7facb006bbd0 legacy=0x7facb00afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:32.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facaffff640 1 -- 172.21.15.154:0/1638481075 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb006c7b0 con 0x7facb015d2e0 2023-11-27T22:29:33.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.997+0000 7facaeffd640 1 -- 172.21.15.154:0/1638481075 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207362549 0 0) 0x7facb006ce00 con 0x7facb006bbd0 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.998+0000 7facaffff640 1 --2- 172.21.15.154:0/1638481075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb015d2e0 0x7facb00d1640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faca00097a0 tx=0x7faca002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87cc0980aa1348c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.998+0000 7facaeffd640 1 -- 172.21.15.154:0/1638481075 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca002e070 con 0x7facb015d2e0 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.998+0000 7facaeffd640 1 -- 172.21.15.154:0/1638481075 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00315a0 con 0x7facb015d2e0 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.998+0000 7facaeffd640 1 -- 172.21.15.154:0/1638481075 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0031930 con 0x7facb015d2e0 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.998+0000 7facb644f640 1 -- 172.21.15.154:0/1638481075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb015d2e0 msgr2=0x7facb00d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.999+0000 7facb644f640 1 --2- 172.21.15.154:0/1638481075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb015d2e0 0x7facb00d1640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faca00097a0 tx=0x7faca002b840 comp rx=0 tx=0).stop 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.999+0000 7facb644f640 1 -- 172.21.15.154:0/1638481075 shutdown_connections 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.999+0000 7facb644f640 1 --2- 172.21.15.154:0/1638481075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb015d2e0 0x7facb00d1640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.999+0000 7facb644f640 1 -- 172.21.15.154:0/1638481075 >> 172.21.15.154:0/1638481075 conn(0x7facb009c580 msgr2=0x7facb00d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:33.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.999+0000 7facb644f640 1 -- 172.21.15.154:0/1638481075 shutdown_connections 2023-11-27T22:29:33.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:32.999+0000 7facb644f640 1 -- 172.21.15.154:0/1638481075 wait complete. 2023-11-27T22:29:33.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.000+0000 7facb644f640 1 Processor -- start 2023-11-27T22:29:33.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.000+0000 7facb644f640 1 -- start start 2023-11-27T22:29:33.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 0x7facb00ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facb015d2e0 0x7facb015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7facb015d6c0 0x7facb00c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb015e530 con 0x7facb006bbd0 2023-11-27T22:29:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00c9be0 con 0x7facb015d2e0 2023-11-27T22:29:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00c6d20 con 0x7facb015d6c0 2023-11-27T22:29:33.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 0x7facb00ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 0x7facb00ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52552/0 (socket says 172.21.15.154:52552) 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 -- 172.21.15.154:0/2211448996 learned_addr learned my addr 172.21.15.154:0/2211448996 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 -- 172.21.15.154:0/2211448996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7facb015d6c0 msgr2=0x7facb00c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7facb015d6c0 0x7facb00c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 -- 172.21.15.154:0/2211448996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facb015d2e0 msgr2=0x7facb015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facb015d2e0 0x7facb015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 -- 172.21.15.154:0/2211448996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009400 con 0x7facb006bbd0 2023-11-27T22:29:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facaffff640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 0x7facb00ccce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faca00098c0 tx=0x7faca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0032900 con 0x7facb006bbd0 2023-11-27T22:29:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0032a80 con 0x7facb006bbd0 2023-11-27T22:29:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb015e740 con 0x7facb006bbd0 2023-11-27T22:29:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0032e30 con 0x7facb006bbd0 2023-11-27T22:29:33.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.001+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb015ed00 con 0x7facb006bbd0 2023-11-27T22:29:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.002+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb0067420 con 0x7facb006bbd0 2023-11-27T22:29:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.003+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faca003b3f0 con 0x7facb006bbd0 2023-11-27T22:29:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.003+0000 7facacff9640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fac9c06b1f0 0x7fac9c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.003+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faca00ab790 con 0x7facb006bbd0 2023-11-27T22:29:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.003+0000 7facaf7fe640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fac9c06b1f0 0x7fac9c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.003+0000 7facaf7fe640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fac9c06b1f0 0x7fac9c06d6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7facb015c440 tx=0x7faca4006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:33.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.007+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faca0076810 con 0x7facb006bbd0 2023-11-27T22:29:33.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.175+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facb00d0950 con 0x7facb006bbd0 2023-11-27T22:29:33.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.175+0000 7facacff9640 1 -- 172.21.15.154:0/2211448996 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7faca0079e30 con 0x7facb006bbd0 2023-11-27T22:29:33.179 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fac9c06b1f0 msgr2=0x7fac9c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fac9c06b1f0 0x7fac9c06d6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7facb015c440 tx=0x7faca4006ba0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 msgr2=0x7facb00ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 0x7facb00ccce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faca00098c0 tx=0x7faca00046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 shutdown_connections 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7facb015d2e0 0x7facb015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fac9c06b1f0 0x7fac9c06d6b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7facb015d6c0 0x7facb00c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 --2- 172.21.15.154:0/2211448996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7facb006bbd0 0x7facb00ccce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 >> 172.21.15.154:0/2211448996 conn(0x7facb009c580 msgr2=0x7facb00b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:33.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 shutdown_connections 2023-11-27T22:29:33.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.177+0000 7facb644f640 1 -- 172.21.15.154:0/2211448996 wait complete. 2023-11-27T22:29:33.189 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:29:33.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.288+0000 7f1730ad3640 1 Processor -- start 2023-11-27T22:29:33.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.288+0000 7f1730ad3640 1 -- start start 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f1730ad3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f172c15d1d0 0x7f172c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f1730ad3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f172c0ad640 0x7f172c06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f1730ad3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0adae0 con 0x7f172c0aeb80 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f1730ad3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c0addc0 con 0x7f172c15d1d0 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f1730ad3640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c0ae0a0 con 0x7f172c0ad640 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f172c15d1d0 0x7f172c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f172c15d1d0 0x7f172c06b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52556/0 (socket says 172.21.15.154:52556) 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 -- 172.21.15.154:0/2574076370 learned_addr learned my addr 172.21.15.154:0/2574076370 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:33.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f1723fff640 1 --2- 172.21.15.154:0/2574076370 >> v2:172.21.15.194:3300/0 conn(0x7f172c0ad640 0x7f172c06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 -- 172.21.15.154:0/2574076370 >> v2:172.21.15.194:3300/0 conn(0x7f172c0ad640 msgr2=0x7f172c06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 --2- 172.21.15.154:0/2574076370 >> v2:172.21.15.194:3300/0 conn(0x7f172c0ad640 0x7f172c06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 -- 172.21.15.154:0/2574076370 >> v1:172.21.15.194:6789/0 conn(0x7f172c0aeb80 legacy=0x7f172c160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:33.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.289+0000 7f172a59c640 1 -- 172.21.15.154:0/2574076370 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c0ae380 con 0x7f172c15d1d0 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.290+0000 7f172a59c640 1 --2- 172.21.15.154:0/2574076370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c15d1d0 0x7f172c06b4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f172c0cc440 tx=0x7f171c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba39395b1cfcff5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.290+0000 7f1729d9b640 1 -- 172.21.15.154:0/2574076370 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c030860 con 0x7f172c15d1d0 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.290+0000 7f1729d9b640 1 -- 172.21.15.154:0/2574076370 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0309c0 con 0x7f172c15d1d0 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.290+0000 7f1729d9b640 1 -- 172.21.15.154:0/2574076370 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c030d50 con 0x7f172c15d1d0 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.290+0000 7f1730ad3640 1 -- 172.21.15.154:0/2574076370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c15d1d0 msgr2=0x7f172c06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.290+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2574076370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c15d1d0 0x7f172c06b4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f172c0cc440 tx=0x7f171c02b9a0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.291+0000 7f1730ad3640 1 -- 172.21.15.154:0/2574076370 shutdown_connections 2023-11-27T22:29:33.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.291+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2574076370 >> v2:172.21.15.194:3300/0 conn(0x7f172c0ad640 0x7f172c06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.291+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2574076370 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c15d1d0 0x7f172c06b4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.291+0000 7f1730ad3640 1 -- 172.21.15.154:0/2574076370 >> 172.21.15.154:0/2574076370 conn(0x7f172c070e70 msgr2=0x7f172c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:33.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.291+0000 7f1730ad3640 1 -- 172.21.15.154:0/2574076370 shutdown_connections 2023-11-27T22:29:33.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.291+0000 7f1730ad3640 1 -- 172.21.15.154:0/2574076370 wait complete. 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.292+0000 7f1730ad3640 1 Processor -- start 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.292+0000 7f1730ad3640 1 -- start start 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 0x7f172c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c0aeb80 0x7f172c0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f172c15d1d0 0x7f172c0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c145df0 con 0x7f172c0ad640 2023-11-27T22:29:33.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c158860 con 0x7f172c0aeb80 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172c0cea10 con 0x7f172c15d1d0 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 0x7f172c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 0x7f172c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52558/0 (socket says 172.21.15.154:52558) 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 -- 172.21.15.154:0/2904296282 learned_addr learned my addr 172.21.15.154:0/2904296282 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1723fff640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c0aeb80 0x7f172c0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172ad9d640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f172c15d1d0 0x7f172c0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 -- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f172c15d1d0 msgr2=0x7f172c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f172c15d1d0 0x7f172c0ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 -- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c0aeb80 msgr2=0x7f172c0cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c0aeb80 0x7f172c0cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 -- 172.21.15.154:0/2904296282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c0094d0 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1723fff640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c0aeb80 0x7f172c0cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f172a59c640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 0x7f172c158320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f171c02b9e0 tx=0x7f171c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c039b60 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c039ce0 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c043650 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c0cecf0 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.293+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c1462e0 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.295+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c069400 con 0x7f172c0ad640 2023-11-27T22:29:33.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.295+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f171c02f3b0 con 0x7f172c0ad640 2023-11-27T22:29:33.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.295+0000 7f1722ffd640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f170c06b1c0 0x7f170c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:33.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.295+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f171c0ab8e0 con 0x7f172c0ad640 2023-11-27T22:29:33.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.295+0000 7f1723fff640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f170c06b1c0 0x7f170c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:33.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.296+0000 7f1723fff640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f170c06b1c0 0x7f170c06d680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f172c06e080 tx=0x7f1714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:33.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.299+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f171c0769f0 con 0x7f172c0ad640 2023-11-27T22:29:33.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.502+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f172c159400 con 0x7f172c0ad640 2023-11-27T22:29:33.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.503+0000 7f1722ffd640 1 -- 172.21.15.154:0/2904296282 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f171c048090 con 0x7f172c0ad640 2023-11-27T22:29:33.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:33.505 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-27T22:29:33.505 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 2 2023-11-27T22:29:33.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.504+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f170c06b1c0 msgr2=0x7f170c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f170c06b1c0 0x7f170c06d680 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f172c06e080 tx=0x7f1714008040 comp rx=0 tx=0).stop 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 msgr2=0x7f172c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 0x7f172c158320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f171c02b9e0 tx=0x7f171c004730 comp rx=0 tx=0).stop 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 shutdown_connections 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f172c0aeb80 0x7f172c0cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f170c06b1c0 0x7f170c06d680 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f172c15d1d0 0x7f172c0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 --2- 172.21.15.154:0/2904296282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f172c0ad640 0x7f172c158320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 >> 172.21.15.154:0/2904296282 conn(0x7f172c070e70 msgr2=0x7f172c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 shutdown_connections 2023-11-27T22:29:33.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:33.505+0000 7f1730ad3640 1 -- 172.21.15.154:0/2904296282 wait complete. 2023-11-27T22:29:35.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:29:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.629+0000 7fde83b0f640 1 Processor -- start 2023-11-27T22:29:35.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde83b0f640 1 -- start start 2023-11-27T22:29:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde83b0f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde7c0d2910 0x7fde7c0d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde83b0f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde7c0d3730 0x7fde7c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde83b0f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c0b2b10 con 0x7fde7c15d330 2023-11-27T22:29:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde83b0f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0d3bc0 con 0x7fde7c0d3730 2023-11-27T22:29:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde83b0f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0d1590 con 0x7fde7c0d2910 2023-11-27T22:29:35.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde820ac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde7c0d3730 0x7fde7c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde820ac640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde7c0d3730 0x7fde7c0b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52560/0 (socket says 172.21.15.154:52560) 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.630+0000 7fde820ac640 1 -- 172.21.15.154:0/268466615 learned_addr learned my addr 172.21.15.154:0/268466615 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.631+0000 7fde810aa640 1 --2- 172.21.15.154:0/268466615 >> v2:172.21.15.194:3300/0 conn(0x7fde7c0d2910 0x7fde7c0d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.631+0000 7fde820ac640 1 -- 172.21.15.154:0/268466615 >> v2:172.21.15.194:3300/0 conn(0x7fde7c0d2910 msgr2=0x7fde7c0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.631+0000 7fde820ac640 1 --2- 172.21.15.154:0/268466615 >> v2:172.21.15.194:3300/0 conn(0x7fde7c0d2910 0x7fde7c0d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.631+0000 7fde820ac640 1 -- 172.21.15.154:0/268466615 >> v1:172.21.15.194:6789/0 conn(0x7fde7c15d330 legacy=0x7fde7c0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.631+0000 7fde820ac640 1 -- 172.21.15.154:0/268466615 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0d1870 con 0x7fde7c0d3730 2023-11-27T22:29:35.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.631+0000 7fde810aa640 1 --2- 172.21.15.154:0/268466615 >> v2:172.21.15.194:3300/0 conn(0x7fde7c0d2910 0x7fde7c0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:35.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.632+0000 7fde820ac640 1 --2- 172.21.15.154:0/268466615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d3730 0x7fde7c0b6390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0d1540 tx=0x7fde7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bb400c0de7f7a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:35.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.633+0000 7fde808a9640 1 -- 172.21.15.154:0/268466615 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74031870 con 0x7fde7c0d3730 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.633+0000 7fde808a9640 1 -- 172.21.15.154:0/268466615 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740319d0 con 0x7fde7c0d3730 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.633+0000 7fde808a9640 1 -- 172.21.15.154:0/268466615 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74031d60 con 0x7fde7c0d3730 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 -- 172.21.15.154:0/268466615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d3730 msgr2=0x7fde7c0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 --2- 172.21.15.154:0/268466615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d3730 0x7fde7c0b6390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0d1540 tx=0x7fde7402b910 comp rx=0 tx=0).stop 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 -- 172.21.15.154:0/268466615 shutdown_connections 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 --2- 172.21.15.154:0/268466615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d3730 0x7fde7c0b6390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 --2- 172.21.15.154:0/268466615 >> v2:172.21.15.194:3300/0 conn(0x7fde7c0d2910 0x7fde7c0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 -- 172.21.15.154:0/268466615 >> 172.21.15.154:0/268466615 conn(0x7fde7c072020 msgr2=0x7fde7c072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 -- 172.21.15.154:0/268466615 shutdown_connections 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.634+0000 7fde83b0f640 1 -- 172.21.15.154:0/268466615 wait complete. 2023-11-27T22:29:35.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.635+0000 7fde83b0f640 1 Processor -- start 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.635+0000 7fde83b0f640 1 -- start start 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde83b0f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 0x7fde7c14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde83b0f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c0d3730 0x7fde7c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde83b0f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c15d330 0x7fde7c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde83b0f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0c82d0 con 0x7fde7c0d2910 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde83b0f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0cbe70 con 0x7fde7c0d3730 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde83b0f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0c7ff0 con 0x7fde7c15d330 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 0x7fde7c14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 0x7fde7c14a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52572/0 (socket says 172.21.15.154:52572) 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 -- 172.21.15.154:0/2942223589 learned_addr learned my addr 172.21.15.154:0/2942223589 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde810aa640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c0d3730 0x7fde7c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde820ac640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c15d330 0x7fde7c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 -- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c15d330 msgr2=0x7fde7c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c15d330 0x7fde7c0b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 -- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c0d3730 msgr2=0x7fde7c0c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c0d3730 0x7fde7c0c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde818ab640 1 -- 172.21.15.154:0/2942223589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740094d0 con 0x7fde7c0d2910 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde810aa640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c0d3730 0x7fde7c0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.636+0000 7fde820ac640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c15d330 0x7fde7c0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.637+0000 7fde818ab640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 0x7fde7c14a4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c760 tx=0x7fde7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.637+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78003b70 con 0x7fde7c0d2910 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.637+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde78003cf0 con 0x7fde7c0d2910 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.637+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800aa90 con 0x7fde7c0d2910 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.637+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c0cb820 con 0x7fde7c0d2910 2023-11-27T22:29:35.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.637+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0c7c90 con 0x7fde7c0d2910 2023-11-27T22:29:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.638+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c069400 con 0x7fde7c0d2910 2023-11-27T22:29:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.638+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fde7800abf0 con 0x7fde7c0d2910 2023-11-27T22:29:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.638+0000 7fde727fc640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b1c0 0x7fde6006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.639+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde78089440 con 0x7fde7c0d2910 2023-11-27T22:29:35.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.639+0000 7fde810aa640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b1c0 0x7fde6006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.639+0000 7fde810aa640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b1c0 0x7fde6006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0b1e60 tx=0x7fde6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:35.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.643+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fde78054550 con 0x7fde7c0d2910 2023-11-27T22:29:35.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.845+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde7c0d3390 con 0x7fde7c0d2910 2023-11-27T22:29:35.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.845+0000 7fde727fc640 1 -- 172.21.15.154:0/2942223589 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7fde78003e60 con 0x7fde7c0d2910 2023-11-27T22:29:35.847 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:35.847 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-27T22:29:35.847 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 3 2023-11-27T22:29:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b1c0 msgr2=0x7fde6006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b1c0 0x7fde6006d680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0b1e60 tx=0x7fde6c008040 comp rx=0 tx=0).stop 2023-11-27T22:29:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 msgr2=0x7fde7c14a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 0x7fde7c14a4b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c760 tx=0x7fde7800cc20 comp rx=0 tx=0).stop 2023-11-27T22:29:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 shutdown_connections 2023-11-27T22:29:35.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c0d3730 0x7fde7c0c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b1c0 0x7fde6006d680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c15d330 0x7fde7c0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 --2- 172.21.15.154:0/2942223589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c0d2910 0x7fde7c14a4b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 >> 172.21.15.154:0/2942223589 conn(0x7fde7c072020 msgr2=0x7fde7c0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 shutdown_connections 2023-11-27T22:29:35.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.847+0000 7fde83b0f640 1 -- 172.21.15.154:0/2942223589 wait complete. 2023-11-27T22:29:35.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:35.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 Processor -- start 2023-11-27T22:29:35.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 -- start start 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd4d815d330 0x7fd4d80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4d80d2910 0x7fd4d80d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d80b2b10 con 0x7fd4d80d3730 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80d3bc0 con 0x7fd4d80d2910 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.958+0000 7fd4dd9f1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80d1590 con 0x7fd4d815d330 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d67fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4d80d2910 0x7fd4d80d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d77fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd4d80d3730 0x7fd4d80b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34240/0 (socket says 172.21.15.154:34240) 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d67fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4d80d2910 0x7fd4d80d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52586/0 (socket says 172.21.15.154:52586) 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d77fe640 1 -- 172.21.15.154:0/595910039 learned_addr learned my addr 172.21.15.154:0/595910039 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d6ffd640 1 --2- 172.21.15.154:0/595910039 >> v2:172.21.15.194:3300/0 conn(0x7fd4d815d330 0x7fd4d80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d67fc640 1 -- 172.21.15.154:0/595910039 >> v2:172.21.15.194:3300/0 conn(0x7fd4d815d330 msgr2=0x7fd4d80b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:35.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d67fc640 1 --2- 172.21.15.154:0/595910039 >> v2:172.21.15.194:3300/0 conn(0x7fd4d815d330 0x7fd4d80b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d67fc640 1 -- 172.21.15.154:0/595910039 >> v1:172.21.15.154:6789/0 conn(0x7fd4d80d3730 legacy=0x7fd4d80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d67fc640 1 -- 172.21.15.154:0/595910039 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80d1870 con 0x7fd4d80d2910 2023-11-27T22:29:35.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d5ffb640 1 -- 172.21.15.154:0/595910039 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026266755 0 0) 0x7fd4d80b2b10 con 0x7fd4d80d3730 2023-11-27T22:29:35.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.959+0000 7fd4d6ffd640 1 --2- 172.21.15.154:0/595910039 >> v2:172.21.15.194:3300/0 conn(0x7fd4d815d330 0x7fd4d80b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:35.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4d67fc640 1 --2- 172.21.15.154:0/595910039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d2910 0x7fd4d80d31f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80d0d10 tx=0x7fd4cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c48111d0dbf6ae server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:35.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4d5ffb640 1 -- 172.21.15.154:0/595910039 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc02e070 con 0x7fd4d80d2910 2023-11-27T22:29:35.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4d5ffb640 1 -- 172.21.15.154:0/595910039 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0315a0 con 0x7fd4d80d2910 2023-11-27T22:29:35.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4d5ffb640 1 -- 172.21.15.154:0/595910039 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc031930 con 0x7fd4d80d2910 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/595910039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d2910 msgr2=0x7fd4d80d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/595910039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d2910 0x7fd4d80d31f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80d0d10 tx=0x7fd4cc02b840 comp rx=0 tx=0).stop 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/595910039 shutdown_connections 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/595910039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d2910 0x7fd4d80d31f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/595910039 >> v2:172.21.15.194:3300/0 conn(0x7fd4d815d330 0x7fd4d80b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/595910039 >> 172.21.15.154:0/595910039 conn(0x7fd4d8072020 msgr2=0x7fd4d8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/595910039 shutdown_connections 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.960+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/595910039 wait complete. 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.961+0000 7fd4dd9f1640 1 Processor -- start 2023-11-27T22:29:35.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 -- start start 2023-11-27T22:29:35.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80d2910 0x7fd4d80c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 0x7fd4d80a9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815d330 0x7fd4d80ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d814f690 con 0x7fd4d80d3730 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80aa150 con 0x7fd4d815d330 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4dd9f1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d814c460 con 0x7fd4d80d2910 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 0x7fd4d80a9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 0x7fd4d80a9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52600/0 (socket says 172.21.15.154:52600) 2023-11-27T22:29:35.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4d67fc640 1 -- 172.21.15.154:0/3615868511 learned_addr learned my addr 172.21.15.154:0/3615868511 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.962+0000 7fd4d6ffd640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80d2910 0x7fd4d80c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d77fe640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815d330 0x7fd4d80ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d67fc640 1 -- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80d2910 msgr2=0x7fd4d80c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d67fc640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80d2910 0x7fd4d80c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d67fc640 1 -- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815d330 msgr2=0x7fd4d80ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d67fc640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815d330 0x7fd4d80ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d67fc640 1 -- 172.21.15.154:0/3615868511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009400 con 0x7fd4d80d3730 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d77fe640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815d330 0x7fd4d80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4d67fc640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 0x7fd4d80a9c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc034040 tx=0x7fd4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc004230 con 0x7fd4d80d3730 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc031f00 con 0x7fd4d80d3730 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc032640 con 0x7fd4d80d3730 2023-11-27T22:29:35.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d80cc190 con 0x7fd4d80d3730 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.963+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d80cb6b0 con 0x7fd4d80d3730 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.964+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8069400 con 0x7fd4d80d3730 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.964+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd4cc0327a0 con 0x7fd4d80d3730 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.965+0000 7fd4bffff640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd4c406b1c0 0x7fd4c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.965+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd4cc0ab600 con 0x7fd4d80d3730 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.965+0000 7fd4d6ffd640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd4c406b1c0 0x7fd4c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.965+0000 7fd4d6ffd640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd4c406b1c0 0x7fd4c406d680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8006fd0 tx=0x7fd4c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:35.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:35.969+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd4cc076710 con 0x7fd4d80d3730 2023-11-27T22:29:36.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.137+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4d80d10f0 con 0x7fd4d80d3730 2023-11-27T22:29:36.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.138+0000 7fd4bffff640 1 -- 172.21.15.154:0/3615868511 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12875 (secure 0 0 0) 0x7fd4cc079d30 con 0x7fd4d80d3730 2023-11-27T22:29:36.139 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:36.140 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":16,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:29.238931+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:36.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd4c406b1c0 msgr2=0x7fd4c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd4c406b1c0 0x7fd4c406d680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8006fd0 tx=0x7fd4c8008040 comp rx=0 tx=0).stop 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 msgr2=0x7fd4d80a9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 0x7fd4d80a9c10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc034040 tx=0x7fd4cc0046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 shutdown_connections 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4d815d330 0x7fd4d80ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd4c406b1c0 0x7fd4c406d680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4d80d3730 0x7fd4d80a9c10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 --2- 172.21.15.154:0/3615868511 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4d80d2910 0x7fd4d80c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 >> 172.21.15.154:0/3615868511 conn(0x7fd4d8072020 msgr2=0x7fd4d80b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 shutdown_connections 2023-11-27T22:29:36.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.140+0000 7fd4dd9f1640 1 -- 172.21.15.154:0/3615868511 wait complete. 2023-11-27T22:29:36.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:29:36.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:29:36.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.254+0000 7fb5a8cd0640 1 Processor -- start 2023-11-27T22:29:36.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.254+0000 7fb5a8cd0640 1 -- start start 2023-11-27T22:29:36.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a8cd0640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb5a4150560 0x7fb5a40b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a8cd0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5a4150940 0x7fb5a40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a8cd0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a40b49f0 con 0x7fb5a40b3390 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a8cd0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a40b3de0 con 0x7fb5a4150940 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a8cd0640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a40b40c0 con 0x7fb5a4150560 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5a4150940 0x7fb5a40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5a4150940 0x7fb5a40ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52604/0 (socket says 172.21.15.154:52604) 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 -- 172.21.15.154:0/2106304904 learned_addr learned my addr 172.21.15.154:0/2106304904 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a259c640 1 --2- 172.21.15.154:0/2106304904 >> v2:172.21.15.194:3300/0 conn(0x7fb5a4150560 0x7fb5a40b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 -- 172.21.15.154:0/2106304904 >> v2:172.21.15.194:3300/0 conn(0x7fb5a4150560 msgr2=0x7fb5a40b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 --2- 172.21.15.154:0/2106304904 >> v2:172.21.15.194:3300/0 conn(0x7fb5a4150560 0x7fb5a40b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 -- 172.21.15.154:0/2106304904 >> v1:172.21.15.194:6789/0 conn(0x7fb5a40b3390 legacy=0x7fb5a415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.255+0000 7fb5a2d9d640 1 -- 172.21.15.154:0/2106304904 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40b43a0 con 0x7fb5a4150940 2023-11-27T22:29:36.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.256+0000 7fb5a2d9d640 1 --2- 172.21.15.154:0/2106304904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a4150940 0x7fb5a40ce0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4072840 tx=0x7fb59c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bc420e6a3b9b4f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.256+0000 7fb5a1d9b640 1 -- 172.21.15.154:0/2106304904 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c02ca80 con 0x7fb5a4150940 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.256+0000 7fb5a1d9b640 1 -- 172.21.15.154:0/2106304904 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c02cbe0 con 0x7fb5a4150940 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.256+0000 7fb5a1d9b640 1 -- 172.21.15.154:0/2106304904 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0343f0 con 0x7fb5a4150940 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/2106304904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a4150940 msgr2=0x7fb5a40ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/2106304904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a4150940 0x7fb5a40ce0e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4072840 tx=0x7fb59c02bee0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/2106304904 shutdown_connections 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/2106304904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a4150940 0x7fb5a40ce0e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/2106304904 >> v2:172.21.15.194:3300/0 conn(0x7fb5a4150560 0x7fb5a40b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/2106304904 >> 172.21.15.154:0/2106304904 conn(0x7fb5a406a4d0 msgr2=0x7fb5a406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/2106304904 shutdown_connections 2023-11-27T22:29:36.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.257+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/2106304904 wait complete. 2023-11-27T22:29:36.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.258+0000 7fb5a8cd0640 1 Processor -- start 2023-11-27T22:29:36.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.258+0000 7fb5a8cd0640 1 -- start start 2023-11-27T22:29:36.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 0x7fb5a4153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5a4150560 0x7fb5a415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5a4152010 0x7fb5a41e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a41525a0 con 0x7fb5a40b3390 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4152880 con 0x7fb5a4150560 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4152b60 con 0x7fb5a4152010 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 0x7fb5a4153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 0x7fb5a4153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52614/0 (socket says 172.21.15.154:52614) 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 -- 172.21.15.154:0/1125521797 learned_addr learned my addr 172.21.15.154:0/1125521797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb59bfff640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5a4150560 0x7fb5a415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a2d9d640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5a4152010 0x7fb5a41e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 -- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5a4152010 msgr2=0x7fb5a41e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5a4152010 0x7fb5a41e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 -- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5a4150560 msgr2=0x7fb5a415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5a4150560 0x7fb5a415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 -- 172.21.15.154:0/1125521797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c009b30 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a259c640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 0x7fb5a4153640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb59400c7f0 tx=0x7fb59400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594004220 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5940043a0 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a4152e40 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594007860 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.259+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a415c6e0 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.260+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a415c8d0 con 0x7fb5a40b3390 2023-11-27T22:29:36.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.261+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb594007bd0 con 0x7fb5a40b3390 2023-11-27T22:29:36.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.261+0000 7fb59affd640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb58406b1c0 0x7fb58406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.261+0000 7fb59bfff640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb58406b1c0 0x7fb58406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.261+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb594089650 con 0x7fb5a40b3390 2023-11-27T22:29:36.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.262+0000 7fb59bfff640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb58406b1c0 0x7fb58406d680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb58c004ea0 tx=0x7fb58c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.266+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb5940546d0 con 0x7fb5a40b3390 2023-11-27T22:29:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.432+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5a4069400 con 0x7fb5a40b3390 2023-11-27T22:29:36.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.432+0000 7fb59affd640 1 -- 172.21.15.154:0/1125521797 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb59401e0a0 con 0x7fb5a40b3390 2023-11-27T22:29:36.434 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb58406b1c0 msgr2=0x7fb58406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb58406b1c0 0x7fb58406d680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb58c004ea0 tx=0x7fb58c009040 comp rx=0 tx=0).stop 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 msgr2=0x7fb5a4153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 0x7fb5a4153640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb59400c7f0 tx=0x7fb59400ccb0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 shutdown_connections 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5a4150560 0x7fb5a415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb58406b1c0 0x7fb58406d680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5a4152010 0x7fb5a41e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 --2- 172.21.15.154:0/1125521797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5a40b3390 0x7fb5a4153640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 >> 172.21.15.154:0/1125521797 conn(0x7fb5a406a4d0 msgr2=0x7fb5a40acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:36.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 shutdown_connections 2023-11-27T22:29:36.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.434+0000 7fb5a8cd0640 1 -- 172.21.15.154:0/1125521797 wait complete. 2023-11-27T22:29:36.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T22:29:36.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.545+0000 7f837cec2640 1 Processor -- start 2023-11-27T22:29:36.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.545+0000 7f837cec2640 1 -- start start 2023-11-27T22:29:36.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837cec2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f837806abe0 0x7f83781618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837cec2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83781409d0 0x7f837806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837cec2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83781406f0 con 0x7f8378140310 2023-11-27T22:29:36.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837cec2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8378161e20 con 0x7f837806abe0 2023-11-27T22:29:36.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837cec2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8378143960 con 0x7f83781409d0 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f836ffff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f837806abe0 0x7f83781618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f8376d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83781409d0 0x7f837806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837659c640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8378140310 0x7f837806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:38282/0 (socket says 172.21.15.154:38282) 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f837659c640 1 -- 172.21.15.154:0/1036072774 learned_addr learned my addr 172.21.15.154:0/1036072774 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f8376d9d640 1 -- 172.21.15.154:0/1036072774 >> v2:172.21.15.194:3300/0 conn(0x7f837806abe0 msgr2=0x7f83781618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f8376d9d640 1 --2- 172.21.15.154:0/1036072774 >> v2:172.21.15.194:3300/0 conn(0x7f837806abe0 0x7f83781618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f8376d9d640 1 -- 172.21.15.154:0/1036072774 >> v1:172.21.15.194:6789/0 conn(0x7f8378140310 legacy=0x7f837806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f8375d9b640 1 -- 172.21.15.154:0/1036072774 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782592600 0 0) 0x7f83781406f0 con 0x7f8378140310 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f8376d9d640 1 -- 172.21.15.154:0/1036072774 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378142de0 con 0x7f83781409d0 2023-11-27T22:29:36.549 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.546+0000 7f836ffff640 1 --2- 172.21.15.154:0/1036072774 >> v2:172.21.15.194:3300/0 conn(0x7f837806abe0 0x7f83781618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.547+0000 7f8376d9d640 1 --2- 172.21.15.154:0/1036072774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83781409d0 0x7f837806efb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8370009d90 tx=0x7f837002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da4de502f6b82c48 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.547+0000 7f8375d9b640 1 -- 172.21.15.154:0/1036072774 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837002cbc0 con 0x7f83781409d0 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.547+0000 7f8375d9b640 1 -- 172.21.15.154:0/1036072774 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837002cd20 con 0x7f83781409d0 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.547+0000 7f8375d9b640 1 -- 172.21.15.154:0/1036072774 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370034660 con 0x7f83781409d0 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 -- 172.21.15.154:0/1036072774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83781409d0 msgr2=0x7f837806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 --2- 172.21.15.154:0/1036072774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83781409d0 0x7f837806efb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8370009d90 tx=0x7f837002be10 comp rx=0 tx=0).stop 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 -- 172.21.15.154:0/1036072774 shutdown_connections 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 --2- 172.21.15.154:0/1036072774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83781409d0 0x7f837806efb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 --2- 172.21.15.154:0/1036072774 >> v2:172.21.15.194:3300/0 conn(0x7f837806abe0 0x7f83781618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 -- 172.21.15.154:0/1036072774 >> 172.21.15.154:0/1036072774 conn(0x7f83780b1e50 msgr2=0x7f83780b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:36.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 -- 172.21.15.154:0/1036072774 shutdown_connections 2023-11-27T22:29:36.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.548+0000 7f837cec2640 1 -- 172.21.15.154:0/1036072774 wait complete. 2023-11-27T22:29:36.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.549+0000 7f837cec2640 1 Processor -- start 2023-11-27T22:29:36.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.549+0000 7f837cec2640 1 -- start start 2023-11-27T22:29:36.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837cec2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f837806abe0 0x7f83780b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837cec2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 0x7f83781f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837cec2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83781409d0 0x7f83780ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837cec2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378146bf0 con 0x7f8378140310 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837cec2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378157810 con 0x7f83781409d0 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837cec2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8378145fe0 con 0x7f837806abe0 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 0x7f83781f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f837806abe0 0x7f83780b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f837659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f837806abe0 0x7f83780b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:45056/0 (socket says 172.21.15.154:45056) 2023-11-27T22:29:36.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 0x7f83781f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52620/0 (socket says 172.21.15.154:52620) 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f8376d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83781409d0 0x7f83780ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 -- 172.21.15.154:0/1416734967 learned_addr learned my addr 172.21.15.154:0/1416734967 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 -- 172.21.15.154:0/1416734967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f837806abe0 msgr2=0x7f83780b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f837806abe0 0x7f83780b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 -- 172.21.15.154:0/1416734967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83781409d0 msgr2=0x7f83780ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.550+0000 7f836ffff640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83781409d0 0x7f83780ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f836ffff640 1 -- 172.21.15.154:0/1416734967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8360009400 con 0x7f8378140310 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f836ffff640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 0x7f83781f2500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f836000e960 tx=0x7f836000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836000ca00 con 0x7f8378140310 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836000cb60 con 0x7f8378140310 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8370009a70 con 0x7f8378140310 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360013470 con 0x7f8378140310 2023-11-27T22:29:36.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.551+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8378146370 con 0x7f8378140310 2023-11-27T22:29:36.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.552+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8378146d60 con 0x7f8378140310 2023-11-27T22:29:36.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.552+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f83600135d0 con 0x7f8378140310 2023-11-27T22:29:36.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.553+0000 7f836effd640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f835806b1c0 0x7f835806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.556 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.553+0000 7f837659c640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f835806b1c0 0x7f835806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.553+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8360089910 con 0x7f8378140310 2023-11-27T22:29:36.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.553+0000 7f837659c640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f835806b1c0 0x7f835806d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8368000f60 tx=0x7f8368007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.557+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f83600549c0 con 0x7f8378140310 2023-11-27T22:29:36.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.726+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8378069400 con 0x7f8378140310 2023-11-27T22:29:36.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.727+0000 7f836effd640 1 -- 172.21.15.154:0/1416734967 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8360057fe0 con 0x7f8378140310 2023-11-27T22:29:36.728 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:36.729 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-11-27T22:29:36.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:29:36.729 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-11-27T22:29:36.729 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-11-27T22:29:36.729 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:29:36.729 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-11-27T22:29:36.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f835806b1c0 msgr2=0x7f835806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f835806b1c0 0x7f835806d680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8368000f60 tx=0x7f8368007d50 comp rx=0 tx=0).stop 2023-11-27T22:29:36.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 msgr2=0x7f83781f2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 0x7f83781f2500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f836000e960 tx=0x7f836000ee20 comp rx=0 tx=0).stop 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 shutdown_connections 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83781409d0 0x7f83780ae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f835806b1c0 0x7f835806d680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8378140310 0x7f83781f2500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 --2- 172.21.15.154:0/1416734967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f837806abe0 0x7f83780b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 >> 172.21.15.154:0/1416734967 conn(0x7f83780b1e50 msgr2=0x7f837806f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.728+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 shutdown_connections 2023-11-27T22:29:36.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.729+0000 7f837cec2640 1 -- 172.21.15.154:0/1416734967 wait complete. 2023-11-27T22:29:36.741 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T22:29:36.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T22:29:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.842+0000 7f8eecec2640 1 Processor -- start 2023-11-27T22:29:36.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.842+0000 7f8eecec2640 1 -- start start 2023-11-27T22:29:36.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.843+0000 7f8eecec2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ee806ea50 0x7f8ee806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.843+0000 7f8eecec2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee8160fb0 0x7f8ee8161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.843+0000 7f8eecec2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee8161d20 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.843+0000 7f8eecec2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80d1ee0 con 0x7f8ee806ea50 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.843+0000 7f8eecec2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee806f370 con 0x7f8ee8160fb0 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ee806ea50 0x7f8ee806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ee806ea50 0x7f8ee806ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52634/0 (socket says 172.21.15.154:52634) 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 -- 172.21.15.154:0/2776680192 learned_addr learned my addr 172.21.15.154:0/2776680192 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee5d9b640 1 --2- 172.21.15.154:0/2776680192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee8160fb0 0x7f8ee8161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 -- 172.21.15.154:0/2776680192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee8160fb0 msgr2=0x7f8ee8161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 --2- 172.21.15.154:0/2776680192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee8160fb0 0x7f8ee8161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 -- 172.21.15.154:0/2776680192 >> v1:172.21.15.194:6789/0 conn(0x7f8ee80b3ff0 legacy=0x7f8ee80b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.844+0000 7f8ee659c640 1 -- 172.21.15.154:0/2776680192 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee815e760 con 0x7f8ee806ea50 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8ee659c640 1 --2- 172.21.15.154:0/2776680192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee806ea50 0x7f8ee806ee30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009e50 tx=0x7f8ed802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7878dc50abe271a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8ee559a640 1 -- 172.21.15.154:0/2776680192 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed802cb00 con 0x7f8ee806ea50 2023-11-27T22:29:36.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8ee559a640 1 -- 172.21.15.154:0/2776680192 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed802cc60 con 0x7f8ee806ea50 2023-11-27T22:29:36.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8ee559a640 1 -- 172.21.15.154:0/2776680192 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80343f0 con 0x7f8ee806ea50 2023-11-27T22:29:36.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 -- 172.21.15.154:0/2776680192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee806ea50 msgr2=0x7f8ee806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2776680192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee806ea50 0x7f8ee806ee30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009e50 tx=0x7f8ed802bf60 comp rx=0 tx=0).stop 2023-11-27T22:29:36.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 -- 172.21.15.154:0/2776680192 shutdown_connections 2023-11-27T22:29:36.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2776680192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee8160fb0 0x7f8ee8161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2776680192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee806ea50 0x7f8ee806ee30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 -- 172.21.15.154:0/2776680192 >> 172.21.15.154:0/2776680192 conn(0x7f8ee806a6b0 msgr2=0x7f8ee806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 -- 172.21.15.154:0/2776680192 shutdown_connections 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.845+0000 7f8eecec2640 1 -- 172.21.15.154:0/2776680192 wait complete. 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 Processor -- start 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 -- start start 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee806ea50 0x7f8ee806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 0x7f8ee806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8160fb0 0x7f8ee80b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee806d520 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80b24e0 con 0x7f8ee8160fb0 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.847+0000 7f8eecec2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee806bf40 con 0x7f8ee806ea50 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 0x7f8ee806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 0x7f8ee806cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52638/0 (socket says 172.21.15.154:52638) 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 -- 172.21.15.154:0/2595216821 learned_addr learned my addr 172.21.15.154:0/2595216821 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee659c640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee806ea50 0x7f8ee806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee6d9d640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8160fb0 0x7f8ee80b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 -- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee806ea50 msgr2=0x7f8ee806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee806ea50 0x7f8ee806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 -- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8160fb0 msgr2=0x7f8ee80b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8160fb0 0x7f8ee80b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 -- 172.21.15.154:0/2595216821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009b30 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ee5d9b640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 0x7f8ee806cfe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00e9b0 tx=0x7f8edc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc009670 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc00c9a0 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee806c220 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00cd50 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.848+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee806c7e0 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.849+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8069400 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.850+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8edc013470 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.850+0000 7f8ed6ffd640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ec806b1c0 0x7f8ec806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.850+0000 7f8ee659c640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ec806b1c0 0x7f8ec806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.850+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8edc089870 con 0x7f8ee80b3ff0 2023-11-27T22:29:36.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.851+0000 7f8ee659c640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ec806b1c0 0x7f8ec806d680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8035000 tx=0x7f8ed8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:36.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:36.855+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8edc0549a0 con 0x7f8ee80b3ff0 2023-11-27T22:29:37.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.021+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8ee8070d30 con 0x7f8ee80b3ff0 2023-11-27T22:29:37.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.637+0000 7f8ed6ffd640 1 -- 172.21.15.154:0/2595216821 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8edc0170b0 con 0x7f8ee80b3ff0 2023-11-27T22:29:37.641 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-11-27T22:29:37.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ec806b1c0 msgr2=0x7f8ec806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ec806b1c0 0x7f8ec806d680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8035000 tx=0x7f8ed8030000 comp rx=0 tx=0).stop 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 msgr2=0x7f8ee806cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 0x7f8ee806cfe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00e9b0 tx=0x7f8edc00ee70 comp rx=0 tx=0).stop 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 shutdown_connections 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8160fb0 0x7f8ee80b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ec806b1c0 0x7f8ec806d680 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee80b3ff0 0x7f8ee806cfe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 --2- 172.21.15.154:0/2595216821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ee806ea50 0x7f8ee806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.640+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 >> 172.21.15.154:0/2595216821 conn(0x7f8ee806a6b0 msgr2=0x7f8ee815cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:37.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.641+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 shutdown_connections 2023-11-27T22:29:37.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.641+0000 7f8eecec2640 1 -- 172.21.15.154:0/2595216821 wait complete. 2023-11-27T22:29:37.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T22:29:37.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.766+0000 7f4ba00bb640 1 Processor -- start 2023-11-27T22:29:37.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.766+0000 7f4ba00bb640 1 -- start start 2023-11-27T22:29:37.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.767+0000 7f4ba00bb640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4b9806a4d0 0x7f4b980b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.767+0000 7f4ba00bb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980b49c0 con 0x7f4b980b4e50 2023-11-27T22:29:37.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.767+0000 7f4ba00bb640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b980b3db0 con 0x7f4b9806a8b0 2023-11-27T22:29:37.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.767+0000 7f4ba00bb640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b980b4090 con 0x7f4b9806a4d0 2023-11-27T22:29:37.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.767+0000 7f4b9e658640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b980b4e50 0x7f4b980ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:34254/0 (socket says 172.21.15.154:34254) 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.767+0000 7f4b9e658640 1 -- 172.21.15.154:0/3161187605 learned_addr learned my addr 172.21.15.154:0/3161187605 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3161187605 >> v2:172.21.15.194:3300/0 conn(0x7f4b9806a4d0 0x7f4b980b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957888985 0 0) 0x7f4b980b49c0 con 0x7f4b980b4e50 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b84003520 con 0x7f4b980b4e50 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411439716 0 0) 0x7f4b84003520 con 0x7f4b980b4e50 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 >> v2:172.21.15.194:3300/0 conn(0x7f4b9806a4d0 msgr2=0x7f4b980b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 --2- 172.21.15.154:0/3161187605 >> v2:172.21.15.194:3300/0 conn(0x7f4b9806a4d0 0x7f4b980b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 >> v1:172.21.15.194:6789/0 conn(0x7f4b9806a8b0 legacy=0x7f4b98146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980b4370 con 0x7f4b980b4e50 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f4b90001670 con 0x7f4b980b4e50 2023-11-27T22:29:37.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 >> v1:172.21.15.154:6789/0 conn(0x7f4b980b4e50 legacy=0x7f4b980ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b840047c0 0x7f4b84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b84005180 0x7f4b8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980b4090 con 0x7f4b84003970 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400c020 con 0x7f4b84005180 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8400c1e0 con 0x7f4b840047c0 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9e658640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b84005180 0x7f4b8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9d656640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b840047c0 0x7f4b84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 -- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b840047c0 msgr2=0x7f4b84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b840047c0 0x7f4b84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 -- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b84005180 msgr2=0x7f4b8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b84005180 0x7f4b8400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9de57640 1 -- 172.21.15.154:0/3161187605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84003520 con 0x7f4b84003970 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9e658640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b84005180 0x7f4b8400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.768+0000 7f4b9e658640 1 -- 172.21.15.154:0/3161187605 reap_dead start 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.769+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b84003d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009fc0 tx=0x7f4b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9761c2c6c91a561 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.769+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9402cc20 con 0x7f4b84003970 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.769+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9400f040 con 0x7f4b84003970 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.769+0000 7f4b9ce55640 1 -- 172.21.15.154:0/3161187605 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94034440 con 0x7f4b84003970 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3161187605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 msgr2=0x7f4b84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b84003d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009fc0 tx=0x7f4b840057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3161187605 shutdown_connections 2023-11-27T22:29:37.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3161187605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b84003d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3161187605 >> 172.21.15.154:0/3161187605 conn(0x7f4b980b1c70 msgr2=0x7f4b980b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:37.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3161187605 shutdown_connections 2023-11-27T22:29:37.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.770+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3161187605 wait complete. 2023-11-27T22:29:37.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.771+0000 7f4ba00bb640 1 Processor -- start 2023-11-27T22:29:37.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.771+0000 7f4ba00bb640 1 -- start start 2023-11-27T22:29:37.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b980af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b9813c3d0 0x7f4b9815c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9813aff0 0x7f4b9813b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9813fd60 con 0x7f4b84003970 2023-11-27T22:29:37.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9813b9b0 con 0x7f4b9813aff0 2023-11-27T22:29:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9813f3c0 con 0x7f4b9813c3d0 2023-11-27T22:29:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b980af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b980af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:52658/0 (socket says 172.21.15.154:52658) 2023-11-27T22:29:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 -- 172.21.15.154:0/3662072250 learned_addr learned my addr 172.21.15.154:0/3662072250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9e658640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9813aff0 0x7f4b9813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 -- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b9813c3d0 msgr2=0x7f4b9815c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9d656640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b9813c3d0 0x7f4b9815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b9813c3d0 0x7f4b9815c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 -- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9813aff0 msgr2=0x7f4b9813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9813aff0 0x7f4b9813b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 -- 172.21.15.154:0/3662072250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9813f6a0 con 0x7f4b84003970 2023-11-27T22:29:37.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9e658640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9813aff0 0x7f4b9813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9d656640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b9813c3d0 0x7f4b9815c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b9de57640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b980af3e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400e230 tx=0x7f4b94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:37.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94034c50 con 0x7f4b84003970 2023-11-27T22:29:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94034dd0 con 0x7f4b84003970 2023-11-27T22:29:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9813f980 con 0x7f4b84003970 2023-11-27T22:29:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94003bd0 con 0x7f4b84003970 2023-11-27T22:29:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.772+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9815c990 con 0x7f4b84003970 2023-11-27T22:29:37.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.773+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9813f500 con 0x7f4b84003970 2023-11-27T22:29:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.774+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4b94040450 con 0x7f4b84003970 2023-11-27T22:29:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.774+0000 7f4b8e7fc640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.774+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4b940abdf0 con 0x7f4b84003970 2023-11-27T22:29:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.774+0000 7f4b9d656640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.775+0000 7f4b9d656640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000c00 tx=0x7f4b88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:37.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.779+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4b9813f500 con 0x7f4b84003970 2023-11-27T22:29:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:37.947+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b9813f500 con 0x7f4b84003970 2023-11-27T22:29:38.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:38.552 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:38.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.639+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/3662072250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b9813f500 con 0x7f4b84003970 2023-11-27T22:29:38.642 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.642+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 msgr2=0x7f4b7c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.642+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000c00 tx=0x7f4b88009040 comp rx=0 tx=0).stop 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.642+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 msgr2=0x7f4b980af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.642+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b980af3e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400e230 tx=0x7f4b94009750 comp rx=0 tx=0).stop 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 shutdown_connections 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9813aff0 0x7f4b9813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b9813c3d0 0x7f4b9815c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 --2- 172.21.15.154:0/3662072250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b84003970 0x7f4b980af3e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 >> 172.21.15.154:0/3662072250 conn(0x7f4b980b1c70 msgr2=0x7f4b98144050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 shutdown_connections 2023-11-27T22:29:38.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.643+0000 7f4ba00bb640 1 -- 172.21.15.154:0/3662072250 wait complete. 2023-11-27T22:29:38.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T22:29:38.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.769+0000 7f27c43ec640 1 Processor -- start 2023-11-27T22:29:38.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.769+0000 7f27c43ec640 1 -- start start 2023-11-27T22:29:38.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c43ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27bc06abe0 0x7f27bc1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:38.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c43ec640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27bc1409d0 0x7f27bc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:38.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c43ec640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc1406f0 con 0x7f27bc140310 2023-11-27T22:29:38.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c43ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc161e20 con 0x7f27bc06abe0 2023-11-27T22:29:38.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c43ec640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc143960 con 0x7f27bc1409d0 2023-11-27T22:29:38.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c1987640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27bc06abe0 0x7f27bc1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:38.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c1987640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27bc06abe0 0x7f27bc1618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56324/0 (socket says 172.21.15.154:56324) 2023-11-27T22:29:38.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c1987640 1 -- 172.21.15.154:0/2008858797 learned_addr learned my addr 172.21.15.154:0/2008858797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:38.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c2989640 1 --2- 172.21.15.154:0/2008858797 >> v2:172.21.15.194:3300/0 conn(0x7f27bc1409d0 0x7f27bc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:38.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c1987640 1 -- 172.21.15.154:0/2008858797 >> v2:172.21.15.194:3300/0 conn(0x7f27bc1409d0 msgr2=0x7f27bc06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:38.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.770+0000 7f27c1987640 1 --2- 172.21.15.154:0/2008858797 >> v2:172.21.15.194:3300/0 conn(0x7f27bc1409d0 0x7f27bc06efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.771+0000 7f27c1987640 1 -- 172.21.15.154:0/2008858797 >> v1:172.21.15.194:6789/0 conn(0x7f27bc140310 legacy=0x7f27bc06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:38.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.771+0000 7f27c1987640 1 -- 172.21.15.154:0/2008858797 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc142de0 con 0x7f27bc06abe0 2023-11-27T22:29:38.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.771+0000 7f27c1987640 1 --2- 172.21.15.154:0/2008858797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc06abe0 0x7f27bc1618e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27bc154960 tx=0x7f27b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a437e654130845eb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:38.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.771+0000 7f27c1186640 1 -- 172.21.15.154:0/2008858797 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0031870 con 0x7f27bc06abe0 2023-11-27T22:29:38.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.771+0000 7f27c1186640 1 -- 172.21.15.154:0/2008858797 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00319d0 con 0x7f27bc06abe0 2023-11-27T22:29:38.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.771+0000 7f27c1186640 1 -- 172.21.15.154:0/2008858797 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b0031d60 con 0x7f27bc06abe0 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 -- 172.21.15.154:0/2008858797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc06abe0 msgr2=0x7f27bc1618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 --2- 172.21.15.154:0/2008858797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc06abe0 0x7f27bc1618e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27bc154960 tx=0x7f27b002b910 comp rx=0 tx=0).stop 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 -- 172.21.15.154:0/2008858797 shutdown_connections 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 --2- 172.21.15.154:0/2008858797 >> v2:172.21.15.194:3300/0 conn(0x7f27bc1409d0 0x7f27bc06efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 --2- 172.21.15.154:0/2008858797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc06abe0 0x7f27bc1618e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 -- 172.21.15.154:0/2008858797 >> 172.21.15.154:0/2008858797 conn(0x7f27bc0b1e50 msgr2=0x7f27bc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:38.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 -- 172.21.15.154:0/2008858797 shutdown_connections 2023-11-27T22:29:38.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.772+0000 7f27c43ec640 1 -- 172.21.15.154:0/2008858797 wait complete. 2023-11-27T22:29:38.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.773+0000 7f27c43ec640 1 Processor -- start 2023-11-27T22:29:38.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.773+0000 7f27c43ec640 1 -- start start 2023-11-27T22:29:38.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c43ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27bc06abe0 0x7f27bc1f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:38.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c43ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 0x7f27bc0ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:38.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c43ec640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1409d0 0x7f27bc15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:38.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c43ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0adaa0 con 0x7f27bc140310 2023-11-27T22:29:38.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c43ec640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0ae570 con 0x7f27bc1409d0 2023-11-27T22:29:38.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c43ec640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc15ce00 con 0x7f27bc06abe0 2023-11-27T22:29:38.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 0x7f27bc0ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:38.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 0x7f27bc0ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56328/0 (socket says 172.21.15.154:56328) 2023-11-27T22:29:38.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 -- 172.21.15.154:0/38396839 learned_addr learned my addr 172.21.15.154:0/38396839 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:38.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c2188640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27bc06abe0 0x7f27bc1f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:38.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c2989640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1409d0 0x7f27bc15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:38.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 -- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27bc06abe0 msgr2=0x7f27bc1f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:38.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27bc06abe0 0x7f27bc1f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 -- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1409d0 msgr2=0x7f27bc15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1409d0 0x7f27bc15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 -- 172.21.15.154:0/38396839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b00094d0 con 0x7f27bc140310 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.774+0000 7f27c1987640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 0x7f27bc0ad560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27b002b950 tx=0x7f27b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.775+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b003ad30 con 0x7f27bc140310 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.775+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00443f0 con 0x7f27bc140310 2023-11-27T22:29:38.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.775+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc0adcd0 con 0x7f27bc140310 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.775+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b00447a0 con 0x7f27bc140310 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.775+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc0ae290 con 0x7f27bc140310 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.776+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc069400 con 0x7f27bc140310 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.776+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f27b004d450 con 0x7f27bc140310 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.776+0000 7f27baffd640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f27a806b1c0 0x7f27a806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.776+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f27b002d040 con 0x7f27bc140310 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.776+0000 7f27c2188640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f27a806b1c0 0x7f27a806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:38.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.777+0000 7f27c2188640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f27a806b1c0 0x7f27a806d680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27b40012e0 tx=0x7f27b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:38.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.781+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f27b0076c30 con 0x7f27bc140310 2023-11-27T22:29:38.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:38.985+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27bc06ea60 con 0x7f27bc140310 2023-11-27T22:29:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.659+0000 7f27baffd640 1 -- 172.21.15.154:0/38396839 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f27b0035070 con 0x7f27bc140310 2023-11-27T22:29:39.662 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 2 and data pool 3 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f27a806b1c0 msgr2=0x7f27a806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f27a806b1c0 0x7f27a806d680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27b40012e0 tx=0x7f27b4009040 comp rx=0 tx=0).stop 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 msgr2=0x7f27bc0ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 0x7f27bc0ad560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27b002b950 tx=0x7f27b00046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 shutdown_connections 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1409d0 0x7f27bc15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f27a806b1c0 0x7f27a806d680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27bc140310 0x7f27bc0ad560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 --2- 172.21.15.154:0/38396839 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27bc06abe0 0x7f27bc1f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 >> 172.21.15.154:0/38396839 conn(0x7f27bc0b1e50 msgr2=0x7f27bc15ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:39.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 shutdown_connections 2023-11-27T22:29:39.666 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.662+0000 7f27c43ec640 1 -- 172.21.15.154:0/38396839 wait complete. 2023-11-27T22:29:39.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:39.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.782+0000 7f3881573640 1 Processor -- start 2023-11-27T22:29:39.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.782+0000 7f3881573640 1 -- start start 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f3881573640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f387c143490 0x7f387c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f3881573640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f387c15e730 0x7f387c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f3881573640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c15e2a0 con 0x7f387c15a4e0 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f3881573640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c15b520 con 0x7f387c143490 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f3881573640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c143870 con 0x7f387c15e730 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f387c143490 0x7f387c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f387c15a4e0 0x7f387c15a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44314/0 (socket says 172.21.15.154:44314) 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387b7fe640 1 -- 172.21.15.154:0/2295430656 learned_addr learned my addr 172.21.15.154:0/2295430656 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f38727fc640 1 --2- 172.21.15.154:0/2295430656 >> v2:172.21.15.194:3300/0 conn(0x7f387c15e730 0x7f387c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387affd640 1 -- 172.21.15.154:0/2295430656 >> v2:172.21.15.194:3300/0 conn(0x7f387c15e730 msgr2=0x7f387c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:39.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387affd640 1 --2- 172.21.15.154:0/2295430656 >> v2:172.21.15.194:3300/0 conn(0x7f387c15e730 0x7f387c0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387affd640 1 -- 172.21.15.154:0/2295430656 >> v1:172.21.15.154:6789/0 conn(0x7f387c15a4e0 legacy=0x7f387c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387affd640 1 -- 172.21.15.154:0/2295430656 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c15b240 con 0x7f387c143490 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f387a7fc640 1 -- 172.21.15.154:0/2295430656 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165565321 0 0) 0x7f387c15e2a0 con 0x7f387c15a4e0 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.783+0000 7f38727fc640 1 --2- 172.21.15.154:0/2295430656 >> v2:172.21.15.194:3300/0 conn(0x7f387c15e730 0x7f387c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.784+0000 7f387affd640 1 --2- 172.21.15.154:0/2295430656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c0b0cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f387c0aeca0 tx=0x7f386c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d760f1d95dcba2c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.784+0000 7f387a7fc640 1 -- 172.21.15.154:0/2295430656 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c031830 con 0x7f387c143490 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.784+0000 7f387a7fc640 1 -- 172.21.15.154:0/2295430656 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c031990 con 0x7f387c143490 2023-11-27T22:29:39.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.784+0000 7f387a7fc640 1 -- 172.21.15.154:0/2295430656 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c031d20 con 0x7f387c143490 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 -- 172.21.15.154:0/2295430656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 msgr2=0x7f387c0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 --2- 172.21.15.154:0/2295430656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c0b0cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f387c0aeca0 tx=0x7f386c02b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 -- 172.21.15.154:0/2295430656 shutdown_connections 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 --2- 172.21.15.154:0/2295430656 >> v2:172.21.15.194:3300/0 conn(0x7f387c15e730 0x7f387c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 --2- 172.21.15.154:0/2295430656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c0b0cf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 -- 172.21.15.154:0/2295430656 >> 172.21.15.154:0/2295430656 conn(0x7f387c06a4d0 msgr2=0x7f387c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 -- 172.21.15.154:0/2295430656 shutdown_connections 2023-11-27T22:29:39.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.785+0000 7f3881573640 1 -- 172.21.15.154:0/2295430656 wait complete. 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.786+0000 7f3881573640 1 Processor -- start 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.786+0000 7f3881573640 1 -- start start 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3881573640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c13c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3881573640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f387c15a4e0 0x7f387c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3881573640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f387c15e730 0x7f387c164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3881573640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c13ce40 con 0x7f387c143490 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3881573640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c13d120 con 0x7f387c15e730 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3881573640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c13d400 con 0x7f387c15a4e0 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c13c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:39.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c13c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56352/0 (socket says 172.21.15.154:56352) 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 -- 172.21.15.154:0/2344145779 learned_addr learned my addr 172.21.15.154:0/2344145779 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387b7fe640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f387c15e730 0x7f387c164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f38727fc640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f387c15a4e0 0x7f387c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 -- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f387c15a4e0 msgr2=0x7f387c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f387c15a4e0 0x7f387c0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 -- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f387c15e730 msgr2=0x7f387c164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f387c15e730 0x7f387c164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 -- 172.21.15.154:0/2344145779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c009400 con 0x7f387c143490 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387b7fe640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f387c15e730 0x7f387c164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f38727fc640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f387c15a4e0 0x7f387c0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f387affd640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c13c860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f386c009890 tx=0x7f386c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:39.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.787+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c03ba70 con 0x7f387c143490 2023-11-27T22:29:39.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.788+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c03bbf0 con 0x7f387c143490 2023-11-27T22:29:39.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.788+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c13d6e0 con 0x7f387c143490 2023-11-27T22:29:39.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.788+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c045400 con 0x7f387c143490 2023-11-27T22:29:39.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.788+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c1f1590 con 0x7f387c143490 2023-11-27T22:29:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.789+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c13dc00 con 0x7f387c143490 2023-11-27T22:29:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.789+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f386c04e440 con 0x7f387c143490 2023-11-27T22:29:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.789+0000 7f3873fff640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f385c06b1c0 0x7f385c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.789+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f386c0abe90 con 0x7f387c143490 2023-11-27T22:29:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.790+0000 7f38727fc640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f385c06b1c0 0x7f385c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:39.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.790+0000 7f38727fc640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f385c06b1c0 0x7f385c06d680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3864006fd0 tx=0x7f3864008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:39.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.794+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f387c13dc00 con 0x7f387c143490 2023-11-27T22:29:39.965 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.963+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f387c13dc00 con 0x7f387c143490 2023-11-27T22:29:39.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.964+0000 7f3873fff640 1 -- 172.21.15.154:0/2344145779 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16543 (secure 0 0 0) 0x7f387c13dc00 con 0x7f387c143490 2023-11-27T22:29:39.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:39.967 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:38.987207+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f385c06b1c0 msgr2=0x7f385c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f385c06b1c0 0x7f385c06d680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3864006fd0 tx=0x7f3864008040 comp rx=0 tx=0).stop 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 msgr2=0x7f387c13c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c13c860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f386c009890 tx=0x7f386c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 shutdown_connections 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f387c15e730 0x7f387c164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f385c06b1c0 0x7f385c06d680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f387c15a4e0 0x7f387c0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 --2- 172.21.15.154:0/2344145779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387c143490 0x7f387c13c860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:39.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 >> 172.21.15.154:0/2344145779 conn(0x7f387c06a4d0 msgr2=0x7f387c06c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:39.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 shutdown_connections 2023-11-27T22:29:39.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:39.966+0000 7f3881573640 1 -- 172.21.15.154:0/2344145779 wait complete. 2023-11-27T22:29:39.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:40.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.077+0000 7fdd7113c640 1 Processor -- start 2023-11-27T22:29:40.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.077+0000 7fdd7113c640 1 -- start start 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd7113c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd6c146460 0x7fdd6c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd7113c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c146fd0 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd7113c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c06c180 con 0x7fdd6c146840 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd7113c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6c06c460 con 0x7fdd6c146460 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd6c146460 0x7fdd6c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6b59e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdd6c06f1c0 0x7fdd6c15db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44320/0 (socket says 172.21.15.154:44320) 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6b59e640 1 -- 172.21.15.154:0/72849666 learned_addr learned my addr 172.21.15.154:0/72849666 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:40.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd6c146460 0x7fdd6c0b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56364/0 (socket says 172.21.15.154:56364) 2023-11-27T22:29:40.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/72849666 >> v1:172.21.15.194:6789/0 conn(0x7fdd6c146840 legacy=0x7fdd6c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:40.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/72849666 >> v1:172.21.15.154:6789/0 conn(0x7fdd6c06f1c0 legacy=0x7fdd6c15db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/72849666 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c06c740 con 0x7fdd6c146460 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.078+0000 7fdd6a59c640 1 -- 172.21.15.154:0/72849666 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3624929853 0 0) 0x7fdd6c146fd0 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd6ad9d640 1 --2- 172.21.15.154:0/72849666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c146460 0x7fdd6c0b49d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097a0 tx=0x7fdd5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b6c55e2bd6d102 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd6a59c640 1 -- 172.21.15.154:0/72849666 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c031830 con 0x7fdd6c146460 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd6a59c640 1 -- 172.21.15.154:0/72849666 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c031990 con 0x7fdd6c146460 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd6a59c640 1 -- 172.21.15.154:0/72849666 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c031d20 con 0x7fdd6c146460 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd7113c640 1 -- 172.21.15.154:0/72849666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c146460 msgr2=0x7fdd6c0b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd7113c640 1 --2- 172.21.15.154:0/72849666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c146460 0x7fdd6c0b49d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097a0 tx=0x7fdd5c02b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd7113c640 1 -- 172.21.15.154:0/72849666 shutdown_connections 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.079+0000 7fdd7113c640 1 --2- 172.21.15.154:0/72849666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c146460 0x7fdd6c0b49d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.080+0000 7fdd7113c640 1 -- 172.21.15.154:0/72849666 >> 172.21.15.154:0/72849666 conn(0x7fdd6c06a6b0 msgr2=0x7fdd6c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.080+0000 7fdd7113c640 1 -- 172.21.15.154:0/72849666 shutdown_connections 2023-11-27T22:29:40.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.080+0000 7fdd7113c640 1 -- 172.21.15.154:0/72849666 wait complete. 2023-11-27T22:29:40.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.081+0000 7fdd7113c640 1 Processor -- start 2023-11-27T22:29:40.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.081+0000 7fdd7113c640 1 -- start start 2023-11-27T22:29:40.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 0x7fdd6c1f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd6c146460 0x7fdd6c0a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd6c146840 0x7fdd6c1331c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0a8a10 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0cc380 con 0x7fdd6c146460 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c0cc660 con 0x7fdd6c146840 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 0x7fdd6c1f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 0x7fdd6c1f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56376/0 (socket says 172.21.15.154:56376) 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/3516253320 learned_addr learned my addr 172.21.15.154:0/3516253320 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6b59e640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd6c146840 0x7fdd6c1331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd63fff640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd6c146460 0x7fdd6c0a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd6c146840 msgr2=0x7fdd6c1331c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd6c146840 0x7fdd6c1331c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd6c146460 msgr2=0x7fdd6c0a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd6c146460 0x7fdd6c0a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 -- 172.21.15.154:0/3516253320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009400 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd6ad9d640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 0x7fdd6c1f3a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000c00 tx=0x7fdd5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c004230 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c004390 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c03a940 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c0cc940 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.082+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c0ccf00 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.083+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c069400 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.084+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdd5c03aaa0 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.084+0000 7fdd637fe640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdd4c06b1c0 0x7fdd4c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.084+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd5c0ac160 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.084+0000 7fdd63fff640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdd4c06b1c0 0x7fdd4c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.084+0000 7fdd63fff640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdd4c06b1c0 0x7fdd4c06d680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd54006fd0 tx=0x7fdd54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.088+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdd5c076e90 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.254+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd6c070460 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.255+0000 7fdd637fe640 1 -- 172.21.15.154:0/3516253320 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16543 (secure 0 0 0) 0x7fdd5c07a4b0 con 0x7fdd6c06f1c0 2023-11-27T22:29:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:40.258 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":19,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:38.987207+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:40.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdd4c06b1c0 msgr2=0x7fdd4c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdd4c06b1c0 0x7fdd4c06d680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd54006fd0 tx=0x7fdd54008040 comp rx=0 tx=0).stop 2023-11-27T22:29:40.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 msgr2=0x7fdd6c1f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 0x7fdd6c1f3a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000c00 tx=0x7fdd5c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 shutdown_connections 2023-11-27T22:29:40.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd6c146460 0x7fdd6c0a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdd4c06b1c0 0x7fdd4c06d680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd6c146840 0x7fdd6c1331c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 --2- 172.21.15.154:0/3516253320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd6c06f1c0 0x7fdd6c1f3a70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 >> 172.21.15.154:0/3516253320 conn(0x7fdd6c06a6b0 msgr2=0x7fdd6c0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:40.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 shutdown_connections 2023-11-27T22:29:40.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.257+0000 7fdd7113c640 1 -- 172.21.15.154:0/3516253320 wait complete. 2023-11-27T22:29:40.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T22:29:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.373+0000 7fed2637c640 1 Processor -- start 2023-11-27T22:29:40.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.373+0000 7fed2637c640 1 -- start start 2023-11-27T22:29:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed2637c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fed2015d330 0x7fed200b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed2637c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed200d3900 0x7fed200b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed2637c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200b2b10 con 0x7fed200d2910 2023-11-27T22:29:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed2637c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200d1590 con 0x7fed200d3900 2023-11-27T22:29:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed2637c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200d1870 con 0x7fed2015d330 2023-11-27T22:29:40.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed24919640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed200d3900 0x7fed200b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed24919640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fed200d3900 0x7fed200b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56386/0 (socket says 172.21.15.154:56386) 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.374+0000 7fed24919640 1 -- 172.21.15.154:0/3689794543 learned_addr learned my addr 172.21.15.154:0/3689794543 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed1ffff640 1 --2- 172.21.15.154:0/3689794543 >> v2:172.21.15.194:3300/0 conn(0x7fed2015d330 0x7fed200b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed24919640 1 -- 172.21.15.154:0/3689794543 >> v2:172.21.15.194:3300/0 conn(0x7fed2015d330 msgr2=0x7fed200b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed24919640 1 --2- 172.21.15.154:0/3689794543 >> v2:172.21.15.194:3300/0 conn(0x7fed2015d330 0x7fed200b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed24919640 1 -- 172.21.15.154:0/3689794543 >> v1:172.21.15.194:6789/0 conn(0x7fed200d2910 legacy=0x7fed200d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed24919640 1 -- 172.21.15.154:0/3689794543 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed200d1b50 con 0x7fed200d3900 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed1ffff640 1 --2- 172.21.15.154:0/3689794543 >> v2:172.21.15.194:3300/0 conn(0x7fed2015d330 0x7fed200b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed24919640 1 --2- 172.21.15.154:0/3689794543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed200d3900 0x7fed200b6390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed200d0d10 tx=0x7fed1802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc58b40f15cb6d7e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.375+0000 7fed1effd640 1 -- 172.21.15.154:0/3689794543 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1802c9f0 con 0x7fed200d3900 2023-11-27T22:29:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed1effd640 1 -- 172.21.15.154:0/3689794543 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1802cb50 con 0x7fed200d3900 2023-11-27T22:29:40.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed1effd640 1 -- 172.21.15.154:0/3689794543 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed180343f0 con 0x7fed200d3900 2023-11-27T22:29:40.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 -- 172.21.15.154:0/3689794543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed200d3900 msgr2=0x7fed200b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 --2- 172.21.15.154:0/3689794543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed200d3900 0x7fed200b6390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fed200d0d10 tx=0x7fed1802be50 comp rx=0 tx=0).stop 2023-11-27T22:29:40.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 -- 172.21.15.154:0/3689794543 shutdown_connections 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 --2- 172.21.15.154:0/3689794543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed200d3900 0x7fed200b6390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 --2- 172.21.15.154:0/3689794543 >> v2:172.21.15.194:3300/0 conn(0x7fed2015d330 0x7fed200b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 -- 172.21.15.154:0/3689794543 >> 172.21.15.154:0/3689794543 conn(0x7fed20072020 msgr2=0x7fed20072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 -- 172.21.15.154:0/3689794543 shutdown_connections 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.376+0000 7fed2637c640 1 -- 172.21.15.154:0/3689794543 wait complete. 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.377+0000 7fed2637c640 1 Processor -- start 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.377+0000 7fed2637c640 1 -- start start 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed2637c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed200d2910 0x7fed2015f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed2637c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed200d3900 0x7fed200ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed2637c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 0x7fed20154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed2637c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20154f50 con 0x7fed2015d330 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed2637c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2015ece0 con 0x7fed200d2910 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed2637c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed200caa30 con 0x7fed200d3900 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed24919640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 0x7fed20154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed24919640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 0x7fed20154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56398/0 (socket says 172.21.15.154:56398) 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed24919640 1 -- 172.21.15.154:0/874681330 learned_addr learned my addr 172.21.15.154:0/874681330 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:40.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed1ffff640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed200d2910 0x7fed2015f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.378+0000 7fed1f7fe640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed200d3900 0x7fed200ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed24919640 1 -- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed200d3900 msgr2=0x7fed200ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed24919640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed200d3900 0x7fed200ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed24919640 1 -- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed200d2910 msgr2=0x7fed2015f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed24919640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed200d2910 0x7fed2015f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed24919640 1 -- 172.21.15.154:0/874681330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18009b30 con 0x7fed2015d330 2023-11-27T22:29:40.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed24919640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 0x7fed20154a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed18036040 tx=0x7fed18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1803e450 con 0x7fed2015d330 2023-11-27T22:29:40.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1803e5d0 con 0x7fed2015d330 2023-11-27T22:29:40.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed200cad10 con 0x7fed2015d330 2023-11-27T22:29:40.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1803e980 con 0x7fed2015d330 2023-11-27T22:29:40.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.379+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed200cb2d0 con 0x7fed2015d330 2023-11-27T22:29:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.380+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed20069400 con 0x7fed2015d330 2023-11-27T22:29:40.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.380+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fed1803eae0 con 0x7fed2015d330 2023-11-27T22:29:40.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.381+0000 7fed1cff9640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fed0c06b1c0 0x7fed0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.381+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed180ac820 con 0x7fed2015d330 2023-11-27T22:29:40.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.381+0000 7fed1ffff640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fed0c06b1c0 0x7fed0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.381+0000 7fed1ffff640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fed0c06b1c0 0x7fed0c06d680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed1000a950 tx=0x7fed10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.385+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fed18077690 con 0x7fed2015d330 2023-11-27T22:29:40.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.587+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fed200b6710 con 0x7fed2015d330 2023-11-27T22:29:40.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.665+0000 7fed1cff9640 1 -- 172.21.15.154:0/874681330 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fed180ac020 con 0x7fed2015d330 2023-11-27T22:29:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fed0c06b1c0 msgr2=0x7fed0c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fed0c06b1c0 0x7fed0c06d680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed1000a950 tx=0x7fed10008040 comp rx=0 tx=0).stop 2023-11-27T22:29:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 msgr2=0x7fed20154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 0x7fed20154a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fed18036040 tx=0x7fed18004a40 comp rx=0 tx=0).stop 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 shutdown_connections 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fed0c06b1c0 0x7fed0c06d680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed2015d330 0x7fed20154a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fed200d3900 0x7fed200ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 --2- 172.21.15.154:0/874681330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed200d2910 0x7fed2015f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 >> 172.21.15.154:0/874681330 conn(0x7fed20072020 msgr2=0x7fed200d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.667+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 shutdown_connections 2023-11-27T22:29:40.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.668+0000 7fed2637c640 1 -- 172.21.15.154:0/874681330 wait complete. 2023-11-27T22:29:40.681 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T22:29:40.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T22:29:40.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.782+0000 7fd4ad8a6640 1 Processor -- start 2023-11-27T22:29:40.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.782+0000 7fd4ad8a6640 1 -- start start 2023-11-27T22:29:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4ad8a6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4a80d2910 0x7fd4a80d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4ad8a6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a80b2b10 con 0x7fd4a815d330 2023-11-27T22:29:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4ad8a6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a80d1590 con 0x7fd4a80d3730 2023-11-27T22:29:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4ad8a6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a80d3bc0 con 0x7fd4a80d2910 2023-11-27T22:29:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a67fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4a80d2910 0x7fd4a80d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a6ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd4a815d330 0x7fd4a80b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44330/0 (socket says 172.21.15.154:44330) 2023-11-27T22:29:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a6ffd640 1 -- 172.21.15.154:0/2864531529 learned_addr learned my addr 172.21.15.154:0/2864531529 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2864531529 >> v1:172.21.15.194:6789/0 conn(0x7fd4a80d3730 legacy=0x7fd4a80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2864531529 >> v1:172.21.15.154:6789/0 conn(0x7fd4a815d330 legacy=0x7fd4a80b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a5ffb640 1 -- 172.21.15.154:0/2864531529 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709444605 0 0) 0x7fd4a80b2b10 con 0x7fd4a815d330 2023-11-27T22:29:40.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.783+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2864531529 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80d1870 con 0x7fd4a80d2910 2023-11-27T22:29:40.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.784+0000 7fd4a67fc640 1 --2- 172.21.15.154:0/2864531529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d2910 0x7fd4a80d31f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0097a0 tx=0x7fd49c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2972de0642d1ed8c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.784+0000 7fd4a5ffb640 1 -- 172.21.15.154:0/2864531529 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c02e070 con 0x7fd4a80d2910 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.784+0000 7fd4a5ffb640 1 -- 172.21.15.154:0/2864531529 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c0315a0 con 0x7fd4a80d2910 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.784+0000 7fd4a5ffb640 1 -- 172.21.15.154:0/2864531529 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c031930 con 0x7fd4a80d2910 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.784+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2864531529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d2910 msgr2=0x7fd4a80d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.784+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2864531529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d2910 0x7fd4a80d31f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0097a0 tx=0x7fd49c02b840 comp rx=0 tx=0).stop 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.785+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2864531529 shutdown_connections 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.785+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2864531529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d2910 0x7fd4a80d31f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.785+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2864531529 >> 172.21.15.154:0/2864531529 conn(0x7fd4a8072020 msgr2=0x7fd4a8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.785+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2864531529 shutdown_connections 2023-11-27T22:29:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.785+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2864531529 wait complete. 2023-11-27T22:29:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.786+0000 7fd4ad8a6640 1 Processor -- start 2023-11-27T22:29:40.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.786+0000 7fd4ad8a6640 1 -- start start 2023-11-27T22:29:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a80d2910 0x7fd4a80c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 0x7fd4a81f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4a815d330 0x7fd4a81f4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81f3430 con 0x7fd4a80d3730 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81f3ec0 con 0x7fd4a80d2910 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81f6680 con 0x7fd4a815d330 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 0x7fd4a81f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 0x7fd4a81f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56430/0 (socket says 172.21.15.154:56430) 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2404865212 learned_addr learned my addr 172.21.15.154:0/2404865212 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a6ffd640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a80d2910 0x7fd4a80c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a77fe640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4a815d330 0x7fd4a81f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4a815d330 msgr2=0x7fd4a81f4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4a815d330 0x7fd4a81f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a80d2910 msgr2=0x7fd4a80c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a80d2910 0x7fd4a80c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 -- 172.21.15.154:0/2404865212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c009400 con 0x7fd4a80d3730 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4a67fc640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 0x7fd4a81f2ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd49c034040 tx=0x7fd49c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c032900 con 0x7fd4a80d3730 2023-11-27T22:29:40.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c032a80 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c032e30 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a81f3620 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.787+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a81f3be0 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.788+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a81f67f0 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.789+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd49c03b3f0 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.789+0000 7fd48ffff640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd49406b1c0 0x7fd49406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.789+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd49c0aba00 con 0x7fd4a80d3730 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.789+0000 7fd4a6ffd640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd49406b1c0 0x7fd49406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:40.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.790+0000 7fd4a6ffd640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd49406b1c0 0x7fd49406d680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd498000f60 tx=0x7fd498009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:40.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.793+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd49c0767c0 con 0x7fd4a80d3730 2023-11-27T22:29:41.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:40.998+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd4a8069400 con 0x7fd4a80d3730 2023-11-27T22:29:41.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.670+0000 7fd48ffff640 1 -- 172.21.15.154:0/2404865212 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd49c079de0 con 0x7fd4a80d3730 2023-11-27T22:29:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd49406b1c0 msgr2=0x7fd49406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd49406b1c0 0x7fd49406d680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd498000f60 tx=0x7fd498009040 comp rx=0 tx=0).stop 2023-11-27T22:29:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 msgr2=0x7fd4a81f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 0x7fd4a81f2ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd49c034040 tx=0x7fd49c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 shutdown_connections 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd49406b1c0 0x7fd49406d680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4a815d330 0x7fd4a81f4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4a80d3730 0x7fd4a81f2ef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 --2- 172.21.15.154:0/2404865212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4a80d2910 0x7fd4a80c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 >> 172.21.15.154:0/2404865212 conn(0x7fd4a8072020 msgr2=0x7fd4a8072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 shutdown_connections 2023-11-27T22:29:41.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.672+0000 7fd4ad8a6640 1 -- 172.21.15.154:0/2404865212 wait complete. 2023-11-27T22:29:41.687 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T22:29:41.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:29:41.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.786+0000 7fc816b00640 1 Processor -- start 2023-11-27T22:29:41.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.786+0000 7fc816b00640 1 -- start start 2023-11-27T22:29:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc816b00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 0x7fc81015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc816b00640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81015e2a0 con 0x7fc810143490 2023-11-27T22:29:41.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc816b00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81015b240 con 0x7fc8100b1400 2023-11-27T22:29:41.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc816b00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81015b520 con 0x7fc81015e730 2023-11-27T22:29:41.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc81489c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc810143490 0x7fc8100b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44336/0 (socket says 172.21.15.154:44336) 2023-11-27T22:29:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc81489c640 1 -- 172.21.15.154:0/434270693 learned_addr learned my addr 172.21.15.154:0/434270693 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613919618 0 0) 0x7fc81015e2a0 con 0x7fc810143490 2023-11-27T22:29:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc800003520 con 0x7fc810143490 2023-11-27T22:29:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc81509d640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 0x7fc81015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075639848 0 0) 0x7fc800003520 con 0x7fc810143490 2023-11-27T22:29:41.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 msgr2=0x7fc81015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 0x7fc81015abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 >> v1:172.21.15.194:6789/0 conn(0x7fc8100b1400 legacy=0x7fc81015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81015dc50 con 0x7fc810143490 2023-11-27T22:29:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fc804001670 con 0x7fc810143490 2023-11-27T22:29:41.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 >> v1:172.21.15.154:6789/0 conn(0x7fc810143490 legacy=0x7fc8100b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8000039a0 0x7fc800003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 0x7fc8000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc800004d00 0x7fc800005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.787+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81015b520 con 0x7fc800004d00 2023-11-27T22:29:41.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80000ba30 con 0x7fc8000039a0 2023-11-27T22:29:41.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80000de00 con 0x7fc81015e730 2023-11-27T22:29:41.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81489c640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8000039a0 0x7fc800003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81509d640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc800004d00 0x7fc800005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc80ffff640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 0x7fc8000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81509d640 1 -- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 msgr2=0x7fc8000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81509d640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc81015e730 0x7fc8000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81509d640 1 -- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8000039a0 msgr2=0x7fc800003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81509d640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8000039a0 0x7fc800003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.788+0000 7fc81509d640 1 -- 172.21.15.154:0/434270693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800003520 con 0x7fc800004d00 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc81509d640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc800004d00 0x7fc800005180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc808009f90 tx=0x7fc8000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1824ef7be13a0843 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80802cbd0 con 0x7fc800004d00 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800f040 con 0x7fc800004d00 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc80f7fe640 1 -- 172.21.15.154:0/434270693 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808034440 con 0x7fc800004d00 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc816b00640 1 -- 172.21.15.154:0/434270693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc800004d00 msgr2=0x7fc800005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc816b00640 1 --2- 172.21.15.154:0/434270693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc800004d00 0x7fc800005180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc808009f90 tx=0x7fc8000057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc81509d640 1 -- 172.21.15.154:0/434270693 reap_dead start 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc816b00640 1 -- 172.21.15.154:0/434270693 shutdown_connections 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc816b00640 1 -- 172.21.15.154:0/434270693 >> 172.21.15.154:0/434270693 conn(0x7fc81006a4d0 msgr2=0x7fc81006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc816b00640 1 -- 172.21.15.154:0/434270693 shutdown_connections 2023-11-27T22:29:41.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.789+0000 7fc816b00640 1 -- 172.21.15.154:0/434270693 wait complete. 2023-11-27T22:29:41.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.790+0000 7fc816b00640 1 Processor -- start 2023-11-27T22:29:41.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 -- start start 2023-11-27T22:29:41.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc800004d00 0x7fc810159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc810142910 0x7fc8100ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 0x7fc8100c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100ae980 con 0x7fc8100ac9c0 2023-11-27T22:29:41.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100ad3a0 con 0x7fc810142910 2023-11-27T22:29:41.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc816b00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100ad680 con 0x7fc800004d00 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.791+0000 7fc81509d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 0x7fc8100c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 0x7fc8100c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56442/0 (socket says 172.21.15.154:56442) 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 -- 172.21.15.154:0/174496303 learned_addr learned my addr 172.21.15.154:0/174496303 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc80ffff640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc810142910 0x7fc8100ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81489c640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc800004d00 0x7fc810159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 -- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc800004d00 msgr2=0x7fc810159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc800004d00 0x7fc810159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 -- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc810142910 msgr2=0x7fc8100ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc810142910 0x7fc8100ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 -- 172.21.15.154:0/174496303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100ad960 con 0x7fc8100ac9c0 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc81509d640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 0x7fc8100c3fd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc808037040 tx=0x7fc808009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:41.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808034d50 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808003990 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8100adc40 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808003d20 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.792+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8100ace50 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.793+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8100b4380 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.794+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc808004030 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.794+0000 7fc80d7fa640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7f406b1c0 0x7fc7f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.794+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8080ab210 con 0x7fc8100ac9c0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.794+0000 7fc81489c640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7f406b1c0 0x7fc7f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.794+0000 7fc81489c640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7f406b1c0 0x7fc7f406d680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc804000c00 tx=0x7fc804009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:41.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:41.798+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc808076080 con 0x7fc8100ac9c0 2023-11-27T22:29:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.001+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8100ae160 con 0x7fc8100ac9c0 2023-11-27T22:29:42.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.002+0000 7fc80d7fa640 1 -- 172.21.15.154:0/174496303 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fc8100ae160 con 0x7fc8100ac9c0 2023-11-27T22:29:42.004 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:42.005 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:29:42.005 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7f406b1c0 msgr2=0x7fc7f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7f406b1c0 0x7fc7f406d680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc804000c00 tx=0x7fc804009040 comp rx=0 tx=0).stop 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 msgr2=0x7fc8100c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 0x7fc8100c3fd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc808037040 tx=0x7fc808009750 comp rx=0 tx=0).stop 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 shutdown_connections 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc810142910 0x7fc8100ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7f406b1c0 0x7fc7f406d680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8100ac9c0 0x7fc8100c3fd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 --2- 172.21.15.154:0/174496303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc800004d00 0x7fc810159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 >> 172.21.15.154:0/174496303 conn(0x7fc81006a4d0 msgr2=0x7fc8100ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 shutdown_connections 2023-11-27T22:29:42.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.004+0000 7fc816b00640 1 -- 172.21.15.154:0/174496303 wait complete. 2023-11-27T22:29:42.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:42.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.114+0000 7fb324505640 1 Processor -- start 2023-11-27T22:29:42.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.114+0000 7fb324505640 1 -- start start 2023-11-27T22:29:42.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb324505640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb31c15f760 0x7fb31c0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb324505640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0b3f10 con 0x7fb31c15b130 2023-11-27T22:29:42.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb324505640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0d0a50 con 0x7fb31c0cf320 2023-11-27T22:29:42.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb324505640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c15fd20 con 0x7fb31c15f760 2023-11-27T22:29:42.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb322aa2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb31c15f760 0x7fb31c0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb3222a1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb31c15b130 0x7fb31c0cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44340/0 (socket says 172.21.15.154:44340) 2023-11-27T22:29:42.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb322aa2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb31c15f760 0x7fb31c0d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56444/0 (socket says 172.21.15.154:56444) 2023-11-27T22:29:42.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.115+0000 7fb3222a1640 1 -- 172.21.15.154:0/3069664194 learned_addr learned my addr 172.21.15.154:0/3069664194 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:42.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb322aa2640 1 -- 172.21.15.154:0/3069664194 >> v1:172.21.15.194:6789/0 conn(0x7fb31c0cf320 legacy=0x7fb31c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb322aa2640 1 -- 172.21.15.154:0/3069664194 >> v1:172.21.15.154:6789/0 conn(0x7fb31c15b130 legacy=0x7fb31c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb322aa2640 1 -- 172.21.15.154:0/3069664194 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0d0d30 con 0x7fb31c15f760 2023-11-27T22:29:42.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb32129f640 1 -- 172.21.15.154:0/3069664194 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938741561 0 0) 0x7fb31c0b3f10 con 0x7fb31c15b130 2023-11-27T22:29:42.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb322aa2640 1 --2- 172.21.15.154:0/3069664194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c15f760 0x7fb31c0d01f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097a0 tx=0x7fb31402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb275f0b1f07dd86 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb32129f640 1 -- 172.21.15.154:0/3069664194 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314031830 con 0x7fb31c15f760 2023-11-27T22:29:42.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.116+0000 7fb32129f640 1 -- 172.21.15.154:0/3069664194 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314031990 con 0x7fb31c15f760 2023-11-27T22:29:42.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb32129f640 1 -- 172.21.15.154:0/3069664194 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314031d20 con 0x7fb31c15f760 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 -- 172.21.15.154:0/3069664194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c15f760 msgr2=0x7fb31c0d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 --2- 172.21.15.154:0/3069664194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c15f760 0x7fb31c0d01f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3140097a0 tx=0x7fb31402b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 -- 172.21.15.154:0/3069664194 shutdown_connections 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 --2- 172.21.15.154:0/3069664194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c15f760 0x7fb31c0d01f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 -- 172.21.15.154:0/3069664194 >> 172.21.15.154:0/3069664194 conn(0x7fb31c0b2c10 msgr2=0x7fb31c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 -- 172.21.15.154:0/3069664194 shutdown_connections 2023-11-27T22:29:42.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.117+0000 7fb324505640 1 -- 172.21.15.154:0/3069664194 wait complete. 2023-11-27T22:29:42.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.118+0000 7fb324505640 1 Processor -- start 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.118+0000 7fb324505640 1 -- start start 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb324505640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 0x7fb31c14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb324505640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb31c15b130 0x7fb31c0c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb324505640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb31c15f760 0x7fb31c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb324505640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c1f1270 con 0x7fb31c0cf320 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb324505640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0c56d0 con 0x7fb31c15f760 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb324505640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0c59b0 con 0x7fb31c15b130 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 0x7fb31c14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 0x7fb31c14c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56460/0 (socket says 172.21.15.154:56460) 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 -- 172.21.15.154:0/2300193400 learned_addr learned my addr 172.21.15.154:0/2300193400 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb322aa2640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb31c15f760 0x7fb31c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb321aa0640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb31c15b130 0x7fb31c0c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 -- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb31c15b130 msgr2=0x7fb31c0c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb31c15b130 0x7fb31c0c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 -- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb31c15f760 msgr2=0x7fb31c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb31c15f760 0x7fb31c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.119+0000 7fb3222a1640 1 -- 172.21.15.154:0/2300193400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314009400 con 0x7fb31c0cf320 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.120+0000 7fb3222a1640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 0x7fb31c14c240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c890 tx=0x7fb31800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.120+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800a640 con 0x7fb31c0cf320 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.120+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31800a7c0 con 0x7fb31c0cf320 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.120+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c0c5c90 con 0x7fb31c0cf320 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.120+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800ab70 con 0x7fb31c0cf320 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.120+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c0c6250 con 0x7fb31c0cf320 2023-11-27T22:29:42.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.121+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c067fc0 con 0x7fb31c0cf320 2023-11-27T22:29:42.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.121+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb31800acd0 con 0x7fb31c0cf320 2023-11-27T22:29:42.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.121+0000 7fb312ffd640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb30006b1c0 0x7fb30006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.122+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb318088e90 con 0x7fb31c0cf320 2023-11-27T22:29:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.122+0000 7fb321aa0640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb30006b1c0 0x7fb30006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.122+0000 7fb321aa0640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb30006b1c0 0x7fb30006d680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb31c14cb80 tx=0x7fb30c007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.126+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb318053c70 con 0x7fb31c0cf320 2023-11-27T22:29:42.296 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.294+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb31c067420 con 0x7fb31c0cf320 2023-11-27T22:29:42.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.295+0000 7fb312ffd640 1 -- 172.21.15.154:0/2300193400 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fb318018020 con 0x7fb31c0cf320 2023-11-27T22:29:42.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:42.298 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:42.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb30006b1c0 msgr2=0x7fb30006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb30006b1c0 0x7fb30006d680 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb31c14cb80 tx=0x7fb30c007e30 comp rx=0 tx=0).stop 2023-11-27T22:29:42.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 msgr2=0x7fb31c14c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 0x7fb31c14c240 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c890 tx=0x7fb31800cd50 comp rx=0 tx=0).stop 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 shutdown_connections 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb31c15f760 0x7fb31c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb30006b1c0 0x7fb30006d680 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb31c15b130 0x7fb31c0c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 --2- 172.21.15.154:0/2300193400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c0cf320 0x7fb31c14c240 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 >> 172.21.15.154:0/2300193400 conn(0x7fb31c0b2c10 msgr2=0x7fb31c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 shutdown_connections 2023-11-27T22:29:42.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.297+0000 7fb324505640 1 -- 172.21.15.154:0/2300193400 wait complete. 2023-11-27T22:29:42.311 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T22:29:42.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:42.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.410+0000 7fcfbb748640 1 Processor -- start 2023-11-27T22:29:42.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.410+0000 7fcfbb748640 1 -- start start 2023-11-27T22:29:42.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfbb748640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcfb4144a00 0x7fcfb406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfbb748640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40b2ef0 con 0x7fcfb4144440 2023-11-27T22:29:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfbb748640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb40b31d0 con 0x7fcfb41415f0 2023-11-27T22:29:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfbb748640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40b3b70 con 0x7fcfb4144a00 2023-11-27T22:29:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfb9ce5640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcfb4144440 0x7fcfb40b3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44350/0 (socket says 172.21.15.154:44350) 2023-11-27T22:29:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfb9ce5640 1 -- 172.21.15.154:0/3080264693 learned_addr learned my addr 172.21.15.154:0/3080264693 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfb8ce3640 1 --2- 172.21.15.154:0/3080264693 >> v2:172.21.15.194:3300/0 conn(0x7fcfb4144a00 0x7fcfb406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658319918 0 0) 0x7fcfb40b2ef0 con 0x7fcfb4144440 2023-11-27T22:29:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa0003520 con 0x7fcfb4144440 2023-11-27T22:29:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206350400 0 0) 0x7fcfa0003520 con 0x7fcfb4144440 2023-11-27T22:29:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 >> v2:172.21.15.194:3300/0 conn(0x7fcfb4144a00 msgr2=0x7fcfb406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 --2- 172.21.15.154:0/3080264693 >> v2:172.21.15.194:3300/0 conn(0x7fcfb4144a00 0x7fcfb406b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 >> v1:172.21.15.194:6789/0 conn(0x7fcfb41415f0 legacy=0x7fcfb4141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40b34b0 con 0x7fcfb4144440 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fcfac0019f0 con 0x7fcfb4144440 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 >> v1:172.21.15.154:6789/0 conn(0x7fcfb4144440 legacy=0x7fcfb40b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa0003970 0x7fcfa0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfa0004370 0x7fcfa0004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0005040 0x7fcfa000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40b3b70 con 0x7fcfa0003970 2023-11-27T22:29:42.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa000bfa0 con 0x7fcfa0005040 2023-11-27T22:29:42.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.411+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa000c160 con 0x7fcfa0004370 2023-11-27T22:29:42.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa0003970 0x7fcfa0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb9ce5640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0005040 0x7fcfa000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb8ce3640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfa0004370 0x7fcfa0004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 -- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfa0004370 msgr2=0x7fcfa0004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfa0004370 0x7fcfa0004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 -- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0005040 msgr2=0x7fcfa000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0005040 0x7fcfa000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 -- 172.21.15.154:0/3080264693 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0003520 con 0x7fcfa0003970 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb9ce5640 1 -- 172.21.15.154:0/3080264693 reap_dead start 2023-11-27T22:29:42.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.412+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa0003970 0x7fcfa0003d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0001860 tx=0x7fcfa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4c6166cfef5d98 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0033410 con 0x7fcfa0003970 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0033590 con 0x7fcfa0003970 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfabfff640 1 -- 172.21.15.154:0/3080264693 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0033940 con 0x7fcfa0003970 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 -- 172.21.15.154:0/3080264693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa0003970 msgr2=0x7fcfa0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa0003970 0x7fcfa0003d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0001860 tx=0x7fcfa00057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 -- 172.21.15.154:0/3080264693 shutdown_connections 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 --2- 172.21.15.154:0/3080264693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfa0003970 0x7fcfa0003d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 -- 172.21.15.154:0/3080264693 >> 172.21.15.154:0/3080264693 conn(0x7fcfb4070e70 msgr2=0x7fcfb4071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 -- 172.21.15.154:0/3080264693 shutdown_connections 2023-11-27T22:29:42.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.413+0000 7fcfbb748640 1 -- 172.21.15.154:0/3080264693 wait complete. 2023-11-27T22:29:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.414+0000 7fcfbb748640 1 Processor -- start 2023-11-27T22:29:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.414+0000 7fcfbb748640 1 -- start start 2023-11-27T22:29:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfbb748640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0003970 0x7fcfb4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfbb748640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfb4158650 0x7fcfb4136180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfbb748640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 0x7fcfb4159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfbb748640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4156270 con 0x7fcfb41596d0 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfbb748640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb415a090 con 0x7fcfa0003970 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfbb748640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41575b0 con 0x7fcfb4158650 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 0x7fcfb4159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 0x7fcfb4159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56476/0 (socket says 172.21.15.154:56476) 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 -- 172.21.15.154:0/1574075980 learned_addr learned my addr 172.21.15.154:0/1574075980 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0003970 0x7fcfb4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb8ce3640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfb4158650 0x7fcfb4136180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 -- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfb4158650 msgr2=0x7fcfb4136180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfb4158650 0x7fcfb4136180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 -- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0003970 msgr2=0x7fcfb4155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0003970 0x7fcfb4155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.415+0000 7fcfb9ce5640 1 -- 172.21.15.154:0/1574075980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4157890 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.416+0000 7fcfb9ce5640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 0x7fcfb4159b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4066490 tx=0x7fcfac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.416+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac007ae0 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.416+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00eda0 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.416+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb4157b70 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.416+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac013680 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.416+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb4158130 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.417+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb4158350 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.417+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcfac0137e0 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.417+0000 7fcfa9ffb640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcf9806b1c0 0x7fcf9806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.417+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfac089d20 con 0x7fcfb41596d0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.417+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcf9806b1c0 0x7fcf9806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.418+0000 7fcfb94e4640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcf9806b1c0 0x7fcf9806d680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0035000 tx=0x7fcfb0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.422+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcfac054a70 con 0x7fcfb41596d0 2023-11-27T22:29:42.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.585+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfb4141e00 con 0x7fcf9806b1c0 2023-11-27T22:29:42.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.592+0000 7fcfa9ffb640 1 -- 172.21.15.154:0/1574075980 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249835 (secure 0 0 0) 0x7fcfb0033410 con 0x7fcf9806b1c0 2023-11-27T22:29:42.607 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:42.608 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:42.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcf9806b1c0 msgr2=0x7fcf9806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcf9806b1c0 0x7fcf9806d680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0035000 tx=0x7fcfb0009030 comp rx=0 tx=0).stop 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 msgr2=0x7fcfb4159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 0x7fcfb4159b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4066490 tx=0x7fcfac00e530 comp rx=0 tx=0).stop 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 shutdown_connections 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcf9806b1c0 0x7fcf9806d680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb41596d0 0x7fcfb4159b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfb4158650 0x7fcfb4136180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 --2- 172.21.15.154:0/1574075980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfa0003970 0x7fcfb4155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 >> 172.21.15.154:0/1574075980 conn(0x7fcfb4070e70 msgr2=0x7fcfb4071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 shutdown_connections 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.595+0000 7fcfbb748640 1 -- 172.21.15.154:0/1574075980 wait complete. 2023-11-27T22:29:42.611 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-27T22:29:40.961779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218556,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000663"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-27T22:29:30.164617+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:30.164617+0000","last_peered":"2023-11-27T22:29:30.164617+0000","last_clean":"2023-11-27T22:29:30.164617+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:30.164617+0000","last_undegraded":"2023-11-27T22:29:30.164617+0000","last_fullsized":"2023-11-27T22:29:30.164617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:42.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:42.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.716+0000 7f6f139ec640 1 Processor -- start 2023-11-27T22:29:42.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.716+0000 7f6f139ec640 1 -- start start 2023-11-27T22:29:42.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f139ec640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6f0c06bbf0 0x7f6f0c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f139ec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0adae0 con 0x7f6f0c0ad640 2023-11-27T22:29:42.722 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f139ec640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0addc0 con 0x7f6f0c15d1d0 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f139ec640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0c0ae0a0 con 0x7f6f0c06bbf0 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f10f87640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6f0c0ad640 0x7f6f0c06d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44354/0 (socket says 172.21.15.154:44354) 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f10f87640 1 -- 172.21.15.154:0/2338540567 learned_addr learned my addr 172.21.15.154:0/2338540567 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f11f89640 1 --2- 172.21.15.154:0/2338540567 >> v2:172.21.15.194:3300/0 conn(0x7f6f0c06bbf0 0x7f6f0c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357166353 0 0) 0x7f6f0c0adae0 con 0x7f6f0c0ad640 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef8003520 con 0x7f6f0c0ad640 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661554866 0 0) 0x7f6f0c0addc0 con 0x7f6f0c15d1d0 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c0adae0 con 0x7f6f0c15d1d0 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1243442258 0 0) 0x7f6ef8003520 con 0x7f6f0c0ad640 2023-11-27T22:29:42.723 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 >> v2:172.21.15.194:3300/0 conn(0x7f6f0c06bbf0 msgr2=0x7f6f0c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 --2- 172.21.15.154:0/2338540567 >> v2:172.21.15.194:3300/0 conn(0x7f6f0c06bbf0 0x7f6f0c06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 >> v1:172.21.15.194:6789/0 conn(0x7f6f0c15d1d0 legacy=0x7f6f0c06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0ae380 con 0x7f6f0c0ad640 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f11f89640 1 --2- 172.21.15.154:0/2338540567 >> v2:172.21.15.194:3300/0 conn(0x7f6f0c06bbf0 0x7f6f0c06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f6efc001670 con 0x7f6f0c0ad640 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 >> v1:172.21.15.154:6789/0 conn(0x7f6f0c0ad640 legacy=0x7f6f0c06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8003b00 0x7f6ef8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ef80047c0 0x7f6ef8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef8005180 0x7f6ef800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0ae0a0 con 0x7f6ef8005180 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef800c000 con 0x7f6ef8003b00 2023-11-27T22:29:42.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.717+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef800c1c0 con 0x7f6ef80047c0 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef8005180 0x7f6ef800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11788640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8003b00 0x7f6ef8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f10f87640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ef80047c0 0x7f6ef8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 -- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ef80047c0 msgr2=0x7f6ef8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ef80047c0 0x7f6ef8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 -- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8003b00 msgr2=0x7f6ef8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8003b00 0x7f6ef8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 -- 172.21.15.154:0/2338540567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8003520 con 0x7f6ef8005180 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 -- 172.21.15.154:0/2338540567 reap_dead start 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.718+0000 7f6f11f89640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef8005180 0x7f6ef800b980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e350 tx=0x7f6ef80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76253d00b4fce6b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0402ce00 con 0x7f6ef8005180 2023-11-27T22:29:42.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0400f040 con 0x7f6ef8005180 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f03fff640 1 -- 172.21.15.154:0/2338540567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04003bd0 con 0x7f6ef8005180 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 -- 172.21.15.154:0/2338540567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef8005180 msgr2=0x7f6ef800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef8005180 0x7f6ef800b980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e350 tx=0x7f6ef80057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 -- 172.21.15.154:0/2338540567 shutdown_connections 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 --2- 172.21.15.154:0/2338540567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ef8005180 0x7f6ef800b980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 -- 172.21.15.154:0/2338540567 >> 172.21.15.154:0/2338540567 conn(0x7f6f0c070e70 msgr2=0x7f6f0c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 -- 172.21.15.154:0/2338540567 shutdown_connections 2023-11-27T22:29:42.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.719+0000 7f6f139ec640 1 -- 172.21.15.154:0/2338540567 wait complete. 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.720+0000 7f6f139ec640 1 Processor -- start 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.720+0000 7f6f139ec640 1 -- start start 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f139ec640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8005180 0x7f6f0c1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f139ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f0c1f69c0 0x7f6f0c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f139ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 0x7f6f0c1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f139ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c1f29a0 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f139ec640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c0cf380 con 0x7f6ef8005180 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f139ec640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c145ad0 con 0x7f6f0c1f69c0 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 0x7f6f0c1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 0x7f6f0c1f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56502/0 (socket says 172.21.15.154:56502) 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 -- 172.21.15.154:0/606733160 learned_addr learned my addr 172.21.15.154:0/606733160 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f10f87640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f0c1f69c0 0x7f6f0c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11788640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8005180 0x7f6f0c1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 -- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f0c1f69c0 msgr2=0x7f6f0c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f0c1f69c0 0x7f6f0c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 -- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8005180 msgr2=0x7f6f0c1465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8005180 0x7f6f0c1465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11f89640 1 -- 172.21.15.154:0/606733160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c145db0 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.721+0000 7f6f11788640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8005180 0x7f6f0c1465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.722+0000 7f6f11f89640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 0x7f6f0c1f2460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f0402c870 tx=0x7f6f04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.722+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04044070 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.722+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0402cc00 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.722+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c146090 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.722+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f04003bd0 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.722+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c0cf660 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.723+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c146280 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.723+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6f0403e420 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.724+0000 7f6f01ffb640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ef006b1f0 0x7f6ef006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.724+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f040abdf0 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.724+0000 7f6f11788640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ef006b1f0 0x7f6ef006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.724+0000 7f6f11788640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ef006b1f0 0x7f6ef006d6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:42.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.728+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6f04076c20 con 0x7f6f0c1f1fe0 2023-11-27T22:29:42.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.891+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f0c0aeb80 con 0x7f6ef006b1f0 2023-11-27T22:29:42.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.897+0000 7f6f01ffb640 1 -- 172.21.15.154:0/606733160 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249835 (secure 0 0 0) 0x7f6f080014f0 con 0x7f6ef006b1f0 2023-11-27T22:29:42.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:42.904 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ef006b1f0 msgr2=0x7f6ef006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ef006b1f0 0x7f6ef006d6b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6f08000c00 tx=0x7f6f08009040 comp rx=0 tx=0).stop 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 msgr2=0x7f6f0c1f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 0x7f6f0c1f2460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f0402c870 tx=0x7f6f04009750 comp rx=0 tx=0).stop 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 shutdown_connections 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ef006b1f0 0x7f6ef006d6b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f0c1f1fe0 0x7f6f0c1f2460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f0c1f69c0 0x7f6f0c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 --2- 172.21.15.154:0/606733160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ef8005180 0x7f6f0c1465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 >> 172.21.15.154:0/606733160 conn(0x7f6f0c070e70 msgr2=0x7f6f0c0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 shutdown_connections 2023-11-27T22:29:42.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:42.900+0000 7f6f139ec640 1 -- 172.21.15.154:0/606733160 wait complete. 2023-11-27T22:29:42.914 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-27T22:29:40.961779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218556,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756164,"statfs":{"total":773094113280,"available":772870311936,"internally_reserved":0,"allocated":2433024,"data_stored":1546680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000663"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-27T22:29:30.164617+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:30.164617+0000","last_peered":"2023-11-27T22:29:30.164617+0000","last_clean":"2023-11-27T22:29:30.164617+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:30.164617+0000","last_undegraded":"2023-11-27T22:29:30.164617+0000","last_fullsized":"2023-11-27T22:29:30.164617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:38.638775+0000","last_change":"2023-11-27T22:29:38.638775+0000","last_active":"2023-11-27T22:29:38.638775+0000","last_peered":"2023-11-27T22:29:38.638775+0000","last_clean":"2023-11-27T22:29:38.638775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:38.638775+0000","last_undegraded":"2023-11-27T22:29:38.638775+0000","last_fullsized":"2023-11-27T22:29:38.638775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:29:37.633928+0000","last_change":"2023-11-27T22:29:37.633928+0000","last_active":"2023-11-27T22:29:37.633928+0000","last_peered":"2023-11-27T22:29:37.633928+0000","last_clean":"2023-11-27T22:29:37.633928+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:29:37.633928+0000","last_undegraded":"2023-11-27T22:29:37.633928+0000","last_fullsized":"2023-11-27T22:29:37.633928+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:42.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.051+0000 7f5790b05640 1 Processor -- start 2023-11-27T22:29:43.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.051+0000 7f5790b05640 1 -- start start 2023-11-27T22:29:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5790b05640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c0b5370 0x7f578c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5790b05640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f578c0d2040 0x7f578c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5790b05640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0ce4c0 con 0x7f578c15d2d0 2023-11-27T22:29:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5790b05640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0d1bb0 con 0x7f578c0d2040 2023-11-27T22:29:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5790b05640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c15d6b0 con 0x7f578c0b5370 2023-11-27T22:29:43.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f578ad9d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f578c0d2040 0x7f578c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5783fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c0b5370 0x7f578c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f578a59c640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f578c15d2d0 0x7f578c0b4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:46896/0 (socket says 172.21.15.154:46896) 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f578a59c640 1 -- 172.21.15.154:0/602449977 learned_addr learned my addr 172.21.15.154:0/602449977 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5783fff640 1 -- 172.21.15.154:0/602449977 >> v2:172.21.15.194:3300/0 conn(0x7f578c0d2040 msgr2=0x7f578c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5783fff640 1 --2- 172.21.15.154:0/602449977 >> v2:172.21.15.194:3300/0 conn(0x7f578c0d2040 0x7f578c0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5783fff640 1 -- 172.21.15.154:0/602449977 >> v1:172.21.15.194:6789/0 conn(0x7f578c15d2d0 legacy=0x7f578c0b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.052+0000 7f5783fff640 1 -- 172.21.15.154:0/602449977 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0ce700 con 0x7f578c0b5370 2023-11-27T22:29:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.053+0000 7f5783fff640 1 --2- 172.21.15.154:0/602449977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c0b5370 0x7f578c0cda40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f57740097a0 tx=0x7f577402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a2712cace0ceee server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.053+0000 7f5789d9b640 1 -- 172.21.15.154:0/602449977 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774031830 con 0x7f578c0b5370 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.053+0000 7f5789d9b640 1 -- 172.21.15.154:0/602449977 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774031990 con 0x7f578c0b5370 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.053+0000 7f5789d9b640 1 -- 172.21.15.154:0/602449977 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774031d20 con 0x7f578c0b5370 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 -- 172.21.15.154:0/602449977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c0b5370 msgr2=0x7f578c0cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 --2- 172.21.15.154:0/602449977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c0b5370 0x7f578c0cda40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f57740097a0 tx=0x7f577402b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 -- 172.21.15.154:0/602449977 shutdown_connections 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 --2- 172.21.15.154:0/602449977 >> v2:172.21.15.194:3300/0 conn(0x7f578c0d2040 0x7f578c0cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 --2- 172.21.15.154:0/602449977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c0b5370 0x7f578c0cda40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 -- 172.21.15.154:0/602449977 >> 172.21.15.154:0/602449977 conn(0x7f578c072050 msgr2=0x7f578c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 -- 172.21.15.154:0/602449977 shutdown_connections 2023-11-27T22:29:43.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.054+0000 7f5790b05640 1 -- 172.21.15.154:0/602449977 wait complete. 2023-11-27T22:29:43.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.055+0000 7f5790b05640 1 Processor -- start 2023-11-27T22:29:43.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.055+0000 7f5790b05640 1 -- start start 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 0x7f578c0c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f578c0d2040 0x7f578c1e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c15d2d0 0x7f578c14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0c7540 con 0x7f578c0b5370 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0c7820 con 0x7f578c0d2040 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0c7b00 con 0x7f578c15d2d0 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 0x7f578c0c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 0x7f578c0c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56514/0 (socket says 172.21.15.154:56514) 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 -- 172.21.15.154:0/380163572 learned_addr learned my addr 172.21.15.154:0/380163572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578ad9d640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c15d2d0 0x7f578c14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5783fff640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f578c0d2040 0x7f578c1e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 -- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c15d2d0 msgr2=0x7f578c14a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c15d2d0 0x7f578c14a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 -- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f578c0d2040 msgr2=0x7f578c1e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f578c0d2040 0x7f578c1e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 -- 172.21.15.154:0/380163572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774009400 con 0x7f578c0b5370 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578ad9d640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c15d2d0 0x7f578c14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5783fff640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f578c0d2040 0x7f578c1e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:43.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f578a59c640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 0x7f578c0c6cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c480 tx=0x7f577c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c005ce0 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c005e40 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c0c7de0 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.056+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0072f0 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.057+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c0c7230 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.057+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c069400 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.058+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f577c007510 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.058+0000 7f5782ffd640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f576c06b1c0 0x7f576c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.058+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f577c088cb0 con 0x7f578c0b5370 2023-11-27T22:29:43.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.058+0000 7f5783fff640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f576c06b1c0 0x7f576c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.059+0000 7f5783fff640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f576c06b1c0 0x7f576c06d680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5774036000 tx=0x7f577403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.063+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f577c053b20 con 0x7f578c0b5370 2023-11-27T22:29:43.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.226+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f578c0d1840 con 0x7f576c06b1c0 2023-11-27T22:29:43.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.232+0000 7f5782ffd640 1 -- 172.21.15.154:0/380163572 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264629 (secure 0 0 0) 0x7f5774045410 con 0x7f576c06b1c0 2023-11-27T22:29:43.238 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:43.239 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f576c06b1c0 msgr2=0x7f576c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f576c06b1c0 0x7f576c06d680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5774036000 tx=0x7f577403c040 comp rx=0 tx=0).stop 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 msgr2=0x7f578c0c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 0x7f578c0c6cf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f577c00c480 tx=0x7f577c00c940 comp rx=0 tx=0).stop 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 shutdown_connections 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f578c0d2040 0x7f578c1e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f576c06b1c0 0x7f576c06d680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f578c15d2d0 0x7f578c14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 --2- 172.21.15.154:0/380163572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f578c0b5370 0x7f578c0c6cf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.235+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 >> 172.21.15.154:0/380163572 conn(0x7f578c072050 msgr2=0x7f578c0d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.236+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 shutdown_connections 2023-11-27T22:29:43.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.236+0000 7f5790b05640 1 -- 172.21.15.154:0/380163572 wait complete. 2023-11-27T22:29:43.249 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-27T22:29:42.962109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218888,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755832,"statfs":{"total":773094113280,"available":772869971968,"internally_reserved":0,"allocated":2793472,"data_stored":1702436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.322911"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.661119+0000","last_change":"2023-11-27T22:29:39.657258+0000","last_active":"2023-11-27T22:29:39.661119+0000","last_peered":"2023-11-27T22:29:39.661119+0000","last_clean":"2023-11-27T22:29:39.661119+0000","last_became_active":"2023-11-27T22:29:39.656994+0000","last_became_peered":"2023-11-27T22:29:39.656994+0000","last_unstale":"2023-11-27T22:29:39.661119+0000","last_undegraded":"2023-11-27T22:29:39.661119+0000","last_fullsized":"2023-11-27T22:29:39.661119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638662+0000","last_change":"2023-11-27T22:29:39.646837+0000","last_active":"2023-11-27T22:29:40.638662+0000","last_peered":"2023-11-27T22:29:40.638662+0000","last_clean":"2023-11-27T22:29:40.638662+0000","last_became_active":"2023-11-27T22:29:39.645981+0000","last_became_peered":"2023-11-27T22:29:39.645981+0000","last_unstale":"2023-11-27T22:29:40.638662+0000","last_undegraded":"2023-11-27T22:29:40.638662+0000","last_fullsized":"2023-11-27T22:29:40.638662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649839+0000","last_change":"2023-11-27T22:29:39.643286+0000","last_active":"2023-11-27T22:29:39.649839+0000","last_peered":"2023-11-27T22:29:39.649839+0000","last_clean":"2023-11-27T22:29:39.649839+0000","last_became_active":"2023-11-27T22:29:39.642812+0000","last_became_peered":"2023-11-27T22:29:39.642812+0000","last_unstale":"2023-11-27T22:29:39.649839+0000","last_undegraded":"2023-11-27T22:29:39.649839+0000","last_fullsized":"2023-11-27T22:29:39.649839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:27.497209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656607+0000","last_change":"2023-11-27T22:29:39.649850+0000","last_active":"2023-11-27T22:29:39.656607+0000","last_peered":"2023-11-27T22:29:39.656607+0000","last_clean":"2023-11-27T22:29:39.656607+0000","last_became_active":"2023-11-27T22:29:39.649553+0000","last_became_peered":"2023-11-27T22:29:39.649553+0000","last_unstale":"2023-11-27T22:29:39.656607+0000","last_undegraded":"2023-11-27T22:29:39.656607+0000","last_fullsized":"2023-11-27T22:29:39.656607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:48.631646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658302+0000","last_change":"2023-11-27T22:29:39.653809+0000","last_active":"2023-11-27T22:29:39.658302+0000","last_peered":"2023-11-27T22:29:39.658302+0000","last_clean":"2023-11-27T22:29:39.658302+0000","last_became_active":"2023-11-27T22:29:39.653442+0000","last_became_peered":"2023-11-27T22:29:39.653442+0000","last_unstale":"2023-11-27T22:29:39.658302+0000","last_undegraded":"2023-11-27T22:29:39.658302+0000","last_fullsized":"2023-11-27T22:29:39.658302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:19.641397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.657293+0000","last_change":"2023-11-27T22:29:39.650707+0000","last_active":"2023-11-27T22:29:39.657293+0000","last_peered":"2023-11-27T22:29:39.657293+0000","last_clean":"2023-11-27T22:29:39.657293+0000","last_became_active":"2023-11-27T22:29:39.649995+0000","last_became_peered":"2023-11-27T22:29:39.649995+0000","last_unstale":"2023-11-27T22:29:39.657293+0000","last_undegraded":"2023-11-27T22:29:39.657293+0000","last_fullsized":"2023-11-27T22:29:39.657293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658351+0000","last_change":"2023-11-27T22:29:39.654105+0000","last_active":"2023-11-27T22:29:39.658351+0000","last_peered":"2023-11-27T22:29:39.658351+0000","last_clean":"2023-11-27T22:29:39.658351+0000","last_became_active":"2023-11-27T22:29:39.653603+0000","last_became_peered":"2023-11-27T22:29:39.653603+0000","last_unstale":"2023-11-27T22:29:39.658351+0000","last_undegraded":"2023-11-27T22:29:39.658351+0000","last_fullsized":"2023-11-27T22:29:39.658351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637398+0000","last_change":"2023-11-27T22:29:39.654077+0000","last_active":"2023-11-27T22:29:40.637398+0000","last_peered":"2023-11-27T22:29:40.637398+0000","last_clean":"2023-11-27T22:29:40.637398+0000","last_became_active":"2023-11-27T22:29:39.653518+0000","last_became_peered":"2023-11-27T22:29:39.653518+0000","last_unstale":"2023-11-27T22:29:40.637398+0000","last_undegraded":"2023-11-27T22:29:40.637398+0000","last_fullsized":"2023-11-27T22:29:40.637398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.661137+0000","last_change":"2023-11-27T22:29:39.657910+0000","last_active":"2023-11-27T22:29:39.661137+0000","last_peered":"2023-11-27T22:29:39.661137+0000","last_clean":"2023-11-27T22:29:39.661137+0000","last_became_active":"2023-11-27T22:29:39.657639+0000","last_became_peered":"2023-11-27T22:29:39.657639+0000","last_unstale":"2023-11-27T22:29:39.661137+0000","last_undegraded":"2023-11-27T22:29:39.661137+0000","last_fullsized":"2023-11-27T22:29:39.661137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637203+0000","last_change":"2023-11-27T22:29:39.645292+0000","last_active":"2023-11-27T22:29:40.637203+0000","last_peered":"2023-11-27T22:29:40.637203+0000","last_clean":"2023-11-27T22:29:40.637203+0000","last_became_active":"2023-11-27T22:29:39.645012+0000","last_became_peered":"2023-11-27T22:29:39.645012+0000","last_unstale":"2023-11-27T22:29:40.637203+0000","last_undegraded":"2023-11-27T22:29:40.637203+0000","last_fullsized":"2023-11-27T22:29:40.637203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637000+0000","last_change":"2023-11-27T22:29:39.645072+0000","last_active":"2023-11-27T22:29:40.637000+0000","last_peered":"2023-11-27T22:29:40.637000+0000","last_clean":"2023-11-27T22:29:40.637000+0000","last_became_active":"2023-11-27T22:29:39.644771+0000","last_became_peered":"2023-11-27T22:29:39.644771+0000","last_unstale":"2023-11-27T22:29:40.637000+0000","last_undegraded":"2023-11-27T22:29:40.637000+0000","last_fullsized":"2023-11-27T22:29:40.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652523+0000","last_change":"2023-11-27T22:29:39.644172+0000","last_active":"2023-11-27T22:29:39.652523+0000","last_peered":"2023-11-27T22:29:39.652523+0000","last_clean":"2023-11-27T22:29:39.652523+0000","last_became_active":"2023-11-27T22:29:39.643298+0000","last_became_peered":"2023-11-27T22:29:39.643298+0000","last_unstale":"2023-11-27T22:29:39.652523+0000","last_undegraded":"2023-11-27T22:29:39.652523+0000","last_fullsized":"2023-11-27T22:29:39.652523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:59.672839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637594+0000","last_change":"2023-11-27T22:29:39.657540+0000","last_active":"2023-11-27T22:29:40.637594+0000","last_peered":"2023-11-27T22:29:40.637594+0000","last_clean":"2023-11-27T22:29:40.637594+0000","last_became_active":"2023-11-27T22:29:39.657283+0000","last_became_peered":"2023-11-27T22:29:39.657283+0000","last_unstale":"2023-11-27T22:29:40.637594+0000","last_undegraded":"2023-11-27T22:29:40.637594+0000","last_fullsized":"2023-11-27T22:29:40.637594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649887+0000","last_change":"2023-11-27T22:29:39.646882+0000","last_active":"2023-11-27T22:29:39.649887+0000","last_peered":"2023-11-27T22:29:39.649887+0000","last_clean":"2023-11-27T22:29:39.649887+0000","last_became_active":"2023-11-27T22:29:39.646580+0000","last_became_peered":"2023-11-27T22:29:39.646580+0000","last_unstale":"2023-11-27T22:29:39.649887+0000","last_undegraded":"2023-11-27T22:29:39.649887+0000","last_fullsized":"2023-11-27T22:29:39.649887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:22.343131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638442+0000","last_change":"2023-11-27T22:29:39.645413+0000","last_active":"2023-11-27T22:29:40.638442+0000","last_peered":"2023-11-27T22:29:40.638442+0000","last_clean":"2023-11-27T22:29:40.638442+0000","last_became_active":"2023-11-27T22:29:39.645150+0000","last_became_peered":"2023-11-27T22:29:39.645150+0000","last_unstale":"2023-11-27T22:29:40.638442+0000","last_undegraded":"2023-11-27T22:29:40.638442+0000","last_fullsized":"2023-11-27T22:29:40.638442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656759+0000","last_change":"2023-11-27T22:29:39.650165+0000","last_active":"2023-11-27T22:29:39.656759+0000","last_peered":"2023-11-27T22:29:39.656759+0000","last_clean":"2023-11-27T22:29:39.656759+0000","last_became_active":"2023-11-27T22:29:39.649783+0000","last_became_peered":"2023-11-27T22:29:39.649783+0000","last_unstale":"2023-11-27T22:29:39.656759+0000","last_undegraded":"2023-11-27T22:29:39.656759+0000","last_fullsized":"2023-11-27T22:29:39.656759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658233+0000","last_change":"2023-11-27T22:29:39.654571+0000","last_active":"2023-11-27T22:29:39.658233+0000","last_peered":"2023-11-27T22:29:39.658233+0000","last_clean":"2023-11-27T22:29:39.658233+0000","last_became_active":"2023-11-27T22:29:39.654278+0000","last_became_peered":"2023-11-27T22:29:39.654278+0000","last_unstale":"2023-11-27T22:29:39.658233+0000","last_undegraded":"2023-11-27T22:29:39.658233+0000","last_fullsized":"2023-11-27T22:29:39.658233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:37.746015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765150+0000","last_change":"2023-11-27T22:29:39.648168+0000","last_active":"2023-11-27T22:29:40.765150+0000","last_peered":"2023-11-27T22:29:40.765150+0000","last_clean":"2023-11-27T22:29:40.765150+0000","last_became_active":"2023-11-27T22:29:39.647900+0000","last_became_peered":"2023-11-27T22:29:39.647900+0000","last_unstale":"2023-11-27T22:29:40.765150+0000","last_undegraded":"2023-11-27T22:29:40.765150+0000","last_fullsized":"2023-11-27T22:29:40.765150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.660999+0000","last_change":"2023-11-27T22:29:39.655501+0000","last_active":"2023-11-27T22:29:39.660999+0000","last_peered":"2023-11-27T22:29:39.660999+0000","last_clean":"2023-11-27T22:29:39.660999+0000","last_became_active":"2023-11-27T22:29:39.655220+0000","last_became_peered":"2023-11-27T22:29:39.655220+0000","last_unstale":"2023-11-27T22:29:39.660999+0000","last_undegraded":"2023-11-27T22:29:39.660999+0000","last_fullsized":"2023-11-27T22:29:39.660999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636971+0000","last_change":"2023-11-27T22:29:39.645941+0000","last_active":"2023-11-27T22:29:40.636971+0000","last_peered":"2023-11-27T22:29:40.636971+0000","last_clean":"2023-11-27T22:29:40.636971+0000","last_became_active":"2023-11-27T22:29:39.645663+0000","last_became_peered":"2023-11-27T22:29:39.645663+0000","last_unstale":"2023-11-27T22:29:40.636971+0000","last_undegraded":"2023-11-27T22:29:40.636971+0000","last_fullsized":"2023-11-27T22:29:40.636971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656950+0000","last_change":"2023-11-27T22:29:39.655808+0000","last_active":"2023-11-27T22:29:39.656950+0000","last_peered":"2023-11-27T22:29:39.656950+0000","last_clean":"2023-11-27T22:29:39.656950+0000","last_became_active":"2023-11-27T22:29:39.655505+0000","last_became_peered":"2023-11-27T22:29:39.655505+0000","last_unstale":"2023-11-27T22:29:39.656950+0000","last_undegraded":"2023-11-27T22:29:39.656950+0000","last_fullsized":"2023-11-27T22:29:39.656950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658048+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:39.658048+0000","last_peered":"2023-11-27T22:29:39.658048+0000","last_clean":"2023-11-27T22:29:39.658048+0000","last_became_active":"2023-11-27T22:29:39.654007+0000","last_became_peered":"2023-11-27T22:29:39.654007+0000","last_unstale":"2023-11-27T22:29:39.658048+0000","last_undegraded":"2023-11-27T22:29:39.658048+0000","last_fullsized":"2023-11-27T22:29:39.658048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:52.858990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637799+0000","last_change":"2023-11-27T22:29:39.648110+0000","last_active":"2023-11-27T22:29:40.637799+0000","last_peered":"2023-11-27T22:29:40.637799+0000","last_clean":"2023-11-27T22:29:40.637799+0000","last_became_active":"2023-11-27T22:29:39.647846+0000","last_became_peered":"2023-11-27T22:29:39.647846+0000","last_unstale":"2023-11-27T22:29:40.637799+0000","last_undegraded":"2023-11-27T22:29:40.637799+0000","last_fullsized":"2023-11-27T22:29:40.637799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656622+0000","last_change":"2023-11-27T22:29:39.649954+0000","last_active":"2023-11-27T22:29:39.656622+0000","last_peered":"2023-11-27T22:29:39.656622+0000","last_clean":"2023-11-27T22:29:39.656622+0000","last_became_active":"2023-11-27T22:29:39.649652+0000","last_became_peered":"2023-11-27T22:29:39.649652+0000","last_unstale":"2023-11-27T22:29:39.656622+0000","last_undegraded":"2023-11-27T22:29:39.656622+0000","last_fullsized":"2023-11-27T22:29:39.656622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:19.641397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637719+0000","last_change":"2023-11-27T22:29:39.649200+0000","last_active":"2023-11-27T22:29:40.637719+0000","last_peered":"2023-11-27T22:29:40.637719+0000","last_clean":"2023-11-27T22:29:40.637719+0000","last_became_active":"2023-11-27T22:29:39.648825+0000","last_became_peered":"2023-11-27T22:29:39.648825+0000","last_unstale":"2023-11-27T22:29:40.637719+0000","last_undegraded":"2023-11-27T22:29:40.637719+0000","last_fullsized":"2023-11-27T22:29:40.637719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637255+0000","last_change":"2023-11-27T22:29:39.654267+0000","last_active":"2023-11-27T22:29:40.637255+0000","last_peered":"2023-11-27T22:29:40.637255+0000","last_clean":"2023-11-27T22:29:40.637255+0000","last_became_active":"2023-11-27T22:29:39.654008+0000","last_became_peered":"2023-11-27T22:29:39.654008+0000","last_unstale":"2023-11-27T22:29:40.637255+0000","last_undegraded":"2023-11-27T22:29:40.637255+0000","last_fullsized":"2023-11-27T22:29:40.637255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638583+0000","last_change":"2023-11-27T22:29:39.647097+0000","last_active":"2023-11-27T22:29:40.638583+0000","last_peered":"2023-11-27T22:29:40.638583+0000","last_clean":"2023-11-27T22:29:40.638583+0000","last_became_active":"2023-11-27T22:29:39.646828+0000","last_became_peered":"2023-11-27T22:29:39.646828+0000","last_unstale":"2023-11-27T22:29:40.638583+0000","last_undegraded":"2023-11-27T22:29:40.638583+0000","last_fullsized":"2023-11-27T22:29:40.638583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637906+0000","last_change":"2023-11-27T22:29:39.653574+0000","last_active":"2023-11-27T22:29:40.637906+0000","last_peered":"2023-11-27T22:29:40.637906+0000","last_clean":"2023-11-27T22:29:40.637906+0000","last_became_active":"2023-11-27T22:29:39.653270+0000","last_became_peered":"2023-11-27T22:29:39.653270+0000","last_unstale":"2023-11-27T22:29:40.637906+0000","last_undegraded":"2023-11-27T22:29:40.637906+0000","last_fullsized":"2023-11-27T22:29:40.637906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.651067+0000","last_change":"2023-11-27T22:29:39.648704+0000","last_active":"2023-11-27T22:29:39.651067+0000","last_peered":"2023-11-27T22:29:39.651067+0000","last_clean":"2023-11-27T22:29:39.651067+0000","last_became_active":"2023-11-27T22:29:39.648254+0000","last_became_peered":"2023-11-27T22:29:39.648254+0000","last_unstale":"2023-11-27T22:29:39.651067+0000","last_undegraded":"2023-11-27T22:29:39.651067+0000","last_fullsized":"2023-11-27T22:29:39.651067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656418+0000","last_change":"2023-11-27T22:29:39.648662+0000","last_active":"2023-11-27T22:29:39.656418+0000","last_peered":"2023-11-27T22:29:39.656418+0000","last_clean":"2023-11-27T22:29:39.656418+0000","last_became_active":"2023-11-27T22:29:39.647607+0000","last_became_peered":"2023-11-27T22:29:39.647607+0000","last_unstale":"2023-11-27T22:29:39.656418+0000","last_undegraded":"2023-11-27T22:29:39.656418+0000","last_fullsized":"2023-11-27T22:29:39.656418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:40.311650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765029+0000","last_change":"2023-11-27T22:29:39.646354+0000","last_active":"2023-11-27T22:29:40.765029+0000","last_peered":"2023-11-27T22:29:40.765029+0000","last_clean":"2023-11-27T22:29:40.765029+0000","last_became_active":"2023-11-27T22:29:39.646090+0000","last_became_peered":"2023-11-27T22:29:39.646090+0000","last_unstale":"2023-11-27T22:29:40.765029+0000","last_undegraded":"2023-11-27T22:29:40.765029+0000","last_fullsized":"2023-11-27T22:29:40.765029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636897+0000","last_change":"2023-11-27T22:29:39.649555+0000","last_active":"2023-11-27T22:29:40.636897+0000","last_peered":"2023-11-27T22:29:40.636897+0000","last_clean":"2023-11-27T22:29:40.636897+0000","last_became_active":"2023-11-27T22:29:39.649055+0000","last_became_peered":"2023-11-27T22:29:39.649055+0000","last_unstale":"2023-11-27T22:29:40.636897+0000","last_undegraded":"2023-11-27T22:29:40.636897+0000","last_fullsized":"2023-11-27T22:29:40.636897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658807+0000","last_change":"2023-11-27T22:29:39.651646+0000","last_active":"2023-11-27T22:29:39.658807+0000","last_peered":"2023-11-27T22:29:39.658807+0000","last_clean":"2023-11-27T22:29:39.658807+0000","last_became_active":"2023-11-27T22:29:39.651358+0000","last_became_peered":"2023-11-27T22:29:39.651358+0000","last_unstale":"2023-11-27T22:29:39.658807+0000","last_undegraded":"2023-11-27T22:29:39.658807+0000","last_fullsized":"2023-11-27T22:29:39.658807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:40.311650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637683+0000","last_change":"2023-11-27T22:29:38.663887+0000","last_active":"2023-11-27T22:29:40.637683+0000","last_peered":"2023-11-27T22:29:40.637683+0000","last_clean":"2023-11-27T22:29:40.637683+0000","last_became_active":"2023-11-27T22:29:38.662995+0000","last_became_peered":"2023-11-27T22:29:38.662995+0000","last_unstale":"2023-11-27T22:29:40.637683+0000","last_undegraded":"2023-11-27T22:29:40.637683+0000","last_fullsized":"2023-11-27T22:29:40.637683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649912+0000","last_change":"2023-11-27T22:29:39.644876+0000","last_active":"2023-11-27T22:29:39.649912+0000","last_peered":"2023-11-27T22:29:39.649912+0000","last_clean":"2023-11-27T22:29:39.649912+0000","last_became_active":"2023-11-27T22:29:39.644470+0000","last_became_peered":"2023-11-27T22:29:39.644470+0000","last_unstale":"2023-11-27T22:29:39.649912+0000","last_undegraded":"2023-11-27T22:29:39.649912+0000","last_fullsized":"2023-11-27T22:29:39.649912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:50:16.238678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636788+0000","last_change":"2023-11-27T22:29:38.659425+0000","last_active":"2023-11-27T22:29:40.636788+0000","last_peered":"2023-11-27T22:29:40.636788+0000","last_clean":"2023-11-27T22:29:40.636788+0000","last_became_active":"2023-11-27T22:29:38.659091+0000","last_became_peered":"2023-11-27T22:29:38.659091+0000","last_unstale":"2023-11-27T22:29:40.636788+0000","last_undegraded":"2023-11-27T22:29:40.636788+0000","last_fullsized":"2023-11-27T22:29:40.636788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637460+0000","last_change":"2023-11-27T22:29:38.658068+0000","last_active":"2023-11-27T22:29:40.637460+0000","last_peered":"2023-11-27T22:29:40.637460+0000","last_clean":"2023-11-27T22:29:40.637460+0000","last_became_active":"2023-11-27T22:29:38.657688+0000","last_became_peered":"2023-11-27T22:29:38.657688+0000","last_unstale":"2023-11-27T22:29:40.637460+0000","last_undegraded":"2023-11-27T22:29:40.637460+0000","last_fullsized":"2023-11-27T22:29:40.637460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637464+0000","last_change":"2023-11-27T22:29:39.651687+0000","last_active":"2023-11-27T22:29:40.637464+0000","last_peered":"2023-11-27T22:29:40.637464+0000","last_clean":"2023-11-27T22:29:40.637464+0000","last_became_active":"2023-11-27T22:29:39.651383+0000","last_became_peered":"2023-11-27T22:29:39.651383+0000","last_unstale":"2023-11-27T22:29:40.637464+0000","last_undegraded":"2023-11-27T22:29:40.637464+0000","last_fullsized":"2023-11-27T22:29:40.637464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640454+0000","last_change":"2023-11-27T22:29:38.656782+0000","last_active":"2023-11-27T22:29:39.640454+0000","last_peered":"2023-11-27T22:29:39.640454+0000","last_clean":"2023-11-27T22:29:39.640454+0000","last_became_active":"2023-11-27T22:29:38.656527+0000","last_became_peered":"2023-11-27T22:29:38.656527+0000","last_unstale":"2023-11-27T22:29:39.640454+0000","last_undegraded":"2023-11-27T22:29:39.640454+0000","last_fullsized":"2023-11-27T22:29:39.640454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638394+0000","last_change":"2023-11-27T22:29:39.646862+0000","last_active":"2023-11-27T22:29:40.638394+0000","last_peered":"2023-11-27T22:29:40.638394+0000","last_clean":"2023-11-27T22:29:40.638394+0000","last_became_active":"2023-11-27T22:29:39.644502+0000","last_became_peered":"2023-11-27T22:29:39.644502+0000","last_unstale":"2023-11-27T22:29:40.638394+0000","last_undegraded":"2023-11-27T22:29:40.638394+0000","last_fullsized":"2023-11-27T22:29:40.638394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636966+0000","last_change":"2023-11-27T22:29:38.656824+0000","last_active":"2023-11-27T22:29:40.636966+0000","last_peered":"2023-11-27T22:29:40.636966+0000","last_clean":"2023-11-27T22:29:40.636966+0000","last_became_active":"2023-11-27T22:29:38.656542+0000","last_became_peered":"2023-11-27T22:29:38.656542+0000","last_unstale":"2023-11-27T22:29:40.636966+0000","last_undegraded":"2023-11-27T22:29:40.636966+0000","last_fullsized":"2023-11-27T22:29:40.636966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.660797+0000","last_change":"2023-11-27T22:29:39.656332+0000","last_active":"2023-11-27T22:29:39.660797+0000","last_peered":"2023-11-27T22:29:39.660797+0000","last_clean":"2023-11-27T22:29:39.660797+0000","last_became_active":"2023-11-27T22:29:39.654860+0000","last_became_peered":"2023-11-27T22:29:39.654860+0000","last_unstale":"2023-11-27T22:29:39.660797+0000","last_undegraded":"2023-11-27T22:29:39.660797+0000","last_fullsized":"2023-11-27T22:29:39.660797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.641823+0000","last_change":"2023-11-27T22:29:38.661962+0000","last_active":"2023-11-27T22:29:39.641823+0000","last_peered":"2023-11-27T22:29:39.641823+0000","last_clean":"2023-11-27T22:29:39.641823+0000","last_became_active":"2023-11-27T22:29:38.661221+0000","last_became_peered":"2023-11-27T22:29:38.661221+0000","last_unstale":"2023-11-27T22:29:39.641823+0000","last_undegraded":"2023-11-27T22:29:39.641823+0000","last_fullsized":"2023-11-27T22:29:39.641823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:02.332894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.650757+0000","last_change":"2023-11-27T22:29:39.644743+0000","last_active":"2023-11-27T22:29:39.650757+0000","last_peered":"2023-11-27T22:29:39.650757+0000","last_clean":"2023-11-27T22:29:39.650757+0000","last_became_active":"2023-11-27T22:29:39.644482+0000","last_became_peered":"2023-11-27T22:29:39.644482+0000","last_unstale":"2023-11-27T22:29:39.650757+0000","last_undegraded":"2023-11-27T22:29:39.650757+0000","last_fullsized":"2023-11-27T22:29:39.650757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:40.311650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638586+0000","last_change":"2023-11-27T22:29:38.657621+0000","last_active":"2023-11-27T22:29:40.638586+0000","last_peered":"2023-11-27T22:29:40.638586+0000","last_clean":"2023-11-27T22:29:40.638586+0000","last_became_active":"2023-11-27T22:29:38.657362+0000","last_became_peered":"2023-11-27T22:29:38.657362+0000","last_unstale":"2023-11-27T22:29:40.638586+0000","last_undegraded":"2023-11-27T22:29:40.638586+0000","last_fullsized":"2023-11-27T22:29:40.638586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.660921+0000","last_change":"2023-11-27T22:29:39.654893+0000","last_active":"2023-11-27T22:29:39.660921+0000","last_peered":"2023-11-27T22:29:39.660921+0000","last_clean":"2023-11-27T22:29:39.660921+0000","last_became_active":"2023-11-27T22:29:39.654615+0000","last_became_peered":"2023-11-27T22:29:39.654615+0000","last_unstale":"2023-11-27T22:29:39.660921+0000","last_undegraded":"2023-11-27T22:29:39.660921+0000","last_fullsized":"2023-11-27T22:29:39.660921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:52.858990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637012+0000","last_change":"2023-11-27T22:29:38.659143+0000","last_active":"2023-11-27T22:29:40.637012+0000","last_peered":"2023-11-27T22:29:40.637012+0000","last_clean":"2023-11-27T22:29:40.637012+0000","last_became_active":"2023-11-27T22:29:38.658790+0000","last_became_peered":"2023-11-27T22:29:38.658790+0000","last_unstale":"2023-11-27T22:29:40.637012+0000","last_undegraded":"2023-11-27T22:29:40.637012+0000","last_fullsized":"2023-11-27T22:29:40.637012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658274+0000","last_change":"2023-11-27T22:29:39.654060+0000","last_active":"2023-11-27T22:29:39.658274+0000","last_peered":"2023-11-27T22:29:39.658274+0000","last_clean":"2023-11-27T22:29:39.658274+0000","last_became_active":"2023-11-27T22:29:39.653483+0000","last_became_peered":"2023-11-27T22:29:39.653483+0000","last_unstale":"2023-11-27T22:29:39.658274+0000","last_undegraded":"2023-11-27T22:29:39.658274+0000","last_fullsized":"2023-11-27T22:29:39.658274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.680884+0000","last_change":"2023-11-27T22:29:38.660084+0000","last_active":"2023-11-27T22:29:39.680884+0000","last_peered":"2023-11-27T22:29:39.680884+0000","last_clean":"2023-11-27T22:29:39.680884+0000","last_became_active":"2023-11-27T22:29:38.659648+0000","last_became_peered":"2023-11-27T22:29:38.659648+0000","last_unstale":"2023-11-27T22:29:39.680884+0000","last_undegraded":"2023-11-27T22:29:39.680884+0000","last_fullsized":"2023-11-27T22:29:39.680884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656349+0000","last_change":"2023-11-27T22:29:39.654365+0000","last_active":"2023-11-27T22:29:39.656349+0000","last_peered":"2023-11-27T22:29:39.656349+0000","last_clean":"2023-11-27T22:29:39.656349+0000","last_became_active":"2023-11-27T22:29:39.654080+0000","last_became_peered":"2023-11-27T22:29:39.654080+0000","last_unstale":"2023-11-27T22:29:39.656349+0000","last_undegraded":"2023-11-27T22:29:39.656349+0000","last_fullsized":"2023-11-27T22:29:39.656349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:59.672839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640429+0000","last_change":"2023-11-27T22:29:38.661785+0000","last_active":"2023-11-27T22:29:39.640429+0000","last_peered":"2023-11-27T22:29:39.640429+0000","last_clean":"2023-11-27T22:29:39.640429+0000","last_became_active":"2023-11-27T22:29:38.661129+0000","last_became_peered":"2023-11-27T22:29:38.661129+0000","last_unstale":"2023-11-27T22:29:39.640429+0000","last_undegraded":"2023-11-27T22:29:39.640429+0000","last_fullsized":"2023-11-27T22:29:39.640429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658322+0000","last_change":"2023-11-27T22:29:39.654846+0000","last_active":"2023-11-27T22:29:39.658322+0000","last_peered":"2023-11-27T22:29:39.658322+0000","last_clean":"2023-11-27T22:29:39.658322+0000","last_became_active":"2023-11-27T22:29:39.654042+0000","last_became_peered":"2023-11-27T22:29:39.654042+0000","last_unstale":"2023-11-27T22:29:39.658322+0000","last_undegraded":"2023-11-27T22:29:39.658322+0000","last_fullsized":"2023-11-27T22:29:39.658322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636721+0000","last_change":"2023-11-27T22:29:38.658756+0000","last_active":"2023-11-27T22:29:40.636721+0000","last_peered":"2023-11-27T22:29:40.636721+0000","last_clean":"2023-11-27T22:29:40.636721+0000","last_became_active":"2023-11-27T22:29:38.658475+0000","last_became_peered":"2023-11-27T22:29:38.658475+0000","last_unstale":"2023-11-27T22:29:40.636721+0000","last_undegraded":"2023-11-27T22:29:40.636721+0000","last_fullsized":"2023-11-27T22:29:40.636721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636767+0000","last_change":"2023-11-27T22:29:39.649309+0000","last_active":"2023-11-27T22:29:40.636767+0000","last_peered":"2023-11-27T22:29:40.636767+0000","last_clean":"2023-11-27T22:29:40.636767+0000","last_became_active":"2023-11-27T22:29:39.648695+0000","last_became_peered":"2023-11-27T22:29:39.648695+0000","last_unstale":"2023-11-27T22:29:40.636767+0000","last_undegraded":"2023-11-27T22:29:40.636767+0000","last_fullsized":"2023-11-27T22:29:40.636767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.764988+0000","last_change":"2023-11-27T22:29:38.654789+0000","last_active":"2023-11-27T22:29:40.764988+0000","last_peered":"2023-11-27T22:29:40.764988+0000","last_clean":"2023-11-27T22:29:40.764988+0000","last_became_active":"2023-11-27T22:29:38.654453+0000","last_became_peered":"2023-11-27T22:29:38.654453+0000","last_unstale":"2023-11-27T22:29:40.764988+0000","last_undegraded":"2023-11-27T22:29:40.764988+0000","last_fullsized":"2023-11-27T22:29:40.764988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:58.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658368+0000","last_change":"2023-11-27T22:29:39.654661+0000","last_active":"2023-11-27T22:29:39.658368+0000","last_peered":"2023-11-27T22:29:39.658368+0000","last_clean":"2023-11-27T22:29:39.658368+0000","last_became_active":"2023-11-27T22:29:39.654269+0000","last_became_peered":"2023-11-27T22:29:39.654269+0000","last_unstale":"2023-11-27T22:29:39.658368+0000","last_undegraded":"2023-11-27T22:29:39.658368+0000","last_fullsized":"2023-11-27T22:29:39.658368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.674838+0000","last_change":"2023-11-27T22:29:38.658036+0000","last_active":"2023-11-27T22:29:39.674838+0000","last_peered":"2023-11-27T22:29:39.674838+0000","last_clean":"2023-11-27T22:29:39.674838+0000","last_became_active":"2023-11-27T22:29:38.657748+0000","last_became_peered":"2023-11-27T22:29:38.657748+0000","last_unstale":"2023-11-27T22:29:39.674838+0000","last_undegraded":"2023-11-27T22:29:39.674838+0000","last_fullsized":"2023-11-27T22:29:39.674838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:26.492362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.666221+0000","last_change":"2023-11-27T22:29:39.659240+0000","last_active":"2023-11-27T22:29:39.666221+0000","last_peered":"2023-11-27T22:29:39.666221+0000","last_clean":"2023-11-27T22:29:39.666221+0000","last_became_active":"2023-11-27T22:29:39.658986+0000","last_became_peered":"2023-11-27T22:29:39.658986+0000","last_unstale":"2023-11-27T22:29:39.666221+0000","last_undegraded":"2023-11-27T22:29:39.666221+0000","last_fullsized":"2023-11-27T22:29:39.666221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765118+0000","last_change":"2023-11-27T22:29:38.660926+0000","last_active":"2023-11-27T22:29:40.765118+0000","last_peered":"2023-11-27T22:29:40.765118+0000","last_clean":"2023-11-27T22:29:40.765118+0000","last_became_active":"2023-11-27T22:29:38.660662+0000","last_became_peered":"2023-11-27T22:29:38.660662+0000","last_unstale":"2023-11-27T22:29:40.765118+0000","last_undegraded":"2023-11-27T22:29:40.765118+0000","last_fullsized":"2023-11-27T22:29:40.765118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:41.693347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.666297+0000","last_change":"2023-11-27T22:29:39.659397+0000","last_active":"2023-11-27T22:29:39.666297+0000","last_peered":"2023-11-27T22:29:39.666297+0000","last_clean":"2023-11-27T22:29:39.666297+0000","last_became_active":"2023-11-27T22:29:39.658970+0000","last_became_peered":"2023-11-27T22:29:39.658970+0000","last_unstale":"2023-11-27T22:29:39.666297+0000","last_undegraded":"2023-11-27T22:29:39.666297+0000","last_fullsized":"2023-11-27T22:29:39.666297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638663+0000","last_change":"2023-11-27T22:29:38.654389+0000","last_active":"2023-11-27T22:29:40.638663+0000","last_peered":"2023-11-27T22:29:40.638663+0000","last_clean":"2023-11-27T22:29:40.638663+0000","last_became_active":"2023-11-27T22:29:38.654116+0000","last_became_peered":"2023-11-27T22:29:38.654116+0000","last_unstale":"2023-11-27T22:29:40.638663+0000","last_undegraded":"2023-11-27T22:29:40.638663+0000","last_fullsized":"2023-11-27T22:29:40.638663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656585+0000","last_change":"2023-11-27T22:29:39.649308+0000","last_active":"2023-11-27T22:29:39.656585+0000","last_peered":"2023-11-27T22:29:39.656585+0000","last_clean":"2023-11-27T22:29:39.656585+0000","last_became_active":"2023-11-27T22:29:39.648915+0000","last_became_peered":"2023-11-27T22:29:39.648915+0000","last_unstale":"2023-11-27T22:29:39.656585+0000","last_undegraded":"2023-11-27T22:29:39.656585+0000","last_fullsized":"2023-11-27T22:29:39.656585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:22.343131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765138+0000","last_change":"2023-11-27T22:29:38.661956+0000","last_active":"2023-11-27T22:29:40.765138+0000","last_peered":"2023-11-27T22:29:40.765138+0000","last_clean":"2023-11-27T22:29:40.765138+0000","last_became_active":"2023-11-27T22:29:38.661660+0000","last_became_peered":"2023-11-27T22:29:38.661660+0000","last_unstale":"2023-11-27T22:29:40.765138+0000","last_undegraded":"2023-11-27T22:29:40.765138+0000","last_fullsized":"2023-11-27T22:29:40.765138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:51.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.661021+0000","last_change":"2023-11-27T22:29:39.655710+0000","last_active":"2023-11-27T22:29:39.661021+0000","last_peered":"2023-11-27T22:29:39.661021+0000","last_clean":"2023-11-27T22:29:39.661021+0000","last_became_active":"2023-11-27T22:29:39.654385+0000","last_became_peered":"2023-11-27T22:29:39.654385+0000","last_unstale":"2023-11-27T22:29:39.661021+0000","last_undegraded":"2023-11-27T22:29:39.661021+0000","last_fullsized":"2023-11-27T22:29:39.661021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-27T22:29:38.657100+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:38.657100+0000","last_peered":"2023-11-27T22:29:38.657100+0000","last_clean":"2023-11-27T22:29:38.657100+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:38.657100+0000","last_undegraded":"2023-11-27T22:29:38.657100+0000","last_fullsized":"2023-11-27T22:29:38.657100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640506+0000","last_change":"2023-11-27T22:29:38.656156+0000","last_active":"2023-11-27T22:29:39.640506+0000","last_peered":"2023-11-27T22:29:39.640506+0000","last_clean":"2023-11-27T22:29:39.640506+0000","last_became_active":"2023-11-27T22:29:38.655859+0000","last_became_peered":"2023-11-27T22:29:38.655859+0000","last_unstale":"2023-11-27T22:29:39.640506+0000","last_undegraded":"2023-11-27T22:29:39.640506+0000","last_fullsized":"2023-11-27T22:29:39.640506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637872+0000","last_change":"2023-11-27T22:29:39.653299+0000","last_active":"2023-11-27T22:29:40.637872+0000","last_peered":"2023-11-27T22:29:40.637872+0000","last_clean":"2023-11-27T22:29:40.637872+0000","last_became_active":"2023-11-27T22:29:39.653033+0000","last_became_peered":"2023-11-27T22:29:39.653033+0000","last_unstale":"2023-11-27T22:29:40.637872+0000","last_undegraded":"2023-11-27T22:29:40.637872+0000","last_fullsized":"2023-11-27T22:29:40.637872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.642321+0000","last_change":"2023-11-27T22:29:38.664007+0000","last_active":"2023-11-27T22:29:39.642321+0000","last_peered":"2023-11-27T22:29:39.642321+0000","last_clean":"2023-11-27T22:29:39.642321+0000","last_became_active":"2023-11-27T22:29:38.663462+0000","last_became_peered":"2023-11-27T22:29:38.663462+0000","last_unstale":"2023-11-27T22:29:39.642321+0000","last_undegraded":"2023-11-27T22:29:39.642321+0000","last_fullsized":"2023-11-27T22:29:39.642321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649855+0000","last_change":"2023-11-27T22:29:39.646086+0000","last_active":"2023-11-27T22:29:39.649855+0000","last_peered":"2023-11-27T22:29:39.649855+0000","last_clean":"2023-11-27T22:29:39.649855+0000","last_became_active":"2023-11-27T22:29:39.645812+0000","last_became_peered":"2023-11-27T22:29:39.645812+0000","last_unstale":"2023-11-27T22:29:39.649855+0000","last_undegraded":"2023-11-27T22:29:39.649855+0000","last_fullsized":"2023-11-27T22:29:39.649855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:52.858990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765072+0000","last_change":"2023-11-27T22:29:38.660283+0000","last_active":"2023-11-27T22:29:40.765072+0000","last_peered":"2023-11-27T22:29:40.765072+0000","last_clean":"2023-11-27T22:29:40.765072+0000","last_became_active":"2023-11-27T22:29:38.658807+0000","last_became_peered":"2023-11-27T22:29:38.658807+0000","last_unstale":"2023-11-27T22:29:40.765072+0000","last_undegraded":"2023-11-27T22:29:40.765072+0000","last_fullsized":"2023-11-27T22:29:40.765072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638421+0000","last_change":"2023-11-27T22:29:39.644925+0000","last_active":"2023-11-27T22:29:40.638421+0000","last_peered":"2023-11-27T22:29:40.638421+0000","last_clean":"2023-11-27T22:29:40.638421+0000","last_became_active":"2023-11-27T22:29:39.644678+0000","last_became_peered":"2023-11-27T22:29:39.644678+0000","last_unstale":"2023-11-27T22:29:40.638421+0000","last_undegraded":"2023-11-27T22:29:40.638421+0000","last_fullsized":"2023-11-27T22:29:40.638421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640486+0000","last_change":"2023-11-27T22:29:38.662139+0000","last_active":"2023-11-27T22:29:39.640486+0000","last_peered":"2023-11-27T22:29:39.640486+0000","last_clean":"2023-11-27T22:29:39.640486+0000","last_became_active":"2023-11-27T22:29:38.661432+0000","last_became_peered":"2023-11-27T22:29:38.661432+0000","last_unstale":"2023-11-27T22:29:39.640486+0000","last_undegraded":"2023-11-27T22:29:39.640486+0000","last_fullsized":"2023-11-27T22:29:39.640486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658782+0000","last_change":"2023-11-27T22:29:39.651435+0000","last_active":"2023-11-27T22:29:39.658782+0000","last_peered":"2023-11-27T22:29:39.658782+0000","last_clean":"2023-11-27T22:29:39.658782+0000","last_became_active":"2023-11-27T22:29:39.651172+0000","last_became_peered":"2023-11-27T22:29:39.651172+0000","last_unstale":"2023-11-27T22:29:39.658782+0000","last_undegraded":"2023-11-27T22:29:39.658782+0000","last_fullsized":"2023-11-27T22:29:39.658782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:22.343131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638530+0000","last_change":"2023-11-27T22:29:38.653717+0000","last_active":"2023-11-27T22:29:40.638530+0000","last_peered":"2023-11-27T22:29:40.638530+0000","last_clean":"2023-11-27T22:29:40.638530+0000","last_became_active":"2023-11-27T22:29:38.653432+0000","last_became_peered":"2023-11-27T22:29:38.653432+0000","last_unstale":"2023-11-27T22:29:40.638530+0000","last_undegraded":"2023-11-27T22:29:40.638530+0000","last_fullsized":"2023-11-27T22:29:40.638530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:07.717011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.657265+0000","last_change":"2023-11-27T22:29:39.650521+0000","last_active":"2023-11-27T22:29:39.657265+0000","last_peered":"2023-11-27T22:29:39.657265+0000","last_clean":"2023-11-27T22:29:39.657265+0000","last_became_active":"2023-11-27T22:29:39.650292+0000","last_became_peered":"2023-11-27T22:29:39.650292+0000","last_unstale":"2023-11-27T22:29:39.657265+0000","last_undegraded":"2023-11-27T22:29:39.657265+0000","last_fullsized":"2023-11-27T22:29:39.657265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.644189+0000","last_change":"2023-11-27T22:29:38.664144+0000","last_active":"2023-11-27T22:29:39.644189+0000","last_peered":"2023-11-27T22:29:39.644189+0000","last_clean":"2023-11-27T22:29:39.644189+0000","last_became_active":"2023-11-27T22:29:38.663854+0000","last_became_peered":"2023-11-27T22:29:38.663854+0000","last_unstale":"2023-11-27T22:29:39.644189+0000","last_undegraded":"2023-11-27T22:29:39.644189+0000","last_fullsized":"2023-11-27T22:29:39.644189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638533+0000","last_change":"2023-11-27T22:29:39.645029+0000","last_active":"2023-11-27T22:29:40.638533+0000","last_peered":"2023-11-27T22:29:40.638533+0000","last_clean":"2023-11-27T22:29:40.638533+0000","last_became_active":"2023-11-27T22:29:39.644767+0000","last_became_peered":"2023-11-27T22:29:39.644767+0000","last_unstale":"2023-11-27T22:29:40.638533+0000","last_undegraded":"2023-11-27T22:29:40.638533+0000","last_fullsized":"2023-11-27T22:29:40.638533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638693+0000","last_change":"2023-11-27T22:29:38.655124+0000","last_active":"2023-11-27T22:29:40.638693+0000","last_peered":"2023-11-27T22:29:40.638693+0000","last_clean":"2023-11-27T22:29:40.638693+0000","last_became_active":"2023-11-27T22:29:38.654557+0000","last_became_peered":"2023-11-27T22:29:38.654557+0000","last_unstale":"2023-11-27T22:29:40.638693+0000","last_undegraded":"2023-11-27T22:29:40.638693+0000","last_fullsized":"2023-11-27T22:29:40.638693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637851+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:40.637851+0000","last_peered":"2023-11-27T22:29:40.637851+0000","last_clean":"2023-11-27T22:29:40.637851+0000","last_became_active":"2023-11-27T22:29:39.654060+0000","last_became_peered":"2023-11-27T22:29:39.654060+0000","last_unstale":"2023-11-27T22:29:40.637851+0000","last_undegraded":"2023-11-27T22:29:40.637851+0000","last_fullsized":"2023-11-27T22:29:40.637851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637133+0000","last_change":"2023-11-27T22:29:38.662202+0000","last_active":"2023-11-27T22:29:40.637133+0000","last_peered":"2023-11-27T22:29:40.637133+0000","last_clean":"2023-11-27T22:29:40.637133+0000","last_became_active":"2023-11-27T22:29:38.661712+0000","last_became_peered":"2023-11-27T22:29:38.661712+0000","last_unstale":"2023-11-27T22:29:40.637133+0000","last_undegraded":"2023-11-27T22:29:40.637133+0000","last_fullsized":"2023-11-27T22:29:40.637133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649233+0000","last_change":"2023-11-27T22:29:39.643007+0000","last_active":"2023-11-27T22:29:39.649233+0000","last_peered":"2023-11-27T22:29:39.649233+0000","last_clean":"2023-11-27T22:29:39.649233+0000","last_became_active":"2023-11-27T22:29:39.642647+0000","last_became_peered":"2023-11-27T22:29:39.642647+0000","last_unstale":"2023-11-27T22:29:39.649233+0000","last_undegraded":"2023-11-27T22:29:39.649233+0000","last_fullsized":"2023-11-27T22:29:39.649233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.644519+0000","last_change":"2023-11-27T22:29:38.664234+0000","last_active":"2023-11-27T22:29:39.644519+0000","last_peered":"2023-11-27T22:29:39.644519+0000","last_clean":"2023-11-27T22:29:39.644519+0000","last_became_active":"2023-11-27T22:29:38.663863+0000","last_became_peered":"2023-11-27T22:29:38.663863+0000","last_unstale":"2023-11-27T22:29:39.644519+0000","last_undegraded":"2023-11-27T22:29:39.644519+0000","last_fullsized":"2023-11-27T22:29:39.644519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652470+0000","last_change":"2023-11-27T22:29:39.644164+0000","last_active":"2023-11-27T22:29:39.652470+0000","last_peered":"2023-11-27T22:29:39.652470+0000","last_clean":"2023-11-27T22:29:39.652470+0000","last_became_active":"2023-11-27T22:29:39.643326+0000","last_became_peered":"2023-11-27T22:29:39.643326+0000","last_unstale":"2023-11-27T22:29:39.652470+0000","last_undegraded":"2023-11-27T22:29:39.652470+0000","last_fullsized":"2023-11-27T22:29:39.652470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:50:16.238678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638480+0000","last_change":"2023-11-27T22:29:38.659399+0000","last_active":"2023-11-27T22:29:40.638480+0000","last_peered":"2023-11-27T22:29:40.638480+0000","last_clean":"2023-11-27T22:29:40.638480+0000","last_became_active":"2023-11-27T22:29:38.659105+0000","last_became_peered":"2023-11-27T22:29:38.659105+0000","last_unstale":"2023-11-27T22:29:40.638480+0000","last_undegraded":"2023-11-27T22:29:40.638480+0000","last_fullsized":"2023-11-27T22:29:40.638480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637606+0000","last_change":"2023-11-27T22:29:39.646130+0000","last_active":"2023-11-27T22:29:40.637606+0000","last_peered":"2023-11-27T22:29:40.637606+0000","last_clean":"2023-11-27T22:29:40.637606+0000","last_became_active":"2023-11-27T22:29:39.645883+0000","last_became_peered":"2023-11-27T22:29:39.645883+0000","last_unstale":"2023-11-27T22:29:40.637606+0000","last_undegraded":"2023-11-27T22:29:40.637606+0000","last_fullsized":"2023-11-27T22:29:40.637606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638459+0000","last_change":"2023-11-27T22:29:38.660518+0000","last_active":"2023-11-27T22:29:40.638459+0000","last_peered":"2023-11-27T22:29:40.638459+0000","last_clean":"2023-11-27T22:29:40.638459+0000","last_became_active":"2023-11-27T22:29:38.660266+0000","last_became_peered":"2023-11-27T22:29:38.660266+0000","last_unstale":"2023-11-27T22:29:40.638459+0000","last_undegraded":"2023-11-27T22:29:40.638459+0000","last_fullsized":"2023-11-27T22:29:40.638459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637857+0000","last_change":"2023-11-27T22:29:39.651820+0000","last_active":"2023-11-27T22:29:40.637857+0000","last_peered":"2023-11-27T22:29:40.637857+0000","last_clean":"2023-11-27T22:29:40.637857+0000","last_became_active":"2023-11-27T22:29:39.651526+0000","last_became_peered":"2023-11-27T22:29:39.651526+0000","last_unstale":"2023-11-27T22:29:40.637857+0000","last_undegraded":"2023-11-27T22:29:40.637857+0000","last_fullsized":"2023-11-27T22:29:40.637857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.680966+0000","last_change":"2023-11-27T22:29:38.665243+0000","last_active":"2023-11-27T22:29:39.680966+0000","last_peered":"2023-11-27T22:29:39.680966+0000","last_clean":"2023-11-27T22:29:39.680966+0000","last_became_active":"2023-11-27T22:29:38.664972+0000","last_became_peered":"2023-11-27T22:29:38.664972+0000","last_unstale":"2023-11-27T22:29:39.680966+0000","last_undegraded":"2023-11-27T22:29:39.680966+0000","last_fullsized":"2023-11-27T22:29:39.680966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636882+0000","last_change":"2023-11-27T22:29:39.645449+0000","last_active":"2023-11-27T22:29:40.636882+0000","last_peered":"2023-11-27T22:29:40.636882+0000","last_clean":"2023-11-27T22:29:40.636882+0000","last_became_active":"2023-11-27T22:29:39.645168+0000","last_became_peered":"2023-11-27T22:29:39.645168+0000","last_unstale":"2023-11-27T22:29:40.636882+0000","last_undegraded":"2023-11-27T22:29:40.636882+0000","last_fullsized":"2023-11-27T22:29:40.636882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652671+0000","last_change":"2023-11-27T22:29:39.646245+0000","last_active":"2023-11-27T22:29:39.652671+0000","last_peered":"2023-11-27T22:29:39.652671+0000","last_clean":"2023-11-27T22:29:39.652671+0000","last_became_active":"2023-11-27T22:29:39.645965+0000","last_became_peered":"2023-11-27T22:29:39.645965+0000","last_unstale":"2023-11-27T22:29:39.652671+0000","last_undegraded":"2023-11-27T22:29:39.652671+0000","last_fullsized":"2023-11-27T22:29:39.652671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.678397+0000","last_change":"2023-11-27T22:29:38.663026+0000","last_active":"2023-11-27T22:29:39.678397+0000","last_peered":"2023-11-27T22:29:39.678397+0000","last_clean":"2023-11-27T22:29:39.678397+0000","last_became_active":"2023-11-27T22:29:38.662621+0000","last_became_peered":"2023-11-27T22:29:38.662621+0000","last_unstale":"2023-11-27T22:29:39.678397+0000","last_undegraded":"2023-11-27T22:29:39.678397+0000","last_fullsized":"2023-11-27T22:29:39.678397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652710+0000","last_change":"2023-11-27T22:29:39.646947+0000","last_active":"2023-11-27T22:29:39.652710+0000","last_peered":"2023-11-27T22:29:39.652710+0000","last_clean":"2023-11-27T22:29:39.652710+0000","last_became_active":"2023-11-27T22:29:39.646670+0000","last_became_peered":"2023-11-27T22:29:39.646670+0000","last_unstale":"2023-11-27T22:29:39.652710+0000","last_undegraded":"2023-11-27T22:29:39.652710+0000","last_fullsized":"2023-11-27T22:29:39.652710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.678554+0000","last_change":"2023-11-27T22:29:38.667974+0000","last_active":"2023-11-27T22:29:39.678554+0000","last_peered":"2023-11-27T22:29:39.678554+0000","last_clean":"2023-11-27T22:29:39.678554+0000","last_became_active":"2023-11-27T22:29:38.667716+0000","last_became_peered":"2023-11-27T22:29:38.667716+0000","last_unstale":"2023-11-27T22:29:39.678554+0000","last_undegraded":"2023-11-27T22:29:39.678554+0000","last_fullsized":"2023-11-27T22:29:39.678554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.650776+0000","last_change":"2023-11-27T22:29:39.648535+0000","last_active":"2023-11-27T22:29:39.650776+0000","last_peered":"2023-11-27T22:29:39.650776+0000","last_clean":"2023-11-27T22:29:39.650776+0000","last_became_active":"2023-11-27T22:29:39.648270+0000","last_became_peered":"2023-11-27T22:29:39.648270+0000","last_unstale":"2023-11-27T22:29:39.650776+0000","last_undegraded":"2023-11-27T22:29:39.650776+0000","last_fullsized":"2023-11-27T22:29:39.650776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637713+0000","last_change":"2023-11-27T22:29:38.663189+0000","last_active":"2023-11-27T22:29:40.637713+0000","last_peered":"2023-11-27T22:29:40.637713+0000","last_clean":"2023-11-27T22:29:40.637713+0000","last_became_active":"2023-11-27T22:29:38.662886+0000","last_became_peered":"2023-11-27T22:29:38.662886+0000","last_unstale":"2023-11-27T22:29:40.637713+0000","last_undegraded":"2023-11-27T22:29:40.637713+0000","last_fullsized":"2023-11-27T22:29:40.637713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637686+0000","last_change":"2023-11-27T22:29:39.656710+0000","last_active":"2023-11-27T22:29:40.637686+0000","last_peered":"2023-11-27T22:29:40.637686+0000","last_clean":"2023-11-27T22:29:40.637686+0000","last_became_active":"2023-11-27T22:29:39.656469+0000","last_became_peered":"2023-11-27T22:29:39.656469+0000","last_unstale":"2023-11-27T22:29:40.637686+0000","last_undegraded":"2023-11-27T22:29:40.637686+0000","last_fullsized":"2023-11-27T22:29:40.637686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.678226+0000","last_change":"2023-11-27T22:29:38.661665+0000","last_active":"2023-11-27T22:29:39.678226+0000","last_peered":"2023-11-27T22:29:39.678226+0000","last_clean":"2023-11-27T22:29:39.678226+0000","last_became_active":"2023-11-27T22:29:38.661369+0000","last_became_peered":"2023-11-27T22:29:38.661369+0000","last_unstale":"2023-11-27T22:29:39.678226+0000","last_undegraded":"2023-11-27T22:29:39.678226+0000","last_fullsized":"2023-11-27T22:29:39.678226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:43.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T22:29:43.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.386+0000 7ff917953640 1 Processor -- start 2023-11-27T22:29:43.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.387+0000 7ff917953640 1 -- start start 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.387+0000 7ff917953640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff91015d330 0x7ff9100b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.387+0000 7ff917953640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9100d2d90 0x7ff9100b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.387+0000 7ff917953640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9100b2b10 con 0x7ff9100d2910 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.387+0000 7ff917953640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9100d1590 con 0x7ff9100d2d90 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.387+0000 7ff917953640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100d1870 con 0x7ff91015d330 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9100d2d90 0x7ff9100b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff9100d2d90 0x7ff9100b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56516/0 (socket says 172.21.15.154:56516) 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 -- 172.21.15.154:0/2955772047 learned_addr learned my addr 172.21.15.154:0/2955772047 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:43.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff9156ef640 1 --2- 172.21.15.154:0/2955772047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff91015d330 0x7ff9100b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 -- 172.21.15.154:0/2955772047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff91015d330 msgr2=0x7ff9100b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:43.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 --2- 172.21.15.154:0/2955772047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff91015d330 0x7ff9100b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 -- 172.21.15.154:0/2955772047 >> v1:172.21.15.194:6789/0 conn(0x7ff9100d2910 legacy=0x7ff9100d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:43.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.388+0000 7ff915ef0640 1 -- 172.21.15.154:0/2955772047 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9100d1b50 con 0x7ff9100d2d90 2023-11-27T22:29:43.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff915ef0640 1 --2- 172.21.15.154:0/2955772047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100b6390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff908009e50 tx=0x7ff90802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d79450cd3645f1d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff907fff640 1 -- 172.21.15.154:0/2955772047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90802c9e0 con 0x7ff9100d2d90 2023-11-27T22:29:43.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff907fff640 1 -- 172.21.15.154:0/2955772047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90802cb40 con 0x7ff9100d2d90 2023-11-27T22:29:43.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff907fff640 1 -- 172.21.15.154:0/2955772047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080343f0 con 0x7ff9100d2d90 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 -- 172.21.15.154:0/2955772047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 msgr2=0x7ff9100b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 --2- 172.21.15.154:0/2955772047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100b6390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff908009e50 tx=0x7ff90802be40 comp rx=0 tx=0).stop 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 -- 172.21.15.154:0/2955772047 shutdown_connections 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 --2- 172.21.15.154:0/2955772047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100b6390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 --2- 172.21.15.154:0/2955772047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff91015d330 0x7ff9100b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 -- 172.21.15.154:0/2955772047 >> 172.21.15.154:0/2955772047 conn(0x7ff910072020 msgr2=0x7ff910072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 -- 172.21.15.154:0/2955772047 shutdown_connections 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.389+0000 7ff917953640 1 -- 172.21.15.154:0/2955772047 wait complete. 2023-11-27T22:29:43.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.390+0000 7ff917953640 1 Processor -- start 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 -- start start 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9100d2910 0x7ff91014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff91015d330 0x7ff91015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100cd170 con 0x7ff9100d2d90 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100cce90 con 0x7ff91015d330 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff917953640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100cade0 con 0x7ff9100d2910 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff914eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff914eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56518/0 (socket says 172.21.15.154:56518) 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.391+0000 7ff914eee640 1 -- 172.21.15.154:0/3525506577 learned_addr learned my addr 172.21.15.154:0/3525506577 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:43.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff9156ef640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9100d2910 0x7ff91014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff915ef0640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff91015d330 0x7ff91015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff914eee640 1 -- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9100d2910 msgr2=0x7ff91014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff914eee640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9100d2910 0x7ff91014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff914eee640 1 -- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff91015d330 msgr2=0x7ff91015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff914eee640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff91015d330 0x7ff91015f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff914eee640 1 -- 172.21.15.154:0/3525506577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908009b30 con 0x7ff9100d2d90 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff915ef0640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff91015d330 0x7ff91015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff914eee640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100cb8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c430 tx=0x7ff90c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c011790 con 0x7ff9100d2d90 2023-11-27T22:29:43.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c0118f0 con 0x7ff9100d2d90 2023-11-27T22:29:43.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9100cb0c0 con 0x7ff9100d2d90 2023-11-27T22:29:43.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c011ce0 con 0x7ff9100d2d90 2023-11-27T22:29:43.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.392+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91014bb50 con 0x7ff9100d2d90 2023-11-27T22:29:43.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.393+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff910069400 con 0x7ff9100d2d90 2023-11-27T22:29:43.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.394+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff90c01c460 con 0x7ff9100d2d90 2023-11-27T22:29:43.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.394+0000 7ff905ffb640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff8f406b1c0 0x7ff8f406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.394+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff90c0899c0 con 0x7ff9100d2d90 2023-11-27T22:29:43.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.394+0000 7ff9156ef640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff8f406b1c0 0x7ff8f406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.394+0000 7ff9156ef640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff8f406b1c0 0x7ff8f406d680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff900006fd0 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.398+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff90c0546f0 con 0x7ff9100d2d90 2023-11-27T22:29:43.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.631+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff9100735c0 con 0x7ff9100d2d90 2023-11-27T22:29:43.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.631+0000 7ff905ffb640 1 -- 172.21.15.154:0/3525506577 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1021 (secure 0 0 0) 0x7ff90c057d10 con 0x7ff9100d2d90 2023-11-27T22:29:43.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:43.635 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1701124165,"num_in_osds":8,"osd_in_since":1701124157,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":223801344,"bytes_avail":772870311936,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-27T22:29:14.875243+0000","services":{}},"progress_events":{}} 2023-11-27T22:29:43.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff8f406b1c0 msgr2=0x7ff8f406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff8f406b1c0 0x7ff8f406d680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff900006fd0 tx=0x7ff900008040 comp rx=0 tx=0).stop 2023-11-27T22:29:43.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 msgr2=0x7ff9100cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100cb8c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00c430 tx=0x7ff90c00c8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 shutdown_connections 2023-11-27T22:29:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff91015d330 0x7ff91015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff8f406b1c0 0x7ff8f406d680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff9100d2d90 0x7ff9100cb8c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 --2- 172.21.15.154:0/3525506577 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9100d2910 0x7ff91014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 >> 172.21.15.154:0/3525506577 conn(0x7ff910072020 msgr2=0x7ff9100b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:43.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 shutdown_connections 2023-11-27T22:29:43.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.633+0000 7ff917953640 1 -- 172.21.15.154:0/3525506577 wait complete. 2023-11-27T22:29:43.647 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T22:29:43.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:43.687 INFO:tasks.ceph.mds.d.smithi194.stderr:2023-11-27T22:29:43.685+0000 7f2bb7b1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.745+0000 7fbcb3217640 1 Processor -- start 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.745+0000 7fbcb3217640 1 -- start start 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcb3217640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcac160fb0 0x7fbcac161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcb3217640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac161d20 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcb3217640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac15e760 con 0x7fbcac06ea50 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcb3217640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac15d9a0 con 0x7fbcac160fb0 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcabfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbcac160fb0 0x7fbcac161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcb17b4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbcac0d0ed0 0x7fbcac0d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44366/0 (socket says 172.21.15.154:44366) 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcb17b4640 1 -- 172.21.15.154:0/2755320549 learned_addr learned my addr 172.21.15.154:0/2755320549 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcabfff640 1 -- 172.21.15.154:0/2755320549 >> v1:172.21.15.194:6789/0 conn(0x7fbcac06ea50 legacy=0x7fbcac06ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcabfff640 1 -- 172.21.15.154:0/2755320549 >> v1:172.21.15.154:6789/0 conn(0x7fbcac0d0ed0 legacy=0x7fbcac0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcabfff640 1 -- 172.21.15.154:0/2755320549 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac15dc80 con 0x7fbcac160fb0 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.746+0000 7fbcab7fe640 1 -- 172.21.15.154:0/2755320549 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777216275 0 0) 0x7fbcac161d20 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.747+0000 7fbcabfff640 1 --2- 172.21.15.154:0/2755320549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac160fb0 0x7fbcac161440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc980097a0 tx=0x7fbc9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4e0f9d748fe5d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.747+0000 7fbcab7fe640 1 -- 172.21.15.154:0/2755320549 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98031830 con 0x7fbcac160fb0 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.747+0000 7fbcab7fe640 1 -- 172.21.15.154:0/2755320549 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98031990 con 0x7fbcac160fb0 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.747+0000 7fbcab7fe640 1 -- 172.21.15.154:0/2755320549 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98031d20 con 0x7fbcac160fb0 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 -- 172.21.15.154:0/2755320549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac160fb0 msgr2=0x7fbcac161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 --2- 172.21.15.154:0/2755320549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac160fb0 0x7fbcac161440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc980097a0 tx=0x7fbc9802b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 -- 172.21.15.154:0/2755320549 shutdown_connections 2023-11-27T22:29:43.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 --2- 172.21.15.154:0/2755320549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac160fb0 0x7fbcac161440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 -- 172.21.15.154:0/2755320549 >> 172.21.15.154:0/2755320549 conn(0x7fbcac06a6b0 msgr2=0x7fbcac06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:43.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 -- 172.21.15.154:0/2755320549 shutdown_connections 2023-11-27T22:29:43.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.748+0000 7fbcb3217640 1 -- 172.21.15.154:0/2755320549 wait complete. 2023-11-27T22:29:43.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.749+0000 7fbcb3217640 1 Processor -- start 2023-11-27T22:29:43.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.749+0000 7fbcb3217640 1 -- start start 2023-11-27T22:29:43.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbcac06ea50 0x7fbcac1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 0x7fbcac157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcac160fb0 0x7fbcac15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac13cac0 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac156830 con 0x7fbcac160fb0 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac15ae20 con 0x7fbcac06ea50 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 0x7fbcac157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 0x7fbcac157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56536/0 (socket says 172.21.15.154:56536) 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 -- 172.21.15.154:0/1956196277 learned_addr learned my addr 172.21.15.154:0/1956196277 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb17b4640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcac160fb0 0x7fbcac15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb0fb3640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbcac06ea50 0x7fbcac1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 -- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbcac06ea50 msgr2=0x7fbcac1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbcac06ea50 0x7fbcac1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 -- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcac160fb0 msgr2=0x7fbcac15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcac160fb0 0x7fbcac15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 -- 172.21.15.154:0/1956196277 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc98009400 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb0fb3640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbcac06ea50 0x7fbcac1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcabfff640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 0x7fbcac157ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc980098c0 tx=0x7fbc980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9803ca80 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9803cbe0 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9803a450 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac158980 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.750+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac13c6e0 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.751+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac15b290 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.752+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbc9803a5b0 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.752+0000 7fbca97fa640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc9006b1c0 0x7fbc9006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.752+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc980abdd0 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.752+0000 7fbcb0fb3640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc9006b1c0 0x7fbc9006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:43.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.752+0000 7fbcb0fb3640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc9006b1c0 0x7fbc9006d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007fd0 tx=0x7fbca0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:43.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.756+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbc98076bb0 con 0x7fbcac0d0ed0 2023-11-27T22:29:43.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.920+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcac15e240 con 0x7fbc9006b1c0 2023-11-27T22:29:43.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.926+0000 7fbca97fa640 1 -- 172.21.15.154:0/1956196277 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264629 (secure 0 0 0) 0x7fbca0001c90 con 0x7fbc9006b1c0 2023-11-27T22:29:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:43.933 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:43.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.929+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc9006b1c0 msgr2=0x7fbc9006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.929+0000 7fbcb3217640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc9006b1c0 0x7fbc9006d680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007fd0 tx=0x7fbca0009040 comp rx=0 tx=0).stop 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.929+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 msgr2=0x7fbcac157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.929+0000 7fbcb3217640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 0x7fbcac157ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc980098c0 tx=0x7fbc980046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 shutdown_connections 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbcac160fb0 0x7fbcac15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc9006b1c0 0x7fbc9006d680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbcac0d0ed0 0x7fbcac157ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 --2- 172.21.15.154:0/1956196277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbcac06ea50 0x7fbcac1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 >> 172.21.15.154:0/1956196277 conn(0x7fbcac06a6b0 msgr2=0x7fbcac141180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 shutdown_connections 2023-11-27T22:29:43.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:43.930+0000 7fbcb3217640 1 -- 172.21.15.154:0/1956196277 wait complete. 2023-11-27T22:29:43.943 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-27T22:29:42.962109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218888,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755832,"statfs":{"total":773094113280,"available":772869971968,"internally_reserved":0,"allocated":2793472,"data_stored":1702436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.322911"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.661119+0000","last_change":"2023-11-27T22:29:39.657258+0000","last_active":"2023-11-27T22:29:39.661119+0000","last_peered":"2023-11-27T22:29:39.661119+0000","last_clean":"2023-11-27T22:29:39.661119+0000","last_became_active":"2023-11-27T22:29:39.656994+0000","last_became_peered":"2023-11-27T22:29:39.656994+0000","last_unstale":"2023-11-27T22:29:39.661119+0000","last_undegraded":"2023-11-27T22:29:39.661119+0000","last_fullsized":"2023-11-27T22:29:39.661119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638662+0000","last_change":"2023-11-27T22:29:39.646837+0000","last_active":"2023-11-27T22:29:40.638662+0000","last_peered":"2023-11-27T22:29:40.638662+0000","last_clean":"2023-11-27T22:29:40.638662+0000","last_became_active":"2023-11-27T22:29:39.645981+0000","last_became_peered":"2023-11-27T22:29:39.645981+0000","last_unstale":"2023-11-27T22:29:40.638662+0000","last_undegraded":"2023-11-27T22:29:40.638662+0000","last_fullsized":"2023-11-27T22:29:40.638662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649839+0000","last_change":"2023-11-27T22:29:39.643286+0000","last_active":"2023-11-27T22:29:39.649839+0000","last_peered":"2023-11-27T22:29:39.649839+0000","last_clean":"2023-11-27T22:29:39.649839+0000","last_became_active":"2023-11-27T22:29:39.642812+0000","last_became_peered":"2023-11-27T22:29:39.642812+0000","last_unstale":"2023-11-27T22:29:39.649839+0000","last_undegraded":"2023-11-27T22:29:39.649839+0000","last_fullsized":"2023-11-27T22:29:39.649839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:27.497209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656607+0000","last_change":"2023-11-27T22:29:39.649850+0000","last_active":"2023-11-27T22:29:39.656607+0000","last_peered":"2023-11-27T22:29:39.656607+0000","last_clean":"2023-11-27T22:29:39.656607+0000","last_became_active":"2023-11-27T22:29:39.649553+0000","last_became_peered":"2023-11-27T22:29:39.649553+0000","last_unstale":"2023-11-27T22:29:39.656607+0000","last_undegraded":"2023-11-27T22:29:39.656607+0000","last_fullsized":"2023-11-27T22:29:39.656607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:48.631646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658302+0000","last_change":"2023-11-27T22:29:39.653809+0000","last_active":"2023-11-27T22:29:39.658302+0000","last_peered":"2023-11-27T22:29:39.658302+0000","last_clean":"2023-11-27T22:29:39.658302+0000","last_became_active":"2023-11-27T22:29:39.653442+0000","last_became_peered":"2023-11-27T22:29:39.653442+0000","last_unstale":"2023-11-27T22:29:39.658302+0000","last_undegraded":"2023-11-27T22:29:39.658302+0000","last_fullsized":"2023-11-27T22:29:39.658302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:19.641397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.657293+0000","last_change":"2023-11-27T22:29:39.650707+0000","last_active":"2023-11-27T22:29:39.657293+0000","last_peered":"2023-11-27T22:29:39.657293+0000","last_clean":"2023-11-27T22:29:39.657293+0000","last_became_active":"2023-11-27T22:29:39.649995+0000","last_became_peered":"2023-11-27T22:29:39.649995+0000","last_unstale":"2023-11-27T22:29:39.657293+0000","last_undegraded":"2023-11-27T22:29:39.657293+0000","last_fullsized":"2023-11-27T22:29:39.657293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658351+0000","last_change":"2023-11-27T22:29:39.654105+0000","last_active":"2023-11-27T22:29:39.658351+0000","last_peered":"2023-11-27T22:29:39.658351+0000","last_clean":"2023-11-27T22:29:39.658351+0000","last_became_active":"2023-11-27T22:29:39.653603+0000","last_became_peered":"2023-11-27T22:29:39.653603+0000","last_unstale":"2023-11-27T22:29:39.658351+0000","last_undegraded":"2023-11-27T22:29:39.658351+0000","last_fullsized":"2023-11-27T22:29:39.658351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637398+0000","last_change":"2023-11-27T22:29:39.654077+0000","last_active":"2023-11-27T22:29:40.637398+0000","last_peered":"2023-11-27T22:29:40.637398+0000","last_clean":"2023-11-27T22:29:40.637398+0000","last_became_active":"2023-11-27T22:29:39.653518+0000","last_became_peered":"2023-11-27T22:29:39.653518+0000","last_unstale":"2023-11-27T22:29:40.637398+0000","last_undegraded":"2023-11-27T22:29:40.637398+0000","last_fullsized":"2023-11-27T22:29:40.637398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.661137+0000","last_change":"2023-11-27T22:29:39.657910+0000","last_active":"2023-11-27T22:29:39.661137+0000","last_peered":"2023-11-27T22:29:39.661137+0000","last_clean":"2023-11-27T22:29:39.661137+0000","last_became_active":"2023-11-27T22:29:39.657639+0000","last_became_peered":"2023-11-27T22:29:39.657639+0000","last_unstale":"2023-11-27T22:29:39.661137+0000","last_undegraded":"2023-11-27T22:29:39.661137+0000","last_fullsized":"2023-11-27T22:29:39.661137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637203+0000","last_change":"2023-11-27T22:29:39.645292+0000","last_active":"2023-11-27T22:29:40.637203+0000","last_peered":"2023-11-27T22:29:40.637203+0000","last_clean":"2023-11-27T22:29:40.637203+0000","last_became_active":"2023-11-27T22:29:39.645012+0000","last_became_peered":"2023-11-27T22:29:39.645012+0000","last_unstale":"2023-11-27T22:29:40.637203+0000","last_undegraded":"2023-11-27T22:29:40.637203+0000","last_fullsized":"2023-11-27T22:29:40.637203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637000+0000","last_change":"2023-11-27T22:29:39.645072+0000","last_active":"2023-11-27T22:29:40.637000+0000","last_peered":"2023-11-27T22:29:40.637000+0000","last_clean":"2023-11-27T22:29:40.637000+0000","last_became_active":"2023-11-27T22:29:39.644771+0000","last_became_peered":"2023-11-27T22:29:39.644771+0000","last_unstale":"2023-11-27T22:29:40.637000+0000","last_undegraded":"2023-11-27T22:29:40.637000+0000","last_fullsized":"2023-11-27T22:29:40.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652523+0000","last_change":"2023-11-27T22:29:39.644172+0000","last_active":"2023-11-27T22:29:39.652523+0000","last_peered":"2023-11-27T22:29:39.652523+0000","last_clean":"2023-11-27T22:29:39.652523+0000","last_became_active":"2023-11-27T22:29:39.643298+0000","last_became_peered":"2023-11-27T22:29:39.643298+0000","last_unstale":"2023-11-27T22:29:39.652523+0000","last_undegraded":"2023-11-27T22:29:39.652523+0000","last_fullsized":"2023-11-27T22:29:39.652523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:59.672839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637594+0000","last_change":"2023-11-27T22:29:39.657540+0000","last_active":"2023-11-27T22:29:40.637594+0000","last_peered":"2023-11-27T22:29:40.637594+0000","last_clean":"2023-11-27T22:29:40.637594+0000","last_became_active":"2023-11-27T22:29:39.657283+0000","last_became_peered":"2023-11-27T22:29:39.657283+0000","last_unstale":"2023-11-27T22:29:40.637594+0000","last_undegraded":"2023-11-27T22:29:40.637594+0000","last_fullsized":"2023-11-27T22:29:40.637594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649887+0000","last_change":"2023-11-27T22:29:39.646882+0000","last_active":"2023-11-27T22:29:39.649887+0000","last_peered":"2023-11-27T22:29:39.649887+0000","last_clean":"2023-11-27T22:29:39.649887+0000","last_became_active":"2023-11-27T22:29:39.646580+0000","last_became_peered":"2023-11-27T22:29:39.646580+0000","last_unstale":"2023-11-27T22:29:39.649887+0000","last_undegraded":"2023-11-27T22:29:39.649887+0000","last_fullsized":"2023-11-27T22:29:39.649887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:22.343131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638442+0000","last_change":"2023-11-27T22:29:39.645413+0000","last_active":"2023-11-27T22:29:40.638442+0000","last_peered":"2023-11-27T22:29:40.638442+0000","last_clean":"2023-11-27T22:29:40.638442+0000","last_became_active":"2023-11-27T22:29:39.645150+0000","last_became_peered":"2023-11-27T22:29:39.645150+0000","last_unstale":"2023-11-27T22:29:40.638442+0000","last_undegraded":"2023-11-27T22:29:40.638442+0000","last_fullsized":"2023-11-27T22:29:40.638442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656759+0000","last_change":"2023-11-27T22:29:39.650165+0000","last_active":"2023-11-27T22:29:39.656759+0000","last_peered":"2023-11-27T22:29:39.656759+0000","last_clean":"2023-11-27T22:29:39.656759+0000","last_became_active":"2023-11-27T22:29:39.649783+0000","last_became_peered":"2023-11-27T22:29:39.649783+0000","last_unstale":"2023-11-27T22:29:39.656759+0000","last_undegraded":"2023-11-27T22:29:39.656759+0000","last_fullsized":"2023-11-27T22:29:39.656759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658233+0000","last_change":"2023-11-27T22:29:39.654571+0000","last_active":"2023-11-27T22:29:39.658233+0000","last_peered":"2023-11-27T22:29:39.658233+0000","last_clean":"2023-11-27T22:29:39.658233+0000","last_became_active":"2023-11-27T22:29:39.654278+0000","last_became_peered":"2023-11-27T22:29:39.654278+0000","last_unstale":"2023-11-27T22:29:39.658233+0000","last_undegraded":"2023-11-27T22:29:39.658233+0000","last_fullsized":"2023-11-27T22:29:39.658233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:37.746015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765150+0000","last_change":"2023-11-27T22:29:39.648168+0000","last_active":"2023-11-27T22:29:40.765150+0000","last_peered":"2023-11-27T22:29:40.765150+0000","last_clean":"2023-11-27T22:29:40.765150+0000","last_became_active":"2023-11-27T22:29:39.647900+0000","last_became_peered":"2023-11-27T22:29:39.647900+0000","last_unstale":"2023-11-27T22:29:40.765150+0000","last_undegraded":"2023-11-27T22:29:40.765150+0000","last_fullsized":"2023-11-27T22:29:40.765150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.660999+0000","last_change":"2023-11-27T22:29:39.655501+0000","last_active":"2023-11-27T22:29:39.660999+0000","last_peered":"2023-11-27T22:29:39.660999+0000","last_clean":"2023-11-27T22:29:39.660999+0000","last_became_active":"2023-11-27T22:29:39.655220+0000","last_became_peered":"2023-11-27T22:29:39.655220+0000","last_unstale":"2023-11-27T22:29:39.660999+0000","last_undegraded":"2023-11-27T22:29:39.660999+0000","last_fullsized":"2023-11-27T22:29:39.660999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636971+0000","last_change":"2023-11-27T22:29:39.645941+0000","last_active":"2023-11-27T22:29:40.636971+0000","last_peered":"2023-11-27T22:29:40.636971+0000","last_clean":"2023-11-27T22:29:40.636971+0000","last_became_active":"2023-11-27T22:29:39.645663+0000","last_became_peered":"2023-11-27T22:29:39.645663+0000","last_unstale":"2023-11-27T22:29:40.636971+0000","last_undegraded":"2023-11-27T22:29:40.636971+0000","last_fullsized":"2023-11-27T22:29:40.636971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656950+0000","last_change":"2023-11-27T22:29:39.655808+0000","last_active":"2023-11-27T22:29:39.656950+0000","last_peered":"2023-11-27T22:29:39.656950+0000","last_clean":"2023-11-27T22:29:39.656950+0000","last_became_active":"2023-11-27T22:29:39.655505+0000","last_became_peered":"2023-11-27T22:29:39.655505+0000","last_unstale":"2023-11-27T22:29:39.656950+0000","last_undegraded":"2023-11-27T22:29:39.656950+0000","last_fullsized":"2023-11-27T22:29:39.656950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658048+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:39.658048+0000","last_peered":"2023-11-27T22:29:39.658048+0000","last_clean":"2023-11-27T22:29:39.658048+0000","last_became_active":"2023-11-27T22:29:39.654007+0000","last_became_peered":"2023-11-27T22:29:39.654007+0000","last_unstale":"2023-11-27T22:29:39.658048+0000","last_undegraded":"2023-11-27T22:29:39.658048+0000","last_fullsized":"2023-11-27T22:29:39.658048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:52.858990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637799+0000","last_change":"2023-11-27T22:29:39.648110+0000","last_active":"2023-11-27T22:29:40.637799+0000","last_peered":"2023-11-27T22:29:40.637799+0000","last_clean":"2023-11-27T22:29:40.637799+0000","last_became_active":"2023-11-27T22:29:39.647846+0000","last_became_peered":"2023-11-27T22:29:39.647846+0000","last_unstale":"2023-11-27T22:29:40.637799+0000","last_undegraded":"2023-11-27T22:29:40.637799+0000","last_fullsized":"2023-11-27T22:29:40.637799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656622+0000","last_change":"2023-11-27T22:29:39.649954+0000","last_active":"2023-11-27T22:29:39.656622+0000","last_peered":"2023-11-27T22:29:39.656622+0000","last_clean":"2023-11-27T22:29:39.656622+0000","last_became_active":"2023-11-27T22:29:39.649652+0000","last_became_peered":"2023-11-27T22:29:39.649652+0000","last_unstale":"2023-11-27T22:29:39.656622+0000","last_undegraded":"2023-11-27T22:29:39.656622+0000","last_fullsized":"2023-11-27T22:29:39.656622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:19.641397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637719+0000","last_change":"2023-11-27T22:29:39.649200+0000","last_active":"2023-11-27T22:29:40.637719+0000","last_peered":"2023-11-27T22:29:40.637719+0000","last_clean":"2023-11-27T22:29:40.637719+0000","last_became_active":"2023-11-27T22:29:39.648825+0000","last_became_peered":"2023-11-27T22:29:39.648825+0000","last_unstale":"2023-11-27T22:29:40.637719+0000","last_undegraded":"2023-11-27T22:29:40.637719+0000","last_fullsized":"2023-11-27T22:29:40.637719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637255+0000","last_change":"2023-11-27T22:29:39.654267+0000","last_active":"2023-11-27T22:29:40.637255+0000","last_peered":"2023-11-27T22:29:40.637255+0000","last_clean":"2023-11-27T22:29:40.637255+0000","last_became_active":"2023-11-27T22:29:39.654008+0000","last_became_peered":"2023-11-27T22:29:39.654008+0000","last_unstale":"2023-11-27T22:29:40.637255+0000","last_undegraded":"2023-11-27T22:29:40.637255+0000","last_fullsized":"2023-11-27T22:29:40.637255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638583+0000","last_change":"2023-11-27T22:29:39.647097+0000","last_active":"2023-11-27T22:29:40.638583+0000","last_peered":"2023-11-27T22:29:40.638583+0000","last_clean":"2023-11-27T22:29:40.638583+0000","last_became_active":"2023-11-27T22:29:39.646828+0000","last_became_peered":"2023-11-27T22:29:39.646828+0000","last_unstale":"2023-11-27T22:29:40.638583+0000","last_undegraded":"2023-11-27T22:29:40.638583+0000","last_fullsized":"2023-11-27T22:29:40.638583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637906+0000","last_change":"2023-11-27T22:29:39.653574+0000","last_active":"2023-11-27T22:29:40.637906+0000","last_peered":"2023-11-27T22:29:40.637906+0000","last_clean":"2023-11-27T22:29:40.637906+0000","last_became_active":"2023-11-27T22:29:39.653270+0000","last_became_peered":"2023-11-27T22:29:39.653270+0000","last_unstale":"2023-11-27T22:29:40.637906+0000","last_undegraded":"2023-11-27T22:29:40.637906+0000","last_fullsized":"2023-11-27T22:29:40.637906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.651067+0000","last_change":"2023-11-27T22:29:39.648704+0000","last_active":"2023-11-27T22:29:39.651067+0000","last_peered":"2023-11-27T22:29:39.651067+0000","last_clean":"2023-11-27T22:29:39.651067+0000","last_became_active":"2023-11-27T22:29:39.648254+0000","last_became_peered":"2023-11-27T22:29:39.648254+0000","last_unstale":"2023-11-27T22:29:39.651067+0000","last_undegraded":"2023-11-27T22:29:39.651067+0000","last_fullsized":"2023-11-27T22:29:39.651067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656418+0000","last_change":"2023-11-27T22:29:39.648662+0000","last_active":"2023-11-27T22:29:39.656418+0000","last_peered":"2023-11-27T22:29:39.656418+0000","last_clean":"2023-11-27T22:29:39.656418+0000","last_became_active":"2023-11-27T22:29:39.647607+0000","last_became_peered":"2023-11-27T22:29:39.647607+0000","last_unstale":"2023-11-27T22:29:39.656418+0000","last_undegraded":"2023-11-27T22:29:39.656418+0000","last_fullsized":"2023-11-27T22:29:39.656418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:40.311650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765029+0000","last_change":"2023-11-27T22:29:39.646354+0000","last_active":"2023-11-27T22:29:40.765029+0000","last_peered":"2023-11-27T22:29:40.765029+0000","last_clean":"2023-11-27T22:29:40.765029+0000","last_became_active":"2023-11-27T22:29:39.646090+0000","last_became_peered":"2023-11-27T22:29:39.646090+0000","last_unstale":"2023-11-27T22:29:40.765029+0000","last_undegraded":"2023-11-27T22:29:40.765029+0000","last_fullsized":"2023-11-27T22:29:40.765029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636897+0000","last_change":"2023-11-27T22:29:39.649555+0000","last_active":"2023-11-27T22:29:40.636897+0000","last_peered":"2023-11-27T22:29:40.636897+0000","last_clean":"2023-11-27T22:29:40.636897+0000","last_became_active":"2023-11-27T22:29:39.649055+0000","last_became_peered":"2023-11-27T22:29:39.649055+0000","last_unstale":"2023-11-27T22:29:40.636897+0000","last_undegraded":"2023-11-27T22:29:40.636897+0000","last_fullsized":"2023-11-27T22:29:40.636897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658807+0000","last_change":"2023-11-27T22:29:39.651646+0000","last_active":"2023-11-27T22:29:39.658807+0000","last_peered":"2023-11-27T22:29:39.658807+0000","last_clean":"2023-11-27T22:29:39.658807+0000","last_became_active":"2023-11-27T22:29:39.651358+0000","last_became_peered":"2023-11-27T22:29:39.651358+0000","last_unstale":"2023-11-27T22:29:39.658807+0000","last_undegraded":"2023-11-27T22:29:39.658807+0000","last_fullsized":"2023-11-27T22:29:39.658807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:40.311650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637683+0000","last_change":"2023-11-27T22:29:38.663887+0000","last_active":"2023-11-27T22:29:40.637683+0000","last_peered":"2023-11-27T22:29:40.637683+0000","last_clean":"2023-11-27T22:29:40.637683+0000","last_became_active":"2023-11-27T22:29:38.662995+0000","last_became_peered":"2023-11-27T22:29:38.662995+0000","last_unstale":"2023-11-27T22:29:40.637683+0000","last_undegraded":"2023-11-27T22:29:40.637683+0000","last_fullsized":"2023-11-27T22:29:40.637683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649912+0000","last_change":"2023-11-27T22:29:39.644876+0000","last_active":"2023-11-27T22:29:39.649912+0000","last_peered":"2023-11-27T22:29:39.649912+0000","last_clean":"2023-11-27T22:29:39.649912+0000","last_became_active":"2023-11-27T22:29:39.644470+0000","last_became_peered":"2023-11-27T22:29:39.644470+0000","last_unstale":"2023-11-27T22:29:39.649912+0000","last_undegraded":"2023-11-27T22:29:39.649912+0000","last_fullsized":"2023-11-27T22:29:39.649912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:50:16.238678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636788+0000","last_change":"2023-11-27T22:29:38.659425+0000","last_active":"2023-11-27T22:29:40.636788+0000","last_peered":"2023-11-27T22:29:40.636788+0000","last_clean":"2023-11-27T22:29:40.636788+0000","last_became_active":"2023-11-27T22:29:38.659091+0000","last_became_peered":"2023-11-27T22:29:38.659091+0000","last_unstale":"2023-11-27T22:29:40.636788+0000","last_undegraded":"2023-11-27T22:29:40.636788+0000","last_fullsized":"2023-11-27T22:29:40.636788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637460+0000","last_change":"2023-11-27T22:29:38.658068+0000","last_active":"2023-11-27T22:29:40.637460+0000","last_peered":"2023-11-27T22:29:40.637460+0000","last_clean":"2023-11-27T22:29:40.637460+0000","last_became_active":"2023-11-27T22:29:38.657688+0000","last_became_peered":"2023-11-27T22:29:38.657688+0000","last_unstale":"2023-11-27T22:29:40.637460+0000","last_undegraded":"2023-11-27T22:29:40.637460+0000","last_fullsized":"2023-11-27T22:29:40.637460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637464+0000","last_change":"2023-11-27T22:29:39.651687+0000","last_active":"2023-11-27T22:29:40.637464+0000","last_peered":"2023-11-27T22:29:40.637464+0000","last_clean":"2023-11-27T22:29:40.637464+0000","last_became_active":"2023-11-27T22:29:39.651383+0000","last_became_peered":"2023-11-27T22:29:39.651383+0000","last_unstale":"2023-11-27T22:29:40.637464+0000","last_undegraded":"2023-11-27T22:29:40.637464+0000","last_fullsized":"2023-11-27T22:29:40.637464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640454+0000","last_change":"2023-11-27T22:29:38.656782+0000","last_active":"2023-11-27T22:29:39.640454+0000","last_peered":"2023-11-27T22:29:39.640454+0000","last_clean":"2023-11-27T22:29:39.640454+0000","last_became_active":"2023-11-27T22:29:38.656527+0000","last_became_peered":"2023-11-27T22:29:38.656527+0000","last_unstale":"2023-11-27T22:29:39.640454+0000","last_undegraded":"2023-11-27T22:29:39.640454+0000","last_fullsized":"2023-11-27T22:29:39.640454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638394+0000","last_change":"2023-11-27T22:29:39.646862+0000","last_active":"2023-11-27T22:29:40.638394+0000","last_peered":"2023-11-27T22:29:40.638394+0000","last_clean":"2023-11-27T22:29:40.638394+0000","last_became_active":"2023-11-27T22:29:39.644502+0000","last_became_peered":"2023-11-27T22:29:39.644502+0000","last_unstale":"2023-11-27T22:29:40.638394+0000","last_undegraded":"2023-11-27T22:29:40.638394+0000","last_fullsized":"2023-11-27T22:29:40.638394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636966+0000","last_change":"2023-11-27T22:29:38.656824+0000","last_active":"2023-11-27T22:29:40.636966+0000","last_peered":"2023-11-27T22:29:40.636966+0000","last_clean":"2023-11-27T22:29:40.636966+0000","last_became_active":"2023-11-27T22:29:38.656542+0000","last_became_peered":"2023-11-27T22:29:38.656542+0000","last_unstale":"2023-11-27T22:29:40.636966+0000","last_undegraded":"2023-11-27T22:29:40.636966+0000","last_fullsized":"2023-11-27T22:29:40.636966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.660797+0000","last_change":"2023-11-27T22:29:39.656332+0000","last_active":"2023-11-27T22:29:39.660797+0000","last_peered":"2023-11-27T22:29:39.660797+0000","last_clean":"2023-11-27T22:29:39.660797+0000","last_became_active":"2023-11-27T22:29:39.654860+0000","last_became_peered":"2023-11-27T22:29:39.654860+0000","last_unstale":"2023-11-27T22:29:39.660797+0000","last_undegraded":"2023-11-27T22:29:39.660797+0000","last_fullsized":"2023-11-27T22:29:39.660797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.641823+0000","last_change":"2023-11-27T22:29:38.661962+0000","last_active":"2023-11-27T22:29:39.641823+0000","last_peered":"2023-11-27T22:29:39.641823+0000","last_clean":"2023-11-27T22:29:39.641823+0000","last_became_active":"2023-11-27T22:29:38.661221+0000","last_became_peered":"2023-11-27T22:29:38.661221+0000","last_unstale":"2023-11-27T22:29:39.641823+0000","last_undegraded":"2023-11-27T22:29:39.641823+0000","last_fullsized":"2023-11-27T22:29:39.641823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:02.332894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.650757+0000","last_change":"2023-11-27T22:29:39.644743+0000","last_active":"2023-11-27T22:29:39.650757+0000","last_peered":"2023-11-27T22:29:39.650757+0000","last_clean":"2023-11-27T22:29:39.650757+0000","last_became_active":"2023-11-27T22:29:39.644482+0000","last_became_peered":"2023-11-27T22:29:39.644482+0000","last_unstale":"2023-11-27T22:29:39.650757+0000","last_undegraded":"2023-11-27T22:29:39.650757+0000","last_fullsized":"2023-11-27T22:29:39.650757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:05:40.311650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638586+0000","last_change":"2023-11-27T22:29:38.657621+0000","last_active":"2023-11-27T22:29:40.638586+0000","last_peered":"2023-11-27T22:29:40.638586+0000","last_clean":"2023-11-27T22:29:40.638586+0000","last_became_active":"2023-11-27T22:29:38.657362+0000","last_became_peered":"2023-11-27T22:29:38.657362+0000","last_unstale":"2023-11-27T22:29:40.638586+0000","last_undegraded":"2023-11-27T22:29:40.638586+0000","last_fullsized":"2023-11-27T22:29:40.638586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.660921+0000","last_change":"2023-11-27T22:29:39.654893+0000","last_active":"2023-11-27T22:29:39.660921+0000","last_peered":"2023-11-27T22:29:39.660921+0000","last_clean":"2023-11-27T22:29:39.660921+0000","last_became_active":"2023-11-27T22:29:39.654615+0000","last_became_peered":"2023-11-27T22:29:39.654615+0000","last_unstale":"2023-11-27T22:29:39.660921+0000","last_undegraded":"2023-11-27T22:29:39.660921+0000","last_fullsized":"2023-11-27T22:29:39.660921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:52.858990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637012+0000","last_change":"2023-11-27T22:29:38.659143+0000","last_active":"2023-11-27T22:29:40.637012+0000","last_peered":"2023-11-27T22:29:40.637012+0000","last_clean":"2023-11-27T22:29:40.637012+0000","last_became_active":"2023-11-27T22:29:38.658790+0000","last_became_peered":"2023-11-27T22:29:38.658790+0000","last_unstale":"2023-11-27T22:29:40.637012+0000","last_undegraded":"2023-11-27T22:29:40.637012+0000","last_fullsized":"2023-11-27T22:29:40.637012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658274+0000","last_change":"2023-11-27T22:29:39.654060+0000","last_active":"2023-11-27T22:29:39.658274+0000","last_peered":"2023-11-27T22:29:39.658274+0000","last_clean":"2023-11-27T22:29:39.658274+0000","last_became_active":"2023-11-27T22:29:39.653483+0000","last_became_peered":"2023-11-27T22:29:39.653483+0000","last_unstale":"2023-11-27T22:29:39.658274+0000","last_undegraded":"2023-11-27T22:29:39.658274+0000","last_fullsized":"2023-11-27T22:29:39.658274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.680884+0000","last_change":"2023-11-27T22:29:38.660084+0000","last_active":"2023-11-27T22:29:39.680884+0000","last_peered":"2023-11-27T22:29:39.680884+0000","last_clean":"2023-11-27T22:29:39.680884+0000","last_became_active":"2023-11-27T22:29:38.659648+0000","last_became_peered":"2023-11-27T22:29:38.659648+0000","last_unstale":"2023-11-27T22:29:39.680884+0000","last_undegraded":"2023-11-27T22:29:39.680884+0000","last_fullsized":"2023-11-27T22:29:39.680884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656349+0000","last_change":"2023-11-27T22:29:39.654365+0000","last_active":"2023-11-27T22:29:39.656349+0000","last_peered":"2023-11-27T22:29:39.656349+0000","last_clean":"2023-11-27T22:29:39.656349+0000","last_became_active":"2023-11-27T22:29:39.654080+0000","last_became_peered":"2023-11-27T22:29:39.654080+0000","last_unstale":"2023-11-27T22:29:39.656349+0000","last_undegraded":"2023-11-27T22:29:39.656349+0000","last_fullsized":"2023-11-27T22:29:39.656349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:59.672839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640429+0000","last_change":"2023-11-27T22:29:38.661785+0000","last_active":"2023-11-27T22:29:39.640429+0000","last_peered":"2023-11-27T22:29:39.640429+0000","last_clean":"2023-11-27T22:29:39.640429+0000","last_became_active":"2023-11-27T22:29:38.661129+0000","last_became_peered":"2023-11-27T22:29:38.661129+0000","last_unstale":"2023-11-27T22:29:39.640429+0000","last_undegraded":"2023-11-27T22:29:39.640429+0000","last_fullsized":"2023-11-27T22:29:39.640429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658322+0000","last_change":"2023-11-27T22:29:39.654846+0000","last_active":"2023-11-27T22:29:39.658322+0000","last_peered":"2023-11-27T22:29:39.658322+0000","last_clean":"2023-11-27T22:29:39.658322+0000","last_became_active":"2023-11-27T22:29:39.654042+0000","last_became_peered":"2023-11-27T22:29:39.654042+0000","last_unstale":"2023-11-27T22:29:39.658322+0000","last_undegraded":"2023-11-27T22:29:39.658322+0000","last_fullsized":"2023-11-27T22:29:39.658322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636721+0000","last_change":"2023-11-27T22:29:38.658756+0000","last_active":"2023-11-27T22:29:40.636721+0000","last_peered":"2023-11-27T22:29:40.636721+0000","last_clean":"2023-11-27T22:29:40.636721+0000","last_became_active":"2023-11-27T22:29:38.658475+0000","last_became_peered":"2023-11-27T22:29:38.658475+0000","last_unstale":"2023-11-27T22:29:40.636721+0000","last_undegraded":"2023-11-27T22:29:40.636721+0000","last_fullsized":"2023-11-27T22:29:40.636721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636767+0000","last_change":"2023-11-27T22:29:39.649309+0000","last_active":"2023-11-27T22:29:40.636767+0000","last_peered":"2023-11-27T22:29:40.636767+0000","last_clean":"2023-11-27T22:29:40.636767+0000","last_became_active":"2023-11-27T22:29:39.648695+0000","last_became_peered":"2023-11-27T22:29:39.648695+0000","last_unstale":"2023-11-27T22:29:40.636767+0000","last_undegraded":"2023-11-27T22:29:40.636767+0000","last_fullsized":"2023-11-27T22:29:40.636767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.764988+0000","last_change":"2023-11-27T22:29:38.654789+0000","last_active":"2023-11-27T22:29:40.764988+0000","last_peered":"2023-11-27T22:29:40.764988+0000","last_clean":"2023-11-27T22:29:40.764988+0000","last_became_active":"2023-11-27T22:29:38.654453+0000","last_became_peered":"2023-11-27T22:29:38.654453+0000","last_unstale":"2023-11-27T22:29:40.764988+0000","last_undegraded":"2023-11-27T22:29:40.764988+0000","last_fullsized":"2023-11-27T22:29:40.764988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:58.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658368+0000","last_change":"2023-11-27T22:29:39.654661+0000","last_active":"2023-11-27T22:29:39.658368+0000","last_peered":"2023-11-27T22:29:39.658368+0000","last_clean":"2023-11-27T22:29:39.658368+0000","last_became_active":"2023-11-27T22:29:39.654269+0000","last_became_peered":"2023-11-27T22:29:39.654269+0000","last_unstale":"2023-11-27T22:29:39.658368+0000","last_undegraded":"2023-11-27T22:29:39.658368+0000","last_fullsized":"2023-11-27T22:29:39.658368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.674838+0000","last_change":"2023-11-27T22:29:38.658036+0000","last_active":"2023-11-27T22:29:39.674838+0000","last_peered":"2023-11-27T22:29:39.674838+0000","last_clean":"2023-11-27T22:29:39.674838+0000","last_became_active":"2023-11-27T22:29:38.657748+0000","last_became_peered":"2023-11-27T22:29:38.657748+0000","last_unstale":"2023-11-27T22:29:39.674838+0000","last_undegraded":"2023-11-27T22:29:39.674838+0000","last_fullsized":"2023-11-27T22:29:39.674838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:26.492362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.666221+0000","last_change":"2023-11-27T22:29:39.659240+0000","last_active":"2023-11-27T22:29:39.666221+0000","last_peered":"2023-11-27T22:29:39.666221+0000","last_clean":"2023-11-27T22:29:39.666221+0000","last_became_active":"2023-11-27T22:29:39.658986+0000","last_became_peered":"2023-11-27T22:29:39.658986+0000","last_unstale":"2023-11-27T22:29:39.666221+0000","last_undegraded":"2023-11-27T22:29:39.666221+0000","last_fullsized":"2023-11-27T22:29:39.666221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765118+0000","last_change":"2023-11-27T22:29:38.660926+0000","last_active":"2023-11-27T22:29:40.765118+0000","last_peered":"2023-11-27T22:29:40.765118+0000","last_clean":"2023-11-27T22:29:40.765118+0000","last_became_active":"2023-11-27T22:29:38.660662+0000","last_became_peered":"2023-11-27T22:29:38.660662+0000","last_unstale":"2023-11-27T22:29:40.765118+0000","last_undegraded":"2023-11-27T22:29:40.765118+0000","last_fullsized":"2023-11-27T22:29:40.765118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:41.693347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.666297+0000","last_change":"2023-11-27T22:29:39.659397+0000","last_active":"2023-11-27T22:29:39.666297+0000","last_peered":"2023-11-27T22:29:39.666297+0000","last_clean":"2023-11-27T22:29:39.666297+0000","last_became_active":"2023-11-27T22:29:39.658970+0000","last_became_peered":"2023-11-27T22:29:39.658970+0000","last_unstale":"2023-11-27T22:29:39.666297+0000","last_undegraded":"2023-11-27T22:29:39.666297+0000","last_fullsized":"2023-11-27T22:29:39.666297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638663+0000","last_change":"2023-11-27T22:29:38.654389+0000","last_active":"2023-11-27T22:29:40.638663+0000","last_peered":"2023-11-27T22:29:40.638663+0000","last_clean":"2023-11-27T22:29:40.638663+0000","last_became_active":"2023-11-27T22:29:38.654116+0000","last_became_peered":"2023-11-27T22:29:38.654116+0000","last_unstale":"2023-11-27T22:29:40.638663+0000","last_undegraded":"2023-11-27T22:29:40.638663+0000","last_fullsized":"2023-11-27T22:29:40.638663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.656585+0000","last_change":"2023-11-27T22:29:39.649308+0000","last_active":"2023-11-27T22:29:39.656585+0000","last_peered":"2023-11-27T22:29:39.656585+0000","last_clean":"2023-11-27T22:29:39.656585+0000","last_became_active":"2023-11-27T22:29:39.648915+0000","last_became_peered":"2023-11-27T22:29:39.648915+0000","last_unstale":"2023-11-27T22:29:39.656585+0000","last_undegraded":"2023-11-27T22:29:39.656585+0000","last_fullsized":"2023-11-27T22:29:39.656585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:22.343131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765138+0000","last_change":"2023-11-27T22:29:38.661956+0000","last_active":"2023-11-27T22:29:40.765138+0000","last_peered":"2023-11-27T22:29:40.765138+0000","last_clean":"2023-11-27T22:29:40.765138+0000","last_became_active":"2023-11-27T22:29:38.661660+0000","last_became_peered":"2023-11-27T22:29:38.661660+0000","last_unstale":"2023-11-27T22:29:40.765138+0000","last_undegraded":"2023-11-27T22:29:40.765138+0000","last_fullsized":"2023-11-27T22:29:40.765138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:51.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.661021+0000","last_change":"2023-11-27T22:29:39.655710+0000","last_active":"2023-11-27T22:29:39.661021+0000","last_peered":"2023-11-27T22:29:39.661021+0000","last_clean":"2023-11-27T22:29:39.661021+0000","last_became_active":"2023-11-27T22:29:39.654385+0000","last_became_peered":"2023-11-27T22:29:39.654385+0000","last_unstale":"2023-11-27T22:29:39.661021+0000","last_undegraded":"2023-11-27T22:29:39.661021+0000","last_fullsized":"2023-11-27T22:29:39.661021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-27T22:29:38.657100+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:38.657100+0000","last_peered":"2023-11-27T22:29:38.657100+0000","last_clean":"2023-11-27T22:29:38.657100+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:38.657100+0000","last_undegraded":"2023-11-27T22:29:38.657100+0000","last_fullsized":"2023-11-27T22:29:38.657100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640506+0000","last_change":"2023-11-27T22:29:38.656156+0000","last_active":"2023-11-27T22:29:39.640506+0000","last_peered":"2023-11-27T22:29:39.640506+0000","last_clean":"2023-11-27T22:29:39.640506+0000","last_became_active":"2023-11-27T22:29:38.655859+0000","last_became_peered":"2023-11-27T22:29:38.655859+0000","last_unstale":"2023-11-27T22:29:39.640506+0000","last_undegraded":"2023-11-27T22:29:39.640506+0000","last_fullsized":"2023-11-27T22:29:39.640506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637872+0000","last_change":"2023-11-27T22:29:39.653299+0000","last_active":"2023-11-27T22:29:40.637872+0000","last_peered":"2023-11-27T22:29:40.637872+0000","last_clean":"2023-11-27T22:29:40.637872+0000","last_became_active":"2023-11-27T22:29:39.653033+0000","last_became_peered":"2023-11-27T22:29:39.653033+0000","last_unstale":"2023-11-27T22:29:40.637872+0000","last_undegraded":"2023-11-27T22:29:40.637872+0000","last_fullsized":"2023-11-27T22:29:40.637872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.642321+0000","last_change":"2023-11-27T22:29:38.664007+0000","last_active":"2023-11-27T22:29:39.642321+0000","last_peered":"2023-11-27T22:29:39.642321+0000","last_clean":"2023-11-27T22:29:39.642321+0000","last_became_active":"2023-11-27T22:29:38.663462+0000","last_became_peered":"2023-11-27T22:29:38.663462+0000","last_unstale":"2023-11-27T22:29:39.642321+0000","last_undegraded":"2023-11-27T22:29:39.642321+0000","last_fullsized":"2023-11-27T22:29:39.642321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649855+0000","last_change":"2023-11-27T22:29:39.646086+0000","last_active":"2023-11-27T22:29:39.649855+0000","last_peered":"2023-11-27T22:29:39.649855+0000","last_clean":"2023-11-27T22:29:39.649855+0000","last_became_active":"2023-11-27T22:29:39.645812+0000","last_became_peered":"2023-11-27T22:29:39.645812+0000","last_unstale":"2023-11-27T22:29:39.649855+0000","last_undegraded":"2023-11-27T22:29:39.649855+0000","last_fullsized":"2023-11-27T22:29:39.649855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:52.858990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765072+0000","last_change":"2023-11-27T22:29:38.660283+0000","last_active":"2023-11-27T22:29:40.765072+0000","last_peered":"2023-11-27T22:29:40.765072+0000","last_clean":"2023-11-27T22:29:40.765072+0000","last_became_active":"2023-11-27T22:29:38.658807+0000","last_became_peered":"2023-11-27T22:29:38.658807+0000","last_unstale":"2023-11-27T22:29:40.765072+0000","last_undegraded":"2023-11-27T22:29:40.765072+0000","last_fullsized":"2023-11-27T22:29:40.765072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638421+0000","last_change":"2023-11-27T22:29:39.644925+0000","last_active":"2023-11-27T22:29:40.638421+0000","last_peered":"2023-11-27T22:29:40.638421+0000","last_clean":"2023-11-27T22:29:40.638421+0000","last_became_active":"2023-11-27T22:29:39.644678+0000","last_became_peered":"2023-11-27T22:29:39.644678+0000","last_unstale":"2023-11-27T22:29:40.638421+0000","last_undegraded":"2023-11-27T22:29:40.638421+0000","last_fullsized":"2023-11-27T22:29:40.638421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.640486+0000","last_change":"2023-11-27T22:29:38.662139+0000","last_active":"2023-11-27T22:29:39.640486+0000","last_peered":"2023-11-27T22:29:39.640486+0000","last_clean":"2023-11-27T22:29:39.640486+0000","last_became_active":"2023-11-27T22:29:38.661432+0000","last_became_peered":"2023-11-27T22:29:38.661432+0000","last_unstale":"2023-11-27T22:29:39.640486+0000","last_undegraded":"2023-11-27T22:29:39.640486+0000","last_fullsized":"2023-11-27T22:29:39.640486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.658782+0000","last_change":"2023-11-27T22:29:39.651435+0000","last_active":"2023-11-27T22:29:39.658782+0000","last_peered":"2023-11-27T22:29:39.658782+0000","last_clean":"2023-11-27T22:29:39.658782+0000","last_became_active":"2023-11-27T22:29:39.651172+0000","last_became_peered":"2023-11-27T22:29:39.651172+0000","last_unstale":"2023-11-27T22:29:39.658782+0000","last_undegraded":"2023-11-27T22:29:39.658782+0000","last_fullsized":"2023-11-27T22:29:39.658782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:22.343131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638530+0000","last_change":"2023-11-27T22:29:38.653717+0000","last_active":"2023-11-27T22:29:40.638530+0000","last_peered":"2023-11-27T22:29:40.638530+0000","last_clean":"2023-11-27T22:29:40.638530+0000","last_became_active":"2023-11-27T22:29:38.653432+0000","last_became_peered":"2023-11-27T22:29:38.653432+0000","last_unstale":"2023-11-27T22:29:40.638530+0000","last_undegraded":"2023-11-27T22:29:40.638530+0000","last_fullsized":"2023-11-27T22:29:40.638530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:07.717011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.657265+0000","last_change":"2023-11-27T22:29:39.650521+0000","last_active":"2023-11-27T22:29:39.657265+0000","last_peered":"2023-11-27T22:29:39.657265+0000","last_clean":"2023-11-27T22:29:39.657265+0000","last_became_active":"2023-11-27T22:29:39.650292+0000","last_became_peered":"2023-11-27T22:29:39.650292+0000","last_unstale":"2023-11-27T22:29:39.657265+0000","last_undegraded":"2023-11-27T22:29:39.657265+0000","last_fullsized":"2023-11-27T22:29:39.657265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.644189+0000","last_change":"2023-11-27T22:29:38.664144+0000","last_active":"2023-11-27T22:29:39.644189+0000","last_peered":"2023-11-27T22:29:39.644189+0000","last_clean":"2023-11-27T22:29:39.644189+0000","last_became_active":"2023-11-27T22:29:38.663854+0000","last_became_peered":"2023-11-27T22:29:38.663854+0000","last_unstale":"2023-11-27T22:29:39.644189+0000","last_undegraded":"2023-11-27T22:29:39.644189+0000","last_fullsized":"2023-11-27T22:29:39.644189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638533+0000","last_change":"2023-11-27T22:29:39.645029+0000","last_active":"2023-11-27T22:29:40.638533+0000","last_peered":"2023-11-27T22:29:40.638533+0000","last_clean":"2023-11-27T22:29:40.638533+0000","last_became_active":"2023-11-27T22:29:39.644767+0000","last_became_peered":"2023-11-27T22:29:39.644767+0000","last_unstale":"2023-11-27T22:29:40.638533+0000","last_undegraded":"2023-11-27T22:29:40.638533+0000","last_fullsized":"2023-11-27T22:29:40.638533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638693+0000","last_change":"2023-11-27T22:29:38.655124+0000","last_active":"2023-11-27T22:29:40.638693+0000","last_peered":"2023-11-27T22:29:40.638693+0000","last_clean":"2023-11-27T22:29:40.638693+0000","last_became_active":"2023-11-27T22:29:38.654557+0000","last_became_peered":"2023-11-27T22:29:38.654557+0000","last_unstale":"2023-11-27T22:29:40.638693+0000","last_undegraded":"2023-11-27T22:29:40.638693+0000","last_fullsized":"2023-11-27T22:29:40.638693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637851+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:40.637851+0000","last_peered":"2023-11-27T22:29:40.637851+0000","last_clean":"2023-11-27T22:29:40.637851+0000","last_became_active":"2023-11-27T22:29:39.654060+0000","last_became_peered":"2023-11-27T22:29:39.654060+0000","last_unstale":"2023-11-27T22:29:40.637851+0000","last_undegraded":"2023-11-27T22:29:40.637851+0000","last_fullsized":"2023-11-27T22:29:40.637851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637133+0000","last_change":"2023-11-27T22:29:38.662202+0000","last_active":"2023-11-27T22:29:40.637133+0000","last_peered":"2023-11-27T22:29:40.637133+0000","last_clean":"2023-11-27T22:29:40.637133+0000","last_became_active":"2023-11-27T22:29:38.661712+0000","last_became_peered":"2023-11-27T22:29:38.661712+0000","last_unstale":"2023-11-27T22:29:40.637133+0000","last_undegraded":"2023-11-27T22:29:40.637133+0000","last_fullsized":"2023-11-27T22:29:40.637133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.649233+0000","last_change":"2023-11-27T22:29:39.643007+0000","last_active":"2023-11-27T22:29:39.649233+0000","last_peered":"2023-11-27T22:29:39.649233+0000","last_clean":"2023-11-27T22:29:39.649233+0000","last_became_active":"2023-11-27T22:29:39.642647+0000","last_became_peered":"2023-11-27T22:29:39.642647+0000","last_unstale":"2023-11-27T22:29:39.649233+0000","last_undegraded":"2023-11-27T22:29:39.649233+0000","last_fullsized":"2023-11-27T22:29:39.649233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.644519+0000","last_change":"2023-11-27T22:29:38.664234+0000","last_active":"2023-11-27T22:29:39.644519+0000","last_peered":"2023-11-27T22:29:39.644519+0000","last_clean":"2023-11-27T22:29:39.644519+0000","last_became_active":"2023-11-27T22:29:38.663863+0000","last_became_peered":"2023-11-27T22:29:38.663863+0000","last_unstale":"2023-11-27T22:29:39.644519+0000","last_undegraded":"2023-11-27T22:29:39.644519+0000","last_fullsized":"2023-11-27T22:29:39.644519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652470+0000","last_change":"2023-11-27T22:29:39.644164+0000","last_active":"2023-11-27T22:29:39.652470+0000","last_peered":"2023-11-27T22:29:39.652470+0000","last_clean":"2023-11-27T22:29:39.652470+0000","last_became_active":"2023-11-27T22:29:39.643326+0000","last_became_peered":"2023-11-27T22:29:39.643326+0000","last_unstale":"2023-11-27T22:29:39.652470+0000","last_undegraded":"2023-11-27T22:29:39.652470+0000","last_fullsized":"2023-11-27T22:29:39.652470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:50:16.238678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638480+0000","last_change":"2023-11-27T22:29:38.659399+0000","last_active":"2023-11-27T22:29:40.638480+0000","last_peered":"2023-11-27T22:29:40.638480+0000","last_clean":"2023-11-27T22:29:40.638480+0000","last_became_active":"2023-11-27T22:29:38.659105+0000","last_became_peered":"2023-11-27T22:29:38.659105+0000","last_unstale":"2023-11-27T22:29:40.638480+0000","last_undegraded":"2023-11-27T22:29:40.638480+0000","last_fullsized":"2023-11-27T22:29:40.638480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637606+0000","last_change":"2023-11-27T22:29:39.646130+0000","last_active":"2023-11-27T22:29:40.637606+0000","last_peered":"2023-11-27T22:29:40.637606+0000","last_clean":"2023-11-27T22:29:40.637606+0000","last_became_active":"2023-11-27T22:29:39.645883+0000","last_became_peered":"2023-11-27T22:29:39.645883+0000","last_unstale":"2023-11-27T22:29:40.637606+0000","last_undegraded":"2023-11-27T22:29:40.637606+0000","last_fullsized":"2023-11-27T22:29:40.637606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638459+0000","last_change":"2023-11-27T22:29:38.660518+0000","last_active":"2023-11-27T22:29:40.638459+0000","last_peered":"2023-11-27T22:29:40.638459+0000","last_clean":"2023-11-27T22:29:40.638459+0000","last_became_active":"2023-11-27T22:29:38.660266+0000","last_became_peered":"2023-11-27T22:29:38.660266+0000","last_unstale":"2023-11-27T22:29:40.638459+0000","last_undegraded":"2023-11-27T22:29:40.638459+0000","last_fullsized":"2023-11-27T22:29:40.638459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637857+0000","last_change":"2023-11-27T22:29:39.651820+0000","last_active":"2023-11-27T22:29:40.637857+0000","last_peered":"2023-11-27T22:29:40.637857+0000","last_clean":"2023-11-27T22:29:40.637857+0000","last_became_active":"2023-11-27T22:29:39.651526+0000","last_became_peered":"2023-11-27T22:29:39.651526+0000","last_unstale":"2023-11-27T22:29:40.637857+0000","last_undegraded":"2023-11-27T22:29:40.637857+0000","last_fullsized":"2023-11-27T22:29:40.637857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.680966+0000","last_change":"2023-11-27T22:29:38.665243+0000","last_active":"2023-11-27T22:29:39.680966+0000","last_peered":"2023-11-27T22:29:39.680966+0000","last_clean":"2023-11-27T22:29:39.680966+0000","last_became_active":"2023-11-27T22:29:38.664972+0000","last_became_peered":"2023-11-27T22:29:38.664972+0000","last_unstale":"2023-11-27T22:29:39.680966+0000","last_undegraded":"2023-11-27T22:29:39.680966+0000","last_fullsized":"2023-11-27T22:29:39.680966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636882+0000","last_change":"2023-11-27T22:29:39.645449+0000","last_active":"2023-11-27T22:29:40.636882+0000","last_peered":"2023-11-27T22:29:40.636882+0000","last_clean":"2023-11-27T22:29:40.636882+0000","last_became_active":"2023-11-27T22:29:39.645168+0000","last_became_peered":"2023-11-27T22:29:39.645168+0000","last_unstale":"2023-11-27T22:29:40.636882+0000","last_undegraded":"2023-11-27T22:29:40.636882+0000","last_fullsized":"2023-11-27T22:29:40.636882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652671+0000","last_change":"2023-11-27T22:29:39.646245+0000","last_active":"2023-11-27T22:29:39.652671+0000","last_peered":"2023-11-27T22:29:39.652671+0000","last_clean":"2023-11-27T22:29:39.652671+0000","last_became_active":"2023-11-27T22:29:39.645965+0000","last_became_peered":"2023-11-27T22:29:39.645965+0000","last_unstale":"2023-11-27T22:29:39.652671+0000","last_undegraded":"2023-11-27T22:29:39.652671+0000","last_fullsized":"2023-11-27T22:29:39.652671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.678397+0000","last_change":"2023-11-27T22:29:38.663026+0000","last_active":"2023-11-27T22:29:39.678397+0000","last_peered":"2023-11-27T22:29:39.678397+0000","last_clean":"2023-11-27T22:29:39.678397+0000","last_became_active":"2023-11-27T22:29:38.662621+0000","last_became_peered":"2023-11-27T22:29:38.662621+0000","last_unstale":"2023-11-27T22:29:39.678397+0000","last_undegraded":"2023-11-27T22:29:39.678397+0000","last_fullsized":"2023-11-27T22:29:39.678397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.652710+0000","last_change":"2023-11-27T22:29:39.646947+0000","last_active":"2023-11-27T22:29:39.652710+0000","last_peered":"2023-11-27T22:29:39.652710+0000","last_clean":"2023-11-27T22:29:39.652710+0000","last_became_active":"2023-11-27T22:29:39.646670+0000","last_became_peered":"2023-11-27T22:29:39.646670+0000","last_unstale":"2023-11-27T22:29:39.652710+0000","last_undegraded":"2023-11-27T22:29:39.652710+0000","last_fullsized":"2023-11-27T22:29:39.652710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.678554+0000","last_change":"2023-11-27T22:29:38.667974+0000","last_active":"2023-11-27T22:29:39.678554+0000","last_peered":"2023-11-27T22:29:39.678554+0000","last_clean":"2023-11-27T22:29:39.678554+0000","last_became_active":"2023-11-27T22:29:38.667716+0000","last_became_peered":"2023-11-27T22:29:38.667716+0000","last_unstale":"2023-11-27T22:29:39.678554+0000","last_undegraded":"2023-11-27T22:29:39.678554+0000","last_fullsized":"2023-11-27T22:29:39.678554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.650776+0000","last_change":"2023-11-27T22:29:39.648535+0000","last_active":"2023-11-27T22:29:39.650776+0000","last_peered":"2023-11-27T22:29:39.650776+0000","last_clean":"2023-11-27T22:29:39.650776+0000","last_became_active":"2023-11-27T22:29:39.648270+0000","last_became_peered":"2023-11-27T22:29:39.648270+0000","last_unstale":"2023-11-27T22:29:39.650776+0000","last_undegraded":"2023-11-27T22:29:39.650776+0000","last_fullsized":"2023-11-27T22:29:39.650776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637713+0000","last_change":"2023-11-27T22:29:38.663189+0000","last_active":"2023-11-27T22:29:40.637713+0000","last_peered":"2023-11-27T22:29:40.637713+0000","last_clean":"2023-11-27T22:29:40.637713+0000","last_became_active":"2023-11-27T22:29:38.662886+0000","last_became_peered":"2023-11-27T22:29:38.662886+0000","last_unstale":"2023-11-27T22:29:40.637713+0000","last_undegraded":"2023-11-27T22:29:40.637713+0000","last_fullsized":"2023-11-27T22:29:40.637713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637686+0000","last_change":"2023-11-27T22:29:39.656710+0000","last_active":"2023-11-27T22:29:40.637686+0000","last_peered":"2023-11-27T22:29:40.637686+0000","last_clean":"2023-11-27T22:29:40.637686+0000","last_became_active":"2023-11-27T22:29:39.656469+0000","last_became_peered":"2023-11-27T22:29:39.656469+0000","last_unstale":"2023-11-27T22:29:40.637686+0000","last_undegraded":"2023-11-27T22:29:40.637686+0000","last_fullsized":"2023-11-27T22:29:40.637686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.678226+0000","last_change":"2023-11-27T22:29:38.661665+0000","last_active":"2023-11-27T22:29:39.678226+0000","last_peered":"2023-11-27T22:29:39.678226+0000","last_clean":"2023-11-27T22:29:39.678226+0000","last_became_active":"2023-11-27T22:29:38.661369+0000","last_became_peered":"2023-11-27T22:29:38.661369+0000","last_unstale":"2023-11-27T22:29:39.678226+0000","last_undegraded":"2023-11-27T22:29:39.678226+0000","last_fullsized":"2023-11-27T22:29:39.678226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:46.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:47.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.057+0000 7f1994516640 1 Processor -- start 2023-11-27T22:29:47.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.058+0000 7f1994516640 1 -- start start 2023-11-27T22:29:47.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.058+0000 7f1994516640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f198c15b5d0 0x7f198c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.058+0000 7f1994516640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c15bf40 con 0x7f198c1448f0 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.058+0000 7f1994516640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c15f3a0 con 0x7f198c06a4d0 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.058+0000 7f1994516640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c0714c0 con 0x7f198c15b5d0 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f1992ab3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f198c15b5d0 0x7f198c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f1992ab3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f198c15b5d0 0x7f198c15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56544/0 (socket says 172.21.15.154:56544) 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f1992ab3640 1 -- 172.21.15.154:0/838393157 learned_addr learned my addr 172.21.15.154:0/838393157 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f19922b2640 1 --1- 172.21.15.154:0/838393157 >> v1:172.21.15.154:6789/0 conn(0x7f198c1448f0 0x7f198c15ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44370/0 (socket says 172.21.15.154:44370) 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f1992ab3640 1 -- 172.21.15.154:0/838393157 >> v1:172.21.15.194:6789/0 conn(0x7f198c06a4d0 legacy=0x7f198c071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f1992ab3640 1 -- 172.21.15.154:0/838393157 >> v1:172.21.15.154:6789/0 conn(0x7f198c1448f0 legacy=0x7f198c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f19912b0640 1 -- 172.21.15.154:0/838393157 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027686725 0 0) 0x7f198c15bf40 con 0x7f198c1448f0 2023-11-27T22:29:47.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.059+0000 7f1992ab3640 1 -- 172.21.15.154:0/838393157 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c15f680 con 0x7f198c15b5d0 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f1992ab3640 1 --2- 172.21.15.154:0/838393157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c15ba00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f197c009870 tx=0x7f197c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce931c78fe1c910 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f19912b0640 1 -- 172.21.15.154:0/838393157 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c02f840 con 0x7f198c15b5d0 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f19912b0640 1 -- 172.21.15.154:0/838393157 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c02f9a0 con 0x7f198c15b5d0 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f19912b0640 1 -- 172.21.15.154:0/838393157 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c02fd30 con 0x7f198c15b5d0 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f1994516640 1 -- 172.21.15.154:0/838393157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 msgr2=0x7f198c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f1994516640 1 --2- 172.21.15.154:0/838393157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c15ba00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f197c009870 tx=0x7f197c02ba20 comp rx=0 tx=0).stop 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f1994516640 1 -- 172.21.15.154:0/838393157 shutdown_connections 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f1994516640 1 --2- 172.21.15.154:0/838393157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c15ba00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.060+0000 7f1994516640 1 -- 172.21.15.154:0/838393157 >> 172.21.15.154:0/838393157 conn(0x7f198c0b1de0 msgr2=0x7f198c0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:47.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.061+0000 7f1994516640 1 -- 172.21.15.154:0/838393157 shutdown_connections 2023-11-27T22:29:47.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.061+0000 7f1994516640 1 -- 172.21.15.154:0/838393157 wait complete. 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 Processor -- start 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 -- start start 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f198c06a4d0 0x7f198c1f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f198c1448f0 0x7f198c13b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0c65b0 con 0x7f198c15b5d0 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c13df20 con 0x7f198c1448f0 2023-11-27T22:29:47.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1994516640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1f5810 con 0x7f198c06a4d0 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1992ab3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1992ab3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c0c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56556/0 (socket says 172.21.15.154:56556) 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.062+0000 7f1992ab3640 1 -- 172.21.15.154:0/21228814 learned_addr learned my addr 172.21.15.154:0/21228814 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1992ab3640 1 -- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f198c06a4d0 msgr2=0x7f198c1f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f19922b2640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f198c06a4d0 0x7f198c1f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1991ab1640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f198c1448f0 0x7f198c13b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1992ab3640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f198c06a4d0 0x7f198c1f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1992ab3640 1 -- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f198c1448f0 msgr2=0x7f198c13b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1992ab3640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f198c1448f0 0x7f198c13b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1992ab3640 1 -- 172.21.15.154:0/21228814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0094d0 con 0x7f198c15b5d0 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1992ab3640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c0c5a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f197c02ba60 tx=0x7f197c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c041400 con 0x7f198c15b5d0 2023-11-27T22:29:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c041580 con 0x7f198c15b5d0 2023-11-27T22:29:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c041930 con 0x7f198c15b5d0 2023-11-27T22:29:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c13e130 con 0x7f198c15b5d0 2023-11-27T22:29:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.063+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c13e6f0 con 0x7f198c15b5d0 2023-11-27T22:29:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.064+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c067420 con 0x7f198c15b5d0 2023-11-27T22:29:47.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.065+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f197c041a90 con 0x7f198c15b5d0 2023-11-27T22:29:47.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.065+0000 7f198affd640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f197806b1c0 0x7f197806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.065+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f197c03c070 con 0x7f198c15b5d0 2023-11-27T22:29:47.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.065+0000 7f19922b2640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f197806b1c0 0x7f197806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.065+0000 7f19922b2640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f197806b1c0 0x7f197806d680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19840012e0 tx=0x7f1984009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.070+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f197c0775f0 con 0x7f198c15b5d0 2023-11-27T22:29:47.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.234+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f198c0716d0 con 0x7f197806b1c0 2023-11-27T22:29:47.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.240+0000 7f198affd640 1 -- 172.21.15.154:0/21228814 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264641 (secure 0 0 0) 0x7f1984001a10 con 0x7f197806b1c0 2023-11-27T22:29:47.248 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:47.249 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:47.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f197806b1c0 msgr2=0x7f197806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f197806b1c0 0x7f197806d680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19840012e0 tx=0x7f1984009040 comp rx=0 tx=0).stop 2023-11-27T22:29:47.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 msgr2=0x7f198c0c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c0c5a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f197c02ba60 tx=0x7f197c004730 comp rx=0 tx=0).stop 2023-11-27T22:29:47.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 shutdown_connections 2023-11-27T22:29:47.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f198c1448f0 0x7f198c13b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f197806b1c0 0x7f197806d680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f198c15b5d0 0x7f198c0c5a40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 --2- 172.21.15.154:0/21228814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f198c06a4d0 0x7f198c1f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 >> 172.21.15.154:0/21228814 conn(0x7f198c0b1de0 msgr2=0x7f198c15bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:47.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 shutdown_connections 2023-11-27T22:29:47.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.243+0000 7f1994516640 1 -- 172.21.15.154:0/21228814 wait complete. 2023-11-27T22:29:47.257 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-27T22:29:46.962965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001535"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138285+0000","last_change":"2023-11-27T22:29:39.657258+0000","last_active":"2023-11-27T22:29:41.138285+0000","last_peered":"2023-11-27T22:29:41.138285+0000","last_clean":"2023-11-27T22:29:41.138285+0000","last_became_active":"2023-11-27T22:29:39.656994+0000","last_became_peered":"2023-11-27T22:29:39.656994+0000","last_unstale":"2023-11-27T22:29:41.138285+0000","last_undegraded":"2023-11-27T22:29:41.138285+0000","last_fullsized":"2023-11-27T22:29:41.138285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:23:47.348952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638662+0000","last_change":"2023-11-27T22:29:39.646837+0000","last_active":"2023-11-27T22:29:40.638662+0000","last_peered":"2023-11-27T22:29:40.638662+0000","last_clean":"2023-11-27T22:29:40.638662+0000","last_became_active":"2023-11-27T22:29:39.645981+0000","last_became_peered":"2023-11-27T22:29:39.645981+0000","last_unstale":"2023-11-27T22:29:40.638662+0000","last_undegraded":"2023-11-27T22:29:40.638662+0000","last_fullsized":"2023-11-27T22:29:40.638662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136530+0000","last_change":"2023-11-27T22:29:39.643286+0000","last_active":"2023-11-27T22:29:41.136530+0000","last_peered":"2023-11-27T22:29:41.136530+0000","last_clean":"2023-11-27T22:29:41.136530+0000","last_became_active":"2023-11-27T22:29:39.642812+0000","last_became_peered":"2023-11-27T22:29:39.642812+0000","last_unstale":"2023-11-27T22:29:41.136530+0000","last_undegraded":"2023-11-27T22:29:41.136530+0000","last_fullsized":"2023-11-27T22:29:41.136530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138267+0000","last_change":"2023-11-27T22:29:39.649850+0000","last_active":"2023-11-27T22:29:41.138267+0000","last_peered":"2023-11-27T22:29:41.138267+0000","last_clean":"2023-11-27T22:29:41.138267+0000","last_became_active":"2023-11-27T22:29:39.649553+0000","last_became_peered":"2023-11-27T22:29:39.649553+0000","last_unstale":"2023-11-27T22:29:41.138267+0000","last_undegraded":"2023-11-27T22:29:41.138267+0000","last_fullsized":"2023-11-27T22:29:41.138267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:23:47.348952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138169+0000","last_change":"2023-11-27T22:29:39.653809+0000","last_active":"2023-11-27T22:29:41.138169+0000","last_peered":"2023-11-27T22:29:41.138169+0000","last_clean":"2023-11-27T22:29:41.138169+0000","last_became_active":"2023-11-27T22:29:39.653442+0000","last_became_peered":"2023-11-27T22:29:39.653442+0000","last_unstale":"2023-11-27T22:29:41.138169+0000","last_undegraded":"2023-11-27T22:29:41.138169+0000","last_fullsized":"2023-11-27T22:29:41.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137163+0000","last_change":"2023-11-27T22:29:39.650707+0000","last_active":"2023-11-27T22:29:41.137163+0000","last_peered":"2023-11-27T22:29:41.137163+0000","last_clean":"2023-11-27T22:29:41.137163+0000","last_became_active":"2023-11-27T22:29:39.649995+0000","last_became_peered":"2023-11-27T22:29:39.649995+0000","last_unstale":"2023-11-27T22:29:41.137163+0000","last_undegraded":"2023-11-27T22:29:41.137163+0000","last_fullsized":"2023-11-27T22:29:41.137163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137235+0000","last_change":"2023-11-27T22:29:39.654105+0000","last_active":"2023-11-27T22:29:41.137235+0000","last_peered":"2023-11-27T22:29:41.137235+0000","last_clean":"2023-11-27T22:29:41.137235+0000","last_became_active":"2023-11-27T22:29:39.653603+0000","last_became_peered":"2023-11-27T22:29:39.653603+0000","last_unstale":"2023-11-27T22:29:41.137235+0000","last_undegraded":"2023-11-27T22:29:41.137235+0000","last_fullsized":"2023-11-27T22:29:41.137235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637398+0000","last_change":"2023-11-27T22:29:39.654077+0000","last_active":"2023-11-27T22:29:40.637398+0000","last_peered":"2023-11-27T22:29:40.637398+0000","last_clean":"2023-11-27T22:29:40.637398+0000","last_became_active":"2023-11-27T22:29:39.653518+0000","last_became_peered":"2023-11-27T22:29:39.653518+0000","last_unstale":"2023-11-27T22:29:40.637398+0000","last_undegraded":"2023-11-27T22:29:40.637398+0000","last_fullsized":"2023-11-27T22:29:40.637398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138343+0000","last_change":"2023-11-27T22:29:39.657910+0000","last_active":"2023-11-27T22:29:41.138343+0000","last_peered":"2023-11-27T22:29:41.138343+0000","last_clean":"2023-11-27T22:29:41.138343+0000","last_became_active":"2023-11-27T22:29:39.657639+0000","last_became_peered":"2023-11-27T22:29:39.657639+0000","last_unstale":"2023-11-27T22:29:41.138343+0000","last_undegraded":"2023-11-27T22:29:41.138343+0000","last_fullsized":"2023-11-27T22:29:41.138343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:50.558601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637203+0000","last_change":"2023-11-27T22:29:39.645292+0000","last_active":"2023-11-27T22:29:40.637203+0000","last_peered":"2023-11-27T22:29:40.637203+0000","last_clean":"2023-11-27T22:29:40.637203+0000","last_became_active":"2023-11-27T22:29:39.645012+0000","last_became_peered":"2023-11-27T22:29:39.645012+0000","last_unstale":"2023-11-27T22:29:40.637203+0000","last_undegraded":"2023-11-27T22:29:40.637203+0000","last_fullsized":"2023-11-27T22:29:40.637203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637000+0000","last_change":"2023-11-27T22:29:39.645072+0000","last_active":"2023-11-27T22:29:40.637000+0000","last_peered":"2023-11-27T22:29:40.637000+0000","last_clean":"2023-11-27T22:29:40.637000+0000","last_became_active":"2023-11-27T22:29:39.644771+0000","last_became_peered":"2023-11-27T22:29:39.644771+0000","last_unstale":"2023-11-27T22:29:40.637000+0000","last_undegraded":"2023-11-27T22:29:40.637000+0000","last_fullsized":"2023-11-27T22:29:40.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137914+0000","last_change":"2023-11-27T22:29:39.644172+0000","last_active":"2023-11-27T22:29:41.137914+0000","last_peered":"2023-11-27T22:29:41.137914+0000","last_clean":"2023-11-27T22:29:41.137914+0000","last_became_active":"2023-11-27T22:29:39.643298+0000","last_became_peered":"2023-11-27T22:29:39.643298+0000","last_unstale":"2023-11-27T22:29:41.137914+0000","last_undegraded":"2023-11-27T22:29:41.137914+0000","last_fullsized":"2023-11-27T22:29:41.137914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637594+0000","last_change":"2023-11-27T22:29:39.657540+0000","last_active":"2023-11-27T22:29:40.637594+0000","last_peered":"2023-11-27T22:29:40.637594+0000","last_clean":"2023-11-27T22:29:40.637594+0000","last_became_active":"2023-11-27T22:29:39.657283+0000","last_became_peered":"2023-11-27T22:29:39.657283+0000","last_unstale":"2023-11-27T22:29:40.637594+0000","last_undegraded":"2023-11-27T22:29:40.637594+0000","last_fullsized":"2023-11-27T22:29:40.637594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136428+0000","last_change":"2023-11-27T22:29:39.646882+0000","last_active":"2023-11-27T22:29:41.136428+0000","last_peered":"2023-11-27T22:29:41.136428+0000","last_clean":"2023-11-27T22:29:41.136428+0000","last_became_active":"2023-11-27T22:29:39.646580+0000","last_became_peered":"2023-11-27T22:29:39.646580+0000","last_unstale":"2023-11-27T22:29:41.136428+0000","last_undegraded":"2023-11-27T22:29:41.136428+0000","last_fullsized":"2023-11-27T22:29:41.136428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:37.746015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638442+0000","last_change":"2023-11-27T22:29:39.645413+0000","last_active":"2023-11-27T22:29:40.638442+0000","last_peered":"2023-11-27T22:29:40.638442+0000","last_clean":"2023-11-27T22:29:40.638442+0000","last_became_active":"2023-11-27T22:29:39.645150+0000","last_became_peered":"2023-11-27T22:29:39.645150+0000","last_unstale":"2023-11-27T22:29:40.638442+0000","last_undegraded":"2023-11-27T22:29:40.638442+0000","last_fullsized":"2023-11-27T22:29:40.638442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137158+0000","last_change":"2023-11-27T22:29:39.650165+0000","last_active":"2023-11-27T22:29:41.137158+0000","last_peered":"2023-11-27T22:29:41.137158+0000","last_clean":"2023-11-27T22:29:41.137158+0000","last_became_active":"2023-11-27T22:29:39.649783+0000","last_became_peered":"2023-11-27T22:29:39.649783+0000","last_unstale":"2023-11-27T22:29:41.137158+0000","last_undegraded":"2023-11-27T22:29:41.137158+0000","last_fullsized":"2023-11-27T22:29:41.137158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137800+0000","last_change":"2023-11-27T22:29:39.654571+0000","last_active":"2023-11-27T22:29:41.137800+0000","last_peered":"2023-11-27T22:29:41.137800+0000","last_clean":"2023-11-27T22:29:41.137800+0000","last_became_active":"2023-11-27T22:29:39.654278+0000","last_became_peered":"2023-11-27T22:29:39.654278+0000","last_unstale":"2023-11-27T22:29:41.137800+0000","last_undegraded":"2023-11-27T22:29:41.137800+0000","last_fullsized":"2023-11-27T22:29:41.137800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765150+0000","last_change":"2023-11-27T22:29:39.648168+0000","last_active":"2023-11-27T22:29:40.765150+0000","last_peered":"2023-11-27T22:29:40.765150+0000","last_clean":"2023-11-27T22:29:40.765150+0000","last_became_active":"2023-11-27T22:29:39.647900+0000","last_became_peered":"2023-11-27T22:29:39.647900+0000","last_unstale":"2023-11-27T22:29:40.765150+0000","last_undegraded":"2023-11-27T22:29:40.765150+0000","last_fullsized":"2023-11-27T22:29:40.765150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138592+0000","last_change":"2023-11-27T22:29:39.655501+0000","last_active":"2023-11-27T22:29:41.138592+0000","last_peered":"2023-11-27T22:29:41.138592+0000","last_clean":"2023-11-27T22:29:41.138592+0000","last_became_active":"2023-11-27T22:29:39.655220+0000","last_became_peered":"2023-11-27T22:29:39.655220+0000","last_unstale":"2023-11-27T22:29:41.138592+0000","last_undegraded":"2023-11-27T22:29:41.138592+0000","last_fullsized":"2023-11-27T22:29:41.138592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:53:34.262936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636971+0000","last_change":"2023-11-27T22:29:39.645941+0000","last_active":"2023-11-27T22:29:40.636971+0000","last_peered":"2023-11-27T22:29:40.636971+0000","last_clean":"2023-11-27T22:29:40.636971+0000","last_became_active":"2023-11-27T22:29:39.645663+0000","last_became_peered":"2023-11-27T22:29:39.645663+0000","last_unstale":"2023-11-27T22:29:40.636971+0000","last_undegraded":"2023-11-27T22:29:40.636971+0000","last_fullsized":"2023-11-27T22:29:40.636971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136618+0000","last_change":"2023-11-27T22:29:39.655808+0000","last_active":"2023-11-27T22:29:41.136618+0000","last_peered":"2023-11-27T22:29:41.136618+0000","last_clean":"2023-11-27T22:29:41.136618+0000","last_became_active":"2023-11-27T22:29:39.655505+0000","last_became_peered":"2023-11-27T22:29:39.655505+0000","last_unstale":"2023-11-27T22:29:41.136618+0000","last_undegraded":"2023-11-27T22:29:41.136618+0000","last_fullsized":"2023-11-27T22:29:41.136618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137325+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:41.137325+0000","last_peered":"2023-11-27T22:29:41.137325+0000","last_clean":"2023-11-27T22:29:41.137325+0000","last_became_active":"2023-11-27T22:29:39.654007+0000","last_became_peered":"2023-11-27T22:29:39.654007+0000","last_unstale":"2023-11-27T22:29:41.137325+0000","last_undegraded":"2023-11-27T22:29:41.137325+0000","last_fullsized":"2023-11-27T22:29:41.137325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637799+0000","last_change":"2023-11-27T22:29:39.648110+0000","last_active":"2023-11-27T22:29:40.637799+0000","last_peered":"2023-11-27T22:29:40.637799+0000","last_clean":"2023-11-27T22:29:40.637799+0000","last_became_active":"2023-11-27T22:29:39.647846+0000","last_became_peered":"2023-11-27T22:29:39.647846+0000","last_unstale":"2023-11-27T22:29:40.637799+0000","last_undegraded":"2023-11-27T22:29:40.637799+0000","last_fullsized":"2023-11-27T22:29:40.637799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137328+0000","last_change":"2023-11-27T22:29:39.649954+0000","last_active":"2023-11-27T22:29:41.137328+0000","last_peered":"2023-11-27T22:29:41.137328+0000","last_clean":"2023-11-27T22:29:41.137328+0000","last_became_active":"2023-11-27T22:29:39.649652+0000","last_became_peered":"2023-11-27T22:29:39.649652+0000","last_unstale":"2023-11-27T22:29:41.137328+0000","last_undegraded":"2023-11-27T22:29:41.137328+0000","last_fullsized":"2023-11-27T22:29:41.137328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637719+0000","last_change":"2023-11-27T22:29:39.649200+0000","last_active":"2023-11-27T22:29:40.637719+0000","last_peered":"2023-11-27T22:29:40.637719+0000","last_clean":"2023-11-27T22:29:40.637719+0000","last_became_active":"2023-11-27T22:29:39.648825+0000","last_became_peered":"2023-11-27T22:29:39.648825+0000","last_unstale":"2023-11-27T22:29:40.637719+0000","last_undegraded":"2023-11-27T22:29:40.637719+0000","last_fullsized":"2023-11-27T22:29:40.637719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637255+0000","last_change":"2023-11-27T22:29:39.654267+0000","last_active":"2023-11-27T22:29:40.637255+0000","last_peered":"2023-11-27T22:29:40.637255+0000","last_clean":"2023-11-27T22:29:40.637255+0000","last_became_active":"2023-11-27T22:29:39.654008+0000","last_became_peered":"2023-11-27T22:29:39.654008+0000","last_unstale":"2023-11-27T22:29:40.637255+0000","last_undegraded":"2023-11-27T22:29:40.637255+0000","last_fullsized":"2023-11-27T22:29:40.637255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638583+0000","last_change":"2023-11-27T22:29:39.647097+0000","last_active":"2023-11-27T22:29:40.638583+0000","last_peered":"2023-11-27T22:29:40.638583+0000","last_clean":"2023-11-27T22:29:40.638583+0000","last_became_active":"2023-11-27T22:29:39.646828+0000","last_became_peered":"2023-11-27T22:29:39.646828+0000","last_unstale":"2023-11-27T22:29:40.638583+0000","last_undegraded":"2023-11-27T22:29:40.638583+0000","last_fullsized":"2023-11-27T22:29:40.638583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637906+0000","last_change":"2023-11-27T22:29:39.653574+0000","last_active":"2023-11-27T22:29:40.637906+0000","last_peered":"2023-11-27T22:29:40.637906+0000","last_clean":"2023-11-27T22:29:40.637906+0000","last_became_active":"2023-11-27T22:29:39.653270+0000","last_became_peered":"2023-11-27T22:29:39.653270+0000","last_unstale":"2023-11-27T22:29:40.637906+0000","last_undegraded":"2023-11-27T22:29:40.637906+0000","last_fullsized":"2023-11-27T22:29:40.637906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136725+0000","last_change":"2023-11-27T22:29:39.648704+0000","last_active":"2023-11-27T22:29:41.136725+0000","last_peered":"2023-11-27T22:29:41.136725+0000","last_clean":"2023-11-27T22:29:41.136725+0000","last_became_active":"2023-11-27T22:29:39.648254+0000","last_became_peered":"2023-11-27T22:29:39.648254+0000","last_unstale":"2023-11-27T22:29:41.136725+0000","last_undegraded":"2023-11-27T22:29:41.136725+0000","last_fullsized":"2023-11-27T22:29:41.136725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137535+0000","last_change":"2023-11-27T22:29:39.648662+0000","last_active":"2023-11-27T22:29:41.137535+0000","last_peered":"2023-11-27T22:29:41.137535+0000","last_clean":"2023-11-27T22:29:41.137535+0000","last_became_active":"2023-11-27T22:29:39.647607+0000","last_became_peered":"2023-11-27T22:29:39.647607+0000","last_unstale":"2023-11-27T22:29:41.137535+0000","last_undegraded":"2023-11-27T22:29:41.137535+0000","last_fullsized":"2023-11-27T22:29:41.137535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765029+0000","last_change":"2023-11-27T22:29:39.646354+0000","last_active":"2023-11-27T22:29:40.765029+0000","last_peered":"2023-11-27T22:29:40.765029+0000","last_clean":"2023-11-27T22:29:40.765029+0000","last_became_active":"2023-11-27T22:29:39.646090+0000","last_became_peered":"2023-11-27T22:29:39.646090+0000","last_unstale":"2023-11-27T22:29:40.765029+0000","last_undegraded":"2023-11-27T22:29:40.765029+0000","last_fullsized":"2023-11-27T22:29:40.765029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636897+0000","last_change":"2023-11-27T22:29:39.649555+0000","last_active":"2023-11-27T22:29:40.636897+0000","last_peered":"2023-11-27T22:29:40.636897+0000","last_clean":"2023-11-27T22:29:40.636897+0000","last_became_active":"2023-11-27T22:29:39.649055+0000","last_became_peered":"2023-11-27T22:29:39.649055+0000","last_unstale":"2023-11-27T22:29:40.636897+0000","last_undegraded":"2023-11-27T22:29:40.636897+0000","last_fullsized":"2023-11-27T22:29:40.636897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137222+0000","last_change":"2023-11-27T22:29:39.651646+0000","last_active":"2023-11-27T22:29:41.137222+0000","last_peered":"2023-11-27T22:29:41.137222+0000","last_clean":"2023-11-27T22:29:41.137222+0000","last_became_active":"2023-11-27T22:29:39.651358+0000","last_became_peered":"2023-11-27T22:29:39.651358+0000","last_unstale":"2023-11-27T22:29:41.137222+0000","last_undegraded":"2023-11-27T22:29:41.137222+0000","last_fullsized":"2023-11-27T22:29:41.137222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637683+0000","last_change":"2023-11-27T22:29:38.663887+0000","last_active":"2023-11-27T22:29:40.637683+0000","last_peered":"2023-11-27T22:29:40.637683+0000","last_clean":"2023-11-27T22:29:40.637683+0000","last_became_active":"2023-11-27T22:29:38.662995+0000","last_became_peered":"2023-11-27T22:29:38.662995+0000","last_unstale":"2023-11-27T22:29:40.637683+0000","last_undegraded":"2023-11-27T22:29:40.637683+0000","last_fullsized":"2023-11-27T22:29:40.637683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136764+0000","last_change":"2023-11-27T22:29:39.644876+0000","last_active":"2023-11-27T22:29:41.136764+0000","last_peered":"2023-11-27T22:29:41.136764+0000","last_clean":"2023-11-27T22:29:41.136764+0000","last_became_active":"2023-11-27T22:29:39.644470+0000","last_became_peered":"2023-11-27T22:29:39.644470+0000","last_unstale":"2023-11-27T22:29:41.136764+0000","last_undegraded":"2023-11-27T22:29:41.136764+0000","last_fullsized":"2023-11-27T22:29:41.136764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636788+0000","last_change":"2023-11-27T22:29:38.659425+0000","last_active":"2023-11-27T22:29:40.636788+0000","last_peered":"2023-11-27T22:29:40.636788+0000","last_clean":"2023-11-27T22:29:40.636788+0000","last_became_active":"2023-11-27T22:29:38.659091+0000","last_became_peered":"2023-11-27T22:29:38.659091+0000","last_unstale":"2023-11-27T22:29:40.636788+0000","last_undegraded":"2023-11-27T22:29:40.636788+0000","last_fullsized":"2023-11-27T22:29:40.636788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637460+0000","last_change":"2023-11-27T22:29:38.658068+0000","last_active":"2023-11-27T22:29:40.637460+0000","last_peered":"2023-11-27T22:29:40.637460+0000","last_clean":"2023-11-27T22:29:40.637460+0000","last_became_active":"2023-11-27T22:29:38.657688+0000","last_became_peered":"2023-11-27T22:29:38.657688+0000","last_unstale":"2023-11-27T22:29:40.637460+0000","last_undegraded":"2023-11-27T22:29:40.637460+0000","last_fullsized":"2023-11-27T22:29:40.637460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637464+0000","last_change":"2023-11-27T22:29:39.651687+0000","last_active":"2023-11-27T22:29:40.637464+0000","last_peered":"2023-11-27T22:29:40.637464+0000","last_clean":"2023-11-27T22:29:40.637464+0000","last_became_active":"2023-11-27T22:29:39.651383+0000","last_became_peered":"2023-11-27T22:29:39.651383+0000","last_unstale":"2023-11-27T22:29:40.637464+0000","last_undegraded":"2023-11-27T22:29:40.637464+0000","last_fullsized":"2023-11-27T22:29:40.637464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977074+0000","last_change":"2023-11-27T22:29:38.656782+0000","last_active":"2023-11-27T22:29:40.977074+0000","last_peered":"2023-11-27T22:29:40.977074+0000","last_clean":"2023-11-27T22:29:40.977074+0000","last_became_active":"2023-11-27T22:29:38.656527+0000","last_became_peered":"2023-11-27T22:29:38.656527+0000","last_unstale":"2023-11-27T22:29:40.977074+0000","last_undegraded":"2023-11-27T22:29:40.977074+0000","last_fullsized":"2023-11-27T22:29:40.977074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638394+0000","last_change":"2023-11-27T22:29:39.646862+0000","last_active":"2023-11-27T22:29:40.638394+0000","last_peered":"2023-11-27T22:29:40.638394+0000","last_clean":"2023-11-27T22:29:40.638394+0000","last_became_active":"2023-11-27T22:29:39.644502+0000","last_became_peered":"2023-11-27T22:29:39.644502+0000","last_unstale":"2023-11-27T22:29:40.638394+0000","last_undegraded":"2023-11-27T22:29:40.638394+0000","last_fullsized":"2023-11-27T22:29:40.638394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636966+0000","last_change":"2023-11-27T22:29:38.656824+0000","last_active":"2023-11-27T22:29:40.636966+0000","last_peered":"2023-11-27T22:29:40.636966+0000","last_clean":"2023-11-27T22:29:40.636966+0000","last_became_active":"2023-11-27T22:29:38.656542+0000","last_became_peered":"2023-11-27T22:29:38.656542+0000","last_unstale":"2023-11-27T22:29:40.636966+0000","last_undegraded":"2023-11-27T22:29:40.636966+0000","last_fullsized":"2023-11-27T22:29:40.636966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137958+0000","last_change":"2023-11-27T22:29:39.656332+0000","last_active":"2023-11-27T22:29:41.137958+0000","last_peered":"2023-11-27T22:29:41.137958+0000","last_clean":"2023-11-27T22:29:41.137958+0000","last_became_active":"2023-11-27T22:29:39.654860+0000","last_became_peered":"2023-11-27T22:29:39.654860+0000","last_unstale":"2023-11-27T22:29:41.137958+0000","last_undegraded":"2023-11-27T22:29:41.137958+0000","last_fullsized":"2023-11-27T22:29:41.137958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:18:12.958698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977350+0000","last_change":"2023-11-27T22:29:38.661962+0000","last_active":"2023-11-27T22:29:40.977350+0000","last_peered":"2023-11-27T22:29:40.977350+0000","last_clean":"2023-11-27T22:29:40.977350+0000","last_became_active":"2023-11-27T22:29:38.661221+0000","last_became_peered":"2023-11-27T22:29:38.661221+0000","last_unstale":"2023-11-27T22:29:40.977350+0000","last_undegraded":"2023-11-27T22:29:40.977350+0000","last_fullsized":"2023-11-27T22:29:40.977350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:02.332894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136729+0000","last_change":"2023-11-27T22:29:39.644743+0000","last_active":"2023-11-27T22:29:41.136729+0000","last_peered":"2023-11-27T22:29:41.136729+0000","last_clean":"2023-11-27T22:29:41.136729+0000","last_became_active":"2023-11-27T22:29:39.644482+0000","last_became_peered":"2023-11-27T22:29:39.644482+0000","last_unstale":"2023-11-27T22:29:41.136729+0000","last_undegraded":"2023-11-27T22:29:41.136729+0000","last_fullsized":"2023-11-27T22:29:41.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638586+0000","last_change":"2023-11-27T22:29:38.657621+0000","last_active":"2023-11-27T22:29:40.638586+0000","last_peered":"2023-11-27T22:29:40.638586+0000","last_clean":"2023-11-27T22:29:40.638586+0000","last_became_active":"2023-11-27T22:29:38.657362+0000","last_became_peered":"2023-11-27T22:29:38.657362+0000","last_unstale":"2023-11-27T22:29:40.638586+0000","last_undegraded":"2023-11-27T22:29:40.638586+0000","last_fullsized":"2023-11-27T22:29:40.638586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138066+0000","last_change":"2023-11-27T22:29:39.654893+0000","last_active":"2023-11-27T22:29:41.138066+0000","last_peered":"2023-11-27T22:29:41.138066+0000","last_clean":"2023-11-27T22:29:41.138066+0000","last_became_active":"2023-11-27T22:29:39.654615+0000","last_became_peered":"2023-11-27T22:29:39.654615+0000","last_unstale":"2023-11-27T22:29:41.138066+0000","last_undegraded":"2023-11-27T22:29:41.138066+0000","last_fullsized":"2023-11-27T22:29:41.138066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:48.631646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637012+0000","last_change":"2023-11-27T22:29:38.659143+0000","last_active":"2023-11-27T22:29:40.637012+0000","last_peered":"2023-11-27T22:29:40.637012+0000","last_clean":"2023-11-27T22:29:40.637012+0000","last_became_active":"2023-11-27T22:29:38.658790+0000","last_became_peered":"2023-11-27T22:29:38.658790+0000","last_unstale":"2023-11-27T22:29:40.637012+0000","last_undegraded":"2023-11-27T22:29:40.637012+0000","last_fullsized":"2023-11-27T22:29:40.637012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138090+0000","last_change":"2023-11-27T22:29:39.654060+0000","last_active":"2023-11-27T22:29:41.138090+0000","last_peered":"2023-11-27T22:29:41.138090+0000","last_clean":"2023-11-27T22:29:41.138090+0000","last_became_active":"2023-11-27T22:29:39.653483+0000","last_became_peered":"2023-11-27T22:29:39.653483+0000","last_unstale":"2023-11-27T22:29:41.138090+0000","last_undegraded":"2023-11-27T22:29:41.138090+0000","last_fullsized":"2023-11-27T22:29:41.138090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978456+0000","last_change":"2023-11-27T22:29:38.660084+0000","last_active":"2023-11-27T22:29:40.978456+0000","last_peered":"2023-11-27T22:29:40.978456+0000","last_clean":"2023-11-27T22:29:40.978456+0000","last_became_active":"2023-11-27T22:29:38.659648+0000","last_became_peered":"2023-11-27T22:29:38.659648+0000","last_unstale":"2023-11-27T22:29:40.978456+0000","last_undegraded":"2023-11-27T22:29:40.978456+0000","last_fullsized":"2023-11-27T22:29:40.978456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136488+0000","last_change":"2023-11-27T22:29:39.654365+0000","last_active":"2023-11-27T22:29:41.136488+0000","last_peered":"2023-11-27T22:29:41.136488+0000","last_clean":"2023-11-27T22:29:41.136488+0000","last_became_active":"2023-11-27T22:29:39.654080+0000","last_became_peered":"2023-11-27T22:29:39.654080+0000","last_unstale":"2023-11-27T22:29:41.136488+0000","last_undegraded":"2023-11-27T22:29:41.136488+0000","last_fullsized":"2023-11-27T22:29:41.136488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977168+0000","last_change":"2023-11-27T22:29:38.661785+0000","last_active":"2023-11-27T22:29:40.977168+0000","last_peered":"2023-11-27T22:29:40.977168+0000","last_clean":"2023-11-27T22:29:40.977168+0000","last_became_active":"2023-11-27T22:29:38.661129+0000","last_became_peered":"2023-11-27T22:29:38.661129+0000","last_unstale":"2023-11-27T22:29:40.977168+0000","last_undegraded":"2023-11-27T22:29:40.977168+0000","last_fullsized":"2023-11-27T22:29:40.977168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138435+0000","last_change":"2023-11-27T22:29:39.654846+0000","last_active":"2023-11-27T22:29:41.138435+0000","last_peered":"2023-11-27T22:29:41.138435+0000","last_clean":"2023-11-27T22:29:41.138435+0000","last_became_active":"2023-11-27T22:29:39.654042+0000","last_became_peered":"2023-11-27T22:29:39.654042+0000","last_unstale":"2023-11-27T22:29:41.138435+0000","last_undegraded":"2023-11-27T22:29:41.138435+0000","last_fullsized":"2023-11-27T22:29:41.138435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:16:15.899536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636721+0000","last_change":"2023-11-27T22:29:38.658756+0000","last_active":"2023-11-27T22:29:40.636721+0000","last_peered":"2023-11-27T22:29:40.636721+0000","last_clean":"2023-11-27T22:29:40.636721+0000","last_became_active":"2023-11-27T22:29:38.658475+0000","last_became_peered":"2023-11-27T22:29:38.658475+0000","last_unstale":"2023-11-27T22:29:40.636721+0000","last_undegraded":"2023-11-27T22:29:40.636721+0000","last_fullsized":"2023-11-27T22:29:40.636721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636767+0000","last_change":"2023-11-27T22:29:39.649309+0000","last_active":"2023-11-27T22:29:40.636767+0000","last_peered":"2023-11-27T22:29:40.636767+0000","last_clean":"2023-11-27T22:29:40.636767+0000","last_became_active":"2023-11-27T22:29:39.648695+0000","last_became_peered":"2023-11-27T22:29:39.648695+0000","last_unstale":"2023-11-27T22:29:40.636767+0000","last_undegraded":"2023-11-27T22:29:40.636767+0000","last_fullsized":"2023-11-27T22:29:40.636767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.764988+0000","last_change":"2023-11-27T22:29:38.654789+0000","last_active":"2023-11-27T22:29:40.764988+0000","last_peered":"2023-11-27T22:29:40.764988+0000","last_clean":"2023-11-27T22:29:40.764988+0000","last_became_active":"2023-11-27T22:29:38.654453+0000","last_became_peered":"2023-11-27T22:29:38.654453+0000","last_unstale":"2023-11-27T22:29:40.764988+0000","last_undegraded":"2023-11-27T22:29:40.764988+0000","last_fullsized":"2023-11-27T22:29:40.764988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:58.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137369+0000","last_change":"2023-11-27T22:29:39.654661+0000","last_active":"2023-11-27T22:29:41.137369+0000","last_peered":"2023-11-27T22:29:41.137369+0000","last_clean":"2023-11-27T22:29:41.137369+0000","last_became_active":"2023-11-27T22:29:39.654269+0000","last_became_peered":"2023-11-27T22:29:39.654269+0000","last_unstale":"2023-11-27T22:29:41.137369+0000","last_undegraded":"2023-11-27T22:29:41.137369+0000","last_fullsized":"2023-11-27T22:29:41.137369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978729+0000","last_change":"2023-11-27T22:29:38.658036+0000","last_active":"2023-11-27T22:29:40.978729+0000","last_peered":"2023-11-27T22:29:40.978729+0000","last_clean":"2023-11-27T22:29:40.978729+0000","last_became_active":"2023-11-27T22:29:38.657748+0000","last_became_peered":"2023-11-27T22:29:38.657748+0000","last_unstale":"2023-11-27T22:29:40.978729+0000","last_undegraded":"2023-11-27T22:29:40.978729+0000","last_fullsized":"2023-11-27T22:29:40.978729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:26.492362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137888+0000","last_change":"2023-11-27T22:29:39.659240+0000","last_active":"2023-11-27T22:29:41.137888+0000","last_peered":"2023-11-27T22:29:41.137888+0000","last_clean":"2023-11-27T22:29:41.137888+0000","last_became_active":"2023-11-27T22:29:39.658986+0000","last_became_peered":"2023-11-27T22:29:39.658986+0000","last_unstale":"2023-11-27T22:29:41.137888+0000","last_undegraded":"2023-11-27T22:29:41.137888+0000","last_fullsized":"2023-11-27T22:29:41.137888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:18:12.958698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765118+0000","last_change":"2023-11-27T22:29:38.660926+0000","last_active":"2023-11-27T22:29:40.765118+0000","last_peered":"2023-11-27T22:29:40.765118+0000","last_clean":"2023-11-27T22:29:40.765118+0000","last_became_active":"2023-11-27T22:29:38.660662+0000","last_became_peered":"2023-11-27T22:29:38.660662+0000","last_unstale":"2023-11-27T22:29:40.765118+0000","last_undegraded":"2023-11-27T22:29:40.765118+0000","last_fullsized":"2023-11-27T22:29:40.765118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:41.693347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138504+0000","last_change":"2023-11-27T22:29:39.659397+0000","last_active":"2023-11-27T22:29:41.138504+0000","last_peered":"2023-11-27T22:29:41.138504+0000","last_clean":"2023-11-27T22:29:41.138504+0000","last_became_active":"2023-11-27T22:29:39.658970+0000","last_became_peered":"2023-11-27T22:29:39.658970+0000","last_unstale":"2023-11-27T22:29:41.138504+0000","last_undegraded":"2023-11-27T22:29:41.138504+0000","last_fullsized":"2023-11-27T22:29:41.138504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:08.383015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638663+0000","last_change":"2023-11-27T22:29:38.654389+0000","last_active":"2023-11-27T22:29:40.638663+0000","last_peered":"2023-11-27T22:29:40.638663+0000","last_clean":"2023-11-27T22:29:40.638663+0000","last_became_active":"2023-11-27T22:29:38.654116+0000","last_became_peered":"2023-11-27T22:29:38.654116+0000","last_unstale":"2023-11-27T22:29:40.638663+0000","last_undegraded":"2023-11-27T22:29:40.638663+0000","last_fullsized":"2023-11-27T22:29:40.638663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138396+0000","last_change":"2023-11-27T22:29:39.649308+0000","last_active":"2023-11-27T22:29:41.138396+0000","last_peered":"2023-11-27T22:29:41.138396+0000","last_clean":"2023-11-27T22:29:41.138396+0000","last_became_active":"2023-11-27T22:29:39.648915+0000","last_became_peered":"2023-11-27T22:29:39.648915+0000","last_unstale":"2023-11-27T22:29:41.138396+0000","last_undegraded":"2023-11-27T22:29:41.138396+0000","last_fullsized":"2023-11-27T22:29:41.138396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:50.558601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765138+0000","last_change":"2023-11-27T22:29:38.661956+0000","last_active":"2023-11-27T22:29:40.765138+0000","last_peered":"2023-11-27T22:29:40.765138+0000","last_clean":"2023-11-27T22:29:40.765138+0000","last_became_active":"2023-11-27T22:29:38.661660+0000","last_became_peered":"2023-11-27T22:29:38.661660+0000","last_unstale":"2023-11-27T22:29:40.765138+0000","last_undegraded":"2023-11-27T22:29:40.765138+0000","last_fullsized":"2023-11-27T22:29:40.765138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:51.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138343+0000","last_change":"2023-11-27T22:29:39.655710+0000","last_active":"2023-11-27T22:29:41.138343+0000","last_peered":"2023-11-27T22:29:41.138343+0000","last_clean":"2023-11-27T22:29:41.138343+0000","last_became_active":"2023-11-27T22:29:39.654385+0000","last_became_peered":"2023-11-27T22:29:39.654385+0000","last_unstale":"2023-11-27T22:29:41.138343+0000","last_undegraded":"2023-11-27T22:29:41.138343+0000","last_fullsized":"2023-11-27T22:29:41.138343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:27.041102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.642415+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:39.642415+0000","last_peered":"2023-11-27T22:29:39.642415+0000","last_clean":"2023-11-27T22:29:39.642415+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:39.642415+0000","last_undegraded":"2023-11-27T22:29:39.642415+0000","last_fullsized":"2023-11-27T22:29:39.642415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977220+0000","last_change":"2023-11-27T22:29:38.656156+0000","last_active":"2023-11-27T22:29:40.977220+0000","last_peered":"2023-11-27T22:29:40.977220+0000","last_clean":"2023-11-27T22:29:40.977220+0000","last_became_active":"2023-11-27T22:29:38.655859+0000","last_became_peered":"2023-11-27T22:29:38.655859+0000","last_unstale":"2023-11-27T22:29:40.977220+0000","last_undegraded":"2023-11-27T22:29:40.977220+0000","last_fullsized":"2023-11-27T22:29:40.977220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637872+0000","last_change":"2023-11-27T22:29:39.653299+0000","last_active":"2023-11-27T22:29:40.637872+0000","last_peered":"2023-11-27T22:29:40.637872+0000","last_clean":"2023-11-27T22:29:40.637872+0000","last_became_active":"2023-11-27T22:29:39.653033+0000","last_became_peered":"2023-11-27T22:29:39.653033+0000","last_unstale":"2023-11-27T22:29:40.637872+0000","last_undegraded":"2023-11-27T22:29:40.637872+0000","last_fullsized":"2023-11-27T22:29:40.637872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977854+0000","last_change":"2023-11-27T22:29:38.664007+0000","last_active":"2023-11-27T22:29:40.977854+0000","last_peered":"2023-11-27T22:29:40.977854+0000","last_clean":"2023-11-27T22:29:40.977854+0000","last_became_active":"2023-11-27T22:29:38.663462+0000","last_became_peered":"2023-11-27T22:29:38.663462+0000","last_unstale":"2023-11-27T22:29:40.977854+0000","last_undegraded":"2023-11-27T22:29:40.977854+0000","last_fullsized":"2023-11-27T22:29:40.977854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136397+0000","last_change":"2023-11-27T22:29:39.646086+0000","last_active":"2023-11-27T22:29:41.136397+0000","last_peered":"2023-11-27T22:29:41.136397+0000","last_clean":"2023-11-27T22:29:41.136397+0000","last_became_active":"2023-11-27T22:29:39.645812+0000","last_became_peered":"2023-11-27T22:29:39.645812+0000","last_unstale":"2023-11-27T22:29:41.136397+0000","last_undegraded":"2023-11-27T22:29:41.136397+0000","last_fullsized":"2023-11-27T22:29:41.136397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765072+0000","last_change":"2023-11-27T22:29:38.660283+0000","last_active":"2023-11-27T22:29:40.765072+0000","last_peered":"2023-11-27T22:29:40.765072+0000","last_clean":"2023-11-27T22:29:40.765072+0000","last_became_active":"2023-11-27T22:29:38.658807+0000","last_became_peered":"2023-11-27T22:29:38.658807+0000","last_unstale":"2023-11-27T22:29:40.765072+0000","last_undegraded":"2023-11-27T22:29:40.765072+0000","last_fullsized":"2023-11-27T22:29:40.765072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638421+0000","last_change":"2023-11-27T22:29:39.644925+0000","last_active":"2023-11-27T22:29:40.638421+0000","last_peered":"2023-11-27T22:29:40.638421+0000","last_clean":"2023-11-27T22:29:40.638421+0000","last_became_active":"2023-11-27T22:29:39.644678+0000","last_became_peered":"2023-11-27T22:29:39.644678+0000","last_unstale":"2023-11-27T22:29:40.638421+0000","last_undegraded":"2023-11-27T22:29:40.638421+0000","last_fullsized":"2023-11-27T22:29:40.638421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977189+0000","last_change":"2023-11-27T22:29:38.662139+0000","last_active":"2023-11-27T22:29:40.977189+0000","last_peered":"2023-11-27T22:29:40.977189+0000","last_clean":"2023-11-27T22:29:40.977189+0000","last_became_active":"2023-11-27T22:29:38.661432+0000","last_became_peered":"2023-11-27T22:29:38.661432+0000","last_unstale":"2023-11-27T22:29:40.977189+0000","last_undegraded":"2023-11-27T22:29:40.977189+0000","last_fullsized":"2023-11-27T22:29:40.977189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137794+0000","last_change":"2023-11-27T22:29:39.651435+0000","last_active":"2023-11-27T22:29:41.137794+0000","last_peered":"2023-11-27T22:29:41.137794+0000","last_clean":"2023-11-27T22:29:41.137794+0000","last_became_active":"2023-11-27T22:29:39.651172+0000","last_became_peered":"2023-11-27T22:29:39.651172+0000","last_unstale":"2023-11-27T22:29:41.137794+0000","last_undegraded":"2023-11-27T22:29:41.137794+0000","last_fullsized":"2023-11-27T22:29:41.137794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638530+0000","last_change":"2023-11-27T22:29:38.653717+0000","last_active":"2023-11-27T22:29:40.638530+0000","last_peered":"2023-11-27T22:29:40.638530+0000","last_clean":"2023-11-27T22:29:40.638530+0000","last_became_active":"2023-11-27T22:29:38.653432+0000","last_became_peered":"2023-11-27T22:29:38.653432+0000","last_unstale":"2023-11-27T22:29:40.638530+0000","last_undegraded":"2023-11-27T22:29:40.638530+0000","last_fullsized":"2023-11-27T22:29:40.638530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:07.717011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137515+0000","last_change":"2023-11-27T22:29:39.650521+0000","last_active":"2023-11-27T22:29:41.137515+0000","last_peered":"2023-11-27T22:29:41.137515+0000","last_clean":"2023-11-27T22:29:41.137515+0000","last_became_active":"2023-11-27T22:29:39.650292+0000","last_became_peered":"2023-11-27T22:29:39.650292+0000","last_unstale":"2023-11-27T22:29:41.137515+0000","last_undegraded":"2023-11-27T22:29:41.137515+0000","last_fullsized":"2023-11-27T22:29:41.137515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978023+0000","last_change":"2023-11-27T22:29:38.664144+0000","last_active":"2023-11-27T22:29:40.978023+0000","last_peered":"2023-11-27T22:29:40.978023+0000","last_clean":"2023-11-27T22:29:40.978023+0000","last_became_active":"2023-11-27T22:29:38.663854+0000","last_became_peered":"2023-11-27T22:29:38.663854+0000","last_unstale":"2023-11-27T22:29:40.978023+0000","last_undegraded":"2023-11-27T22:29:40.978023+0000","last_fullsized":"2023-11-27T22:29:40.978023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638533+0000","last_change":"2023-11-27T22:29:39.645029+0000","last_active":"2023-11-27T22:29:40.638533+0000","last_peered":"2023-11-27T22:29:40.638533+0000","last_clean":"2023-11-27T22:29:40.638533+0000","last_became_active":"2023-11-27T22:29:39.644767+0000","last_became_peered":"2023-11-27T22:29:39.644767+0000","last_unstale":"2023-11-27T22:29:40.638533+0000","last_undegraded":"2023-11-27T22:29:40.638533+0000","last_fullsized":"2023-11-27T22:29:40.638533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977545+0000","last_change":"2023-11-27T22:29:38.655124+0000","last_active":"2023-11-27T22:29:40.977545+0000","last_peered":"2023-11-27T22:29:40.977545+0000","last_clean":"2023-11-27T22:29:40.977545+0000","last_became_active":"2023-11-27T22:29:38.654557+0000","last_became_peered":"2023-11-27T22:29:38.654557+0000","last_unstale":"2023-11-27T22:29:40.977545+0000","last_undegraded":"2023-11-27T22:29:40.977545+0000","last_fullsized":"2023-11-27T22:29:40.977545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637851+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:40.637851+0000","last_peered":"2023-11-27T22:29:40.637851+0000","last_clean":"2023-11-27T22:29:40.637851+0000","last_became_active":"2023-11-27T22:29:39.654060+0000","last_became_peered":"2023-11-27T22:29:39.654060+0000","last_unstale":"2023-11-27T22:29:40.637851+0000","last_undegraded":"2023-11-27T22:29:40.637851+0000","last_fullsized":"2023-11-27T22:29:40.637851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637133+0000","last_change":"2023-11-27T22:29:38.662202+0000","last_active":"2023-11-27T22:29:40.637133+0000","last_peered":"2023-11-27T22:29:40.637133+0000","last_clean":"2023-11-27T22:29:40.637133+0000","last_became_active":"2023-11-27T22:29:38.661712+0000","last_became_peered":"2023-11-27T22:29:38.661712+0000","last_unstale":"2023-11-27T22:29:40.637133+0000","last_undegraded":"2023-11-27T22:29:40.637133+0000","last_fullsized":"2023-11-27T22:29:40.637133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136678+0000","last_change":"2023-11-27T22:29:39.643007+0000","last_active":"2023-11-27T22:29:41.136678+0000","last_peered":"2023-11-27T22:29:41.136678+0000","last_clean":"2023-11-27T22:29:41.136678+0000","last_became_active":"2023-11-27T22:29:39.642647+0000","last_became_peered":"2023-11-27T22:29:39.642647+0000","last_unstale":"2023-11-27T22:29:41.136678+0000","last_undegraded":"2023-11-27T22:29:41.136678+0000","last_fullsized":"2023-11-27T22:29:41.136678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977837+0000","last_change":"2023-11-27T22:29:38.664234+0000","last_active":"2023-11-27T22:29:40.977837+0000","last_peered":"2023-11-27T22:29:40.977837+0000","last_clean":"2023-11-27T22:29:40.977837+0000","last_became_active":"2023-11-27T22:29:38.663863+0000","last_became_peered":"2023-11-27T22:29:38.663863+0000","last_unstale":"2023-11-27T22:29:40.977837+0000","last_undegraded":"2023-11-27T22:29:40.977837+0000","last_fullsized":"2023-11-27T22:29:40.977837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137919+0000","last_change":"2023-11-27T22:29:39.644164+0000","last_active":"2023-11-27T22:29:41.137919+0000","last_peered":"2023-11-27T22:29:41.137919+0000","last_clean":"2023-11-27T22:29:41.137919+0000","last_became_active":"2023-11-27T22:29:39.643326+0000","last_became_peered":"2023-11-27T22:29:39.643326+0000","last_unstale":"2023-11-27T22:29:41.137919+0000","last_undegraded":"2023-11-27T22:29:41.137919+0000","last_fullsized":"2023-11-27T22:29:41.137919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638480+0000","last_change":"2023-11-27T22:29:38.659399+0000","last_active":"2023-11-27T22:29:40.638480+0000","last_peered":"2023-11-27T22:29:40.638480+0000","last_clean":"2023-11-27T22:29:40.638480+0000","last_became_active":"2023-11-27T22:29:38.659105+0000","last_became_peered":"2023-11-27T22:29:38.659105+0000","last_unstale":"2023-11-27T22:29:40.638480+0000","last_undegraded":"2023-11-27T22:29:40.638480+0000","last_fullsized":"2023-11-27T22:29:40.638480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637606+0000","last_change":"2023-11-27T22:29:39.646130+0000","last_active":"2023-11-27T22:29:40.637606+0000","last_peered":"2023-11-27T22:29:40.637606+0000","last_clean":"2023-11-27T22:29:40.637606+0000","last_became_active":"2023-11-27T22:29:39.645883+0000","last_became_peered":"2023-11-27T22:29:39.645883+0000","last_unstale":"2023-11-27T22:29:40.637606+0000","last_undegraded":"2023-11-27T22:29:40.637606+0000","last_fullsized":"2023-11-27T22:29:40.637606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638459+0000","last_change":"2023-11-27T22:29:38.660518+0000","last_active":"2023-11-27T22:29:40.638459+0000","last_peered":"2023-11-27T22:29:40.638459+0000","last_clean":"2023-11-27T22:29:40.638459+0000","last_became_active":"2023-11-27T22:29:38.660266+0000","last_became_peered":"2023-11-27T22:29:38.660266+0000","last_unstale":"2023-11-27T22:29:40.638459+0000","last_undegraded":"2023-11-27T22:29:40.638459+0000","last_fullsized":"2023-11-27T22:29:40.638459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637857+0000","last_change":"2023-11-27T22:29:39.651820+0000","last_active":"2023-11-27T22:29:40.637857+0000","last_peered":"2023-11-27T22:29:40.637857+0000","last_clean":"2023-11-27T22:29:40.637857+0000","last_became_active":"2023-11-27T22:29:39.651526+0000","last_became_peered":"2023-11-27T22:29:39.651526+0000","last_unstale":"2023-11-27T22:29:40.637857+0000","last_undegraded":"2023-11-27T22:29:40.637857+0000","last_fullsized":"2023-11-27T22:29:40.637857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977936+0000","last_change":"2023-11-27T22:29:38.665243+0000","last_active":"2023-11-27T22:29:40.977936+0000","last_peered":"2023-11-27T22:29:40.977936+0000","last_clean":"2023-11-27T22:29:40.977936+0000","last_became_active":"2023-11-27T22:29:38.664972+0000","last_became_peered":"2023-11-27T22:29:38.664972+0000","last_unstale":"2023-11-27T22:29:40.977936+0000","last_undegraded":"2023-11-27T22:29:40.977936+0000","last_fullsized":"2023-11-27T22:29:40.977936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636882+0000","last_change":"2023-11-27T22:29:39.645449+0000","last_active":"2023-11-27T22:29:40.636882+0000","last_peered":"2023-11-27T22:29:40.636882+0000","last_clean":"2023-11-27T22:29:40.636882+0000","last_became_active":"2023-11-27T22:29:39.645168+0000","last_became_peered":"2023-11-27T22:29:39.645168+0000","last_unstale":"2023-11-27T22:29:40.636882+0000","last_undegraded":"2023-11-27T22:29:40.636882+0000","last_fullsized":"2023-11-27T22:29:40.636882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137381+0000","last_change":"2023-11-27T22:29:39.646245+0000","last_active":"2023-11-27T22:29:41.137381+0000","last_peered":"2023-11-27T22:29:41.137381+0000","last_clean":"2023-11-27T22:29:41.137381+0000","last_became_active":"2023-11-27T22:29:39.645965+0000","last_became_peered":"2023-11-27T22:29:39.645965+0000","last_unstale":"2023-11-27T22:29:41.137381+0000","last_undegraded":"2023-11-27T22:29:41.137381+0000","last_fullsized":"2023-11-27T22:29:41.137381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977950+0000","last_change":"2023-11-27T22:29:38.663026+0000","last_active":"2023-11-27T22:29:40.977950+0000","last_peered":"2023-11-27T22:29:40.977950+0000","last_clean":"2023-11-27T22:29:40.977950+0000","last_became_active":"2023-11-27T22:29:38.662621+0000","last_became_peered":"2023-11-27T22:29:38.662621+0000","last_unstale":"2023-11-27T22:29:40.977950+0000","last_undegraded":"2023-11-27T22:29:40.977950+0000","last_fullsized":"2023-11-27T22:29:40.977950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138386+0000","last_change":"2023-11-27T22:29:39.646947+0000","last_active":"2023-11-27T22:29:41.138386+0000","last_peered":"2023-11-27T22:29:41.138386+0000","last_clean":"2023-11-27T22:29:41.138386+0000","last_became_active":"2023-11-27T22:29:39.646670+0000","last_became_peered":"2023-11-27T22:29:39.646670+0000","last_unstale":"2023-11-27T22:29:41.138386+0000","last_undegraded":"2023-11-27T22:29:41.138386+0000","last_fullsized":"2023-11-27T22:29:41.138386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:27.041102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977999+0000","last_change":"2023-11-27T22:29:38.667974+0000","last_active":"2023-11-27T22:29:40.977999+0000","last_peered":"2023-11-27T22:29:40.977999+0000","last_clean":"2023-11-27T22:29:40.977999+0000","last_became_active":"2023-11-27T22:29:38.667716+0000","last_became_peered":"2023-11-27T22:29:38.667716+0000","last_unstale":"2023-11-27T22:29:40.977999+0000","last_undegraded":"2023-11-27T22:29:40.977999+0000","last_fullsized":"2023-11-27T22:29:40.977999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136640+0000","last_change":"2023-11-27T22:29:39.648535+0000","last_active":"2023-11-27T22:29:41.136640+0000","last_peered":"2023-11-27T22:29:41.136640+0000","last_clean":"2023-11-27T22:29:41.136640+0000","last_became_active":"2023-11-27T22:29:39.648270+0000","last_became_peered":"2023-11-27T22:29:39.648270+0000","last_unstale":"2023-11-27T22:29:41.136640+0000","last_undegraded":"2023-11-27T22:29:41.136640+0000","last_fullsized":"2023-11-27T22:29:41.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637713+0000","last_change":"2023-11-27T22:29:38.663189+0000","last_active":"2023-11-27T22:29:40.637713+0000","last_peered":"2023-11-27T22:29:40.637713+0000","last_clean":"2023-11-27T22:29:40.637713+0000","last_became_active":"2023-11-27T22:29:38.662886+0000","last_became_peered":"2023-11-27T22:29:38.662886+0000","last_unstale":"2023-11-27T22:29:40.637713+0000","last_undegraded":"2023-11-27T22:29:40.637713+0000","last_fullsized":"2023-11-27T22:29:40.637713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637686+0000","last_change":"2023-11-27T22:29:39.656710+0000","last_active":"2023-11-27T22:29:40.637686+0000","last_peered":"2023-11-27T22:29:40.637686+0000","last_clean":"2023-11-27T22:29:40.637686+0000","last_became_active":"2023-11-27T22:29:39.656469+0000","last_became_peered":"2023-11-27T22:29:39.656469+0000","last_unstale":"2023-11-27T22:29:40.637686+0000","last_undegraded":"2023-11-27T22:29:40.637686+0000","last_fullsized":"2023-11-27T22:29:40.637686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978528+0000","last_change":"2023-11-27T22:29:38.661665+0000","last_active":"2023-11-27T22:29:40.978528+0000","last_peered":"2023-11-27T22:29:40.978528+0000","last_clean":"2023-11-27T22:29:40.978528+0000","last_became_active":"2023-11-27T22:29:38.661369+0000","last_became_peered":"2023-11-27T22:29:38.661369+0000","last_unstale":"2023-11-27T22:29:40.978528+0000","last_undegraded":"2023-11-27T22:29:40.978528+0000","last_fullsized":"2023-11-27T22:29:40.978528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T22:29:47.261 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-27T22:29:47.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-27T22:29:47.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-27T22:29:47.262 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-27T22:29:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.395+0000 7fbfb053c640 1 Processor -- start 2023-11-27T22:29:47.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.395+0000 7fbfb053c640 1 -- start start 2023-11-27T22:29:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfb053c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbfa806abe0 0x7fbfa815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfb053c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 0x7fbfa81409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfb053c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa806e960 con 0x7fbfa81432a0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfb053c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa815dec0 con 0x7fbfa806abe0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfb053c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa815e1a0 con 0x7fbfa8143680 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfae2d8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbfa81432a0 0x7fbfa806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44384/0 (socket says 172.21.15.154:44384) 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.396+0000 7fbfae2d8640 1 -- 172.21.15.154:0/3522223932 learned_addr learned my addr 172.21.15.154:0/3522223932 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfadad7640 1 --2- 172.21.15.154:0/3522223932 >> v2:172.21.15.194:3300/0 conn(0x7fbfa806abe0 0x7fbfa815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 0x7fbfa81409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288070934 0 0) 0x7fbfa806e960 con 0x7fbfa81432a0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf94003520 con 0x7fbfa81432a0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1796052287 0 0) 0x7fbf94003520 con 0x7fbfa81432a0 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 msgr2=0x7fbfa81409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 0x7fbfa81409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 >> v2:172.21.15.194:3300/0 conn(0x7fbfa806abe0 msgr2=0x7fbfa815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 --2- 172.21.15.154:0/3522223932 >> v2:172.21.15.194:3300/0 conn(0x7fbfa806abe0 0x7fbfa815d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa815e480 con 0x7fbfa81432a0 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fbfa40019f0 con 0x7fbfa81432a0 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 >> v1:172.21.15.154:6789/0 conn(0x7fbfa81432a0 legacy=0x7fbfa806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 0x7fbf94003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf94003ef0 0x7fbf940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf94004d00 0x7fbf94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa815dec0 con 0x7fbf94004d00 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa815e1a0 con 0x7fbf94003ef0 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9400b980 con 0x7fbfa8143680 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf94004d00 0x7fbf94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfae2d8640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 0x7fbf94003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfadad7640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf94003ef0 0x7fbf940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 -- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 msgr2=0x7fbf94003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfa8143680 0x7fbf94003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 -- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf94003ef0 msgr2=0x7fbf940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf94003ef0 0x7fbf940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.397+0000 7fbfaead9640 1 -- 172.21.15.154:0/3522223932 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94003520 con 0x7fbf94004d00 2023-11-27T22:29:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.398+0000 7fbfaead9640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf94004d00 0x7fbf94005180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009ac0 tx=0x7fbf940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9fd9a68897eb46 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.398+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa002c6b0 con 0x7fbf94004d00 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.398+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa002c810 con 0x7fbf94004d00 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.398+0000 7fbfad2d6640 1 -- 172.21.15.154:0/3522223932 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa002cba0 con 0x7fbf94004d00 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfb053c640 1 -- 172.21.15.154:0/3522223932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf94004d00 msgr2=0x7fbf94005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfb053c640 1 --2- 172.21.15.154:0/3522223932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbf94004d00 0x7fbf94005180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009ac0 tx=0x7fbf940057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfaead9640 1 -- 172.21.15.154:0/3522223932 reap_dead start 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfb053c640 1 -- 172.21.15.154:0/3522223932 shutdown_connections 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfb053c640 1 -- 172.21.15.154:0/3522223932 >> 172.21.15.154:0/3522223932 conn(0x7fbfa80b1de0 msgr2=0x7fbfa80b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfb053c640 1 -- 172.21.15.154:0/3522223932 shutdown_connections 2023-11-27T22:29:47.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.399+0000 7fbfb053c640 1 -- 172.21.15.154:0/3522223932 wait complete. 2023-11-27T22:29:47.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.400+0000 7fbfb053c640 1 Processor -- start 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.400+0000 7fbfb053c640 1 -- start start 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf94004d00 0x7fbfa813b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 0x7fbfa8156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa8156760 0x7fbfa8141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8154b30 con 0x7fbfa81558b0 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8154dd0 con 0x7fbfa8156760 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa81550b0 con 0x7fbf94004d00 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 0x7fbfa8156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 0x7fbfa8156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56578/0 (socket says 172.21.15.154:56578) 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 -- 172.21.15.154:0/1487518007 learned_addr learned my addr 172.21.15.154:0/1487518007 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:47.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfae2d8640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf94004d00 0x7fbfa813b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfaead9640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa8156760 0x7fbfa8141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 -- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf94004d00 msgr2=0x7fbfa813b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf94004d00 0x7fbfa813b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 -- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa8156760 msgr2=0x7fbfa8141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa8156760 0x7fbfa8141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 -- 172.21.15.154:0/1487518007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8155390 con 0x7fbfa81558b0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfae2d8640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf94004d00 0x7fbfa813b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfadad7640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 0x7fbfa8156220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf98011960 tx=0x7fbf98011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800faf0 con 0x7fbfa81558b0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800fc50 con 0x7fbfa81558b0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa8156d90 con 0x7fbfa81558b0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98014440 con 0x7fbfa81558b0 2023-11-27T22:29:47.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.401+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa8155d30 con 0x7fbfa81558b0 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.402+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa8156b40 con 0x7fbfa81558b0 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.403+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbf980145a0 con 0x7fbfa81558b0 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.403+0000 7fbf9effd640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbf8c06b1c0 0x7fbf8c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.403+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf9808a290 con 0x7fbfa81558b0 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.403+0000 7fbfae2d8640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbf8c06b1c0 0x7fbf8c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.404+0000 7fbfae2d8640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbf8c06b1c0 0x7fbf8c06d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4004e00 tx=0x7fbfa4006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.408+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbf98055050 con 0x7fbfa81558b0 2023-11-27T22:29:47.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.622+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbfa8155520 con 0x7fbfa81558b0 2023-11-27T22:29:47.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.625+0000 7fbf9effd640 1 -- 172.21.15.154:0/1487518007 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171164 (secure 0 0 0) 0x7fbf98058670 con 0x7fbfa81558b0 2023-11-27T22:29:47.629 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbf8c06b1c0 msgr2=0x7fbf8c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbf8c06b1c0 0x7fbf8c06d680 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4004e00 tx=0x7fbfa4006040 comp rx=0 tx=0).stop 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 msgr2=0x7fbfa8156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 0x7fbfa8156220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf98011960 tx=0x7fbf98011e20 comp rx=0 tx=0).stop 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 shutdown_connections 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfa8156760 0x7fbfa8141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbf8c06b1c0 0x7fbf8c06d680 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbfa81558b0 0x7fbfa8156220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 --2- 172.21.15.154:0/1487518007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbf94004d00 0x7fbfa813b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.627+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 >> 172.21.15.154:0/1487518007 conn(0x7fbfa80b1de0 msgr2=0x7fbfa80b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.628+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 shutdown_connections 2023-11-27T22:29:47.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.628+0000 7fbfb053c640 1 -- 172.21.15.154:0/1487518007 wait complete. 2023-11-27T22:29:47.644 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":359126469},{"type":"v1","addr":"172.21.15.154:6833","nonce":359126469}]},"active_addr":"172.21.15.154:6833/359126469","active_change":"2023-11-27T22:29:18.951643+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":4053200727}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":494119332}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":3434495813}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.154:0","nonce":10384349}]}]} 2023-11-27T22:29:47.648 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-27T22:29:47.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-27T22:29:47.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:47.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.746+0000 7f0172864640 1 Processor -- start 2023-11-27T22:29:47.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.747+0000 7f0172864640 1 -- start start 2023-11-27T22:29:47.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.747+0000 7f0172864640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c0cf320 0x7f016c0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.747+0000 7f0172864640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f016c15f760 0x7f016c0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.747+0000 7f0172864640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016c0b3f10 con 0x7f016c15b130 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.747+0000 7f0172864640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016c15fd20 con 0x7f016c15f760 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.747+0000 7f0172864640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0d0730 con 0x7f016c0cf320 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f016c15f760 0x7f016c0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f016c15f760 0x7f016c0cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56580/0 (socket says 172.21.15.154:56580) 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 -- 172.21.15.154:0/207923472 learned_addr learned my addr 172.21.15.154:0/207923472 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f016b7fe640 1 --2- 172.21.15.154:0/207923472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c0cf320 0x7f016c0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 -- 172.21.15.154:0/207923472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c0cf320 msgr2=0x7f016c0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 --2- 172.21.15.154:0/207923472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c0cf320 0x7f016c0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 -- 172.21.15.154:0/207923472 >> v1:172.21.15.194:6789/0 conn(0x7f016c15b130 legacy=0x7f016c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.748+0000 7f0170e01640 1 -- 172.21.15.154:0/207923472 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c0d0a50 con 0x7f016c15f760 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0170e01640 1 --2- 172.21.15.154:0/207923472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c15f760 0x7f016c0cd310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0164009e50 tx=0x7f016402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf812c1114f3246 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f016affd640 1 -- 172.21.15.154:0/207923472 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016402cb00 con 0x7f016c15f760 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f016affd640 1 -- 172.21.15.154:0/207923472 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016402cc60 con 0x7f016c15f760 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f016affd640 1 -- 172.21.15.154:0/207923472 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01640343f0 con 0x7f016c15f760 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 -- 172.21.15.154:0/207923472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c15f760 msgr2=0x7f016c0cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 --2- 172.21.15.154:0/207923472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c15f760 0x7f016c0cd310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0164009e50 tx=0x7f016402bf60 comp rx=0 tx=0).stop 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 -- 172.21.15.154:0/207923472 shutdown_connections 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 --2- 172.21.15.154:0/207923472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c15f760 0x7f016c0cd310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 --2- 172.21.15.154:0/207923472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c0cf320 0x7f016c0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 -- 172.21.15.154:0/207923472 >> 172.21.15.154:0/207923472 conn(0x7f016c0b2c10 msgr2=0x7f016c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:47.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 -- 172.21.15.154:0/207923472 shutdown_connections 2023-11-27T22:29:47.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.749+0000 7f0172864640 1 -- 172.21.15.154:0/207923472 wait complete. 2023-11-27T22:29:47.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.750+0000 7f0172864640 1 Processor -- start 2023-11-27T22:29:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 -- start start 2023-11-27T22:29:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 0x7f016c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f016c15b130 0x7f016c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c15f760 0x7f016c0af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0ca9e0 con 0x7f016c0cf320 2023-11-27T22:29:47.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016c152580 con 0x7f016c15b130 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f0172864640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016c0c9dd0 con 0x7f016c15f760 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.751+0000 7f016bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 0x7f016c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 0x7f016c152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56588/0 (socket says 172.21.15.154:56588) 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 -- 172.21.15.154:0/3261679853 learned_addr learned my addr 172.21.15.154:0/3261679853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016b7fe640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f016c15b130 0x7f016c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f0170e01640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c15f760 0x7f016c0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 -- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c15f760 msgr2=0x7f016c0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c15f760 0x7f016c0af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 -- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f016c15b130 msgr2=0x7f016c0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f016c15b130 0x7f016c0c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 -- 172.21.15.154:0/3261679853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164009b30 con 0x7f016c0cf320 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f016bfff640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 0x7f016c152830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c450 tx=0x7f015c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c0052d0 con 0x7f016c0cf320 2023-11-27T22:29:47.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c005430 con 0x7f016c0cf320 2023-11-27T22:29:47.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c012870 con 0x7f016c0cf320 2023-11-27T22:29:47.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c0ca0b0 con 0x7f016c0cf320 2023-11-27T22:29:47.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.752+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016c0ca670 con 0x7f016c0cf320 2023-11-27T22:29:47.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.753+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016c067fc0 con 0x7f016c0cf320 2023-11-27T22:29:47.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.754+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f015c0129d0 con 0x7f016c0cf320 2023-11-27T22:29:47.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.754+0000 7f0168ff9640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f015806b1c0 0x7f015806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:47.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.754+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f015c0894a0 con 0x7f016c0cf320 2023-11-27T22:29:47.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.754+0000 7f016b7fe640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f015806b1c0 0x7f015806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:47.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.754+0000 7f016b7fe640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f015806b1c0 0x7f015806d680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f016c1f6990 tx=0x7f0160009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:47.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.758+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f015c0541f0 con 0x7f016c0cf320 2023-11-27T22:29:47.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.924+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f016c067420 con 0x7f016c0cf320 2023-11-27T22:29:47.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.926+0000 7f0168ff9640 1 -- 172.21.15.154:0/3261679853 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f015c057810 con 0x7f016c0cf320 2023-11-27T22:29:47.928 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:47.929 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f015806b1c0 msgr2=0x7f015806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f015806b1c0 0x7f015806d680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f016c1f6990 tx=0x7f0160009190 comp rx=0 tx=0).stop 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 msgr2=0x7f016c152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 0x7f016c152830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c450 tx=0x7f015c00c910 comp rx=0 tx=0).stop 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 shutdown_connections 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f016c15b130 0x7f016c0c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f015806b1c0 0x7f015806d680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f016c15f760 0x7f016c0af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 --2- 172.21.15.154:0/3261679853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f016c0cf320 0x7f016c152830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 >> 172.21.15.154:0/3261679853 conn(0x7f016c0b2c10 msgr2=0x7f016c15a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:47.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 shutdown_connections 2023-11-27T22:29:47.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:47.928+0000 7f0172864640 1 -- 172.21.15.154:0/3261679853 wait complete. 2023-11-27T22:29:47.942 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-27T22:29:47.942 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:48.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.039+0000 7fd43b31d640 1 Processor -- start 2023-11-27T22:29:48.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.039+0000 7fd43b31d640 1 -- start start 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd43b31d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4340cf320 0x7fd4340d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd43b31d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415f760 0x7fd4340cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd43b31d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4340b3f10 con 0x7fd43415b130 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd43b31d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd43415fd20 con 0x7fd4340cf320 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd43b31d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340d0730 con 0x7fd43415f760 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4340cf320 0x7fd4340d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd4340cf320 0x7fd4340d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56604/0 (socket says 172.21.15.154:56604) 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 -- 172.21.15.154:0/1912292197 learned_addr learned my addr 172.21.15.154:0/1912292197 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4398ba640 1 --2- 172.21.15.154:0/1912292197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415f760 0x7fd4340cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 -- 172.21.15.154:0/1912292197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415f760 msgr2=0x7fd4340cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 --2- 172.21.15.154:0/1912292197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415f760 0x7fd4340cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 -- 172.21.15.154:0/1912292197 >> v1:172.21.15.194:6789/0 conn(0x7fd43415b130 legacy=0x7fd4340cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.040+0000 7fd4388b8640 1 -- 172.21.15.154:0/1912292197 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4340d0a50 con 0x7fd4340cf320 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.041+0000 7fd4388b8640 1 --2- 172.21.15.154:0/1912292197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340d01f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd424009870 tx=0x7fd42402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d04ed12e8e76ca server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.041+0000 7fd42bfff640 1 -- 172.21.15.154:0/1912292197 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424030840 con 0x7fd4340cf320 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.041+0000 7fd42bfff640 1 -- 172.21.15.154:0/1912292197 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4240309a0 con 0x7fd4340cf320 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.041+0000 7fd42bfff640 1 -- 172.21.15.154:0/1912292197 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd424030d30 con 0x7fd4340cf320 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 -- 172.21.15.154:0/1912292197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 msgr2=0x7fd4340d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 --2- 172.21.15.154:0/1912292197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340d01f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd424009870 tx=0x7fd42402b980 comp rx=0 tx=0).stop 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 -- 172.21.15.154:0/1912292197 shutdown_connections 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 --2- 172.21.15.154:0/1912292197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415f760 0x7fd4340cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 --2- 172.21.15.154:0/1912292197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340d01f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 -- 172.21.15.154:0/1912292197 >> 172.21.15.154:0/1912292197 conn(0x7fd4340b2c10 msgr2=0x7fd4340b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 -- 172.21.15.154:0/1912292197 shutdown_connections 2023-11-27T22:29:48.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.042+0000 7fd43b31d640 1 -- 172.21.15.154:0/1912292197 wait complete. 2023-11-27T22:29:48.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.043+0000 7fd43b31d640 1 Processor -- start 2023-11-27T22:29:48.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.043+0000 7fd43b31d640 1 -- start start 2023-11-27T22:29:48.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415b130 0x7fd4340ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43415f760 0x7fd4340cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340b24b0 con 0x7fd4340cf320 2023-11-27T22:29:48.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340c81b0 con 0x7fd43415f760 2023-11-27T22:29:48.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4340c8490 con 0x7fd43415b130 2023-11-27T22:29:48.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56612/0 (socket says 172.21.15.154:56612) 2023-11-27T22:29:48.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 -- 172.21.15.154:0/2911978592 learned_addr learned my addr 172.21.15.154:0/2911978592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4388b8640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415b130 0x7fd4340ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4398ba640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43415f760 0x7fd4340cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 -- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415b130 msgr2=0x7fd4340ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415b130 0x7fd4340ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 -- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43415f760 msgr2=0x7fd4340cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43415f760 0x7fd4340cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 -- 172.21.15.154:0/2911978592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4240094d0 con 0x7fd4340cf320 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4388b8640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415b130 0x7fd4340ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4398ba640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43415f760 0x7fd4340cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd4390b9640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340b1f70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c450 tx=0x7fd43000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4300052d0 con 0x7fd4340cf320 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd430005430 con 0x7fd4340cf320 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4340c8770 con 0x7fd4340cf320 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430012870 con 0x7fd4340cf320 2023-11-27T22:29:48.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.044+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4340c8d30 con 0x7fd4340cf320 2023-11-27T22:29:48.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.045+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd434067fc0 con 0x7fd4340cf320 2023-11-27T22:29:48.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.046+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd4300129d0 con 0x7fd4340cf320 2023-11-27T22:29:48.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.046+0000 7fd429ffb640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd41806b1c0 0x7fd41806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.046+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd430089560 con 0x7fd4340cf320 2023-11-27T22:29:48.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.046+0000 7fd4388b8640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd41806b1c0 0x7fd41806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.047+0000 7fd4388b8640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd41806b1c0 0x7fd41806d680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd424036000 tx=0x7fd424008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.050+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd430054290 con 0x7fd4340cf320 2023-11-27T22:29:48.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.220+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd434067420 con 0x7fd4340cf320 2023-11-27T22:29:48.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.221+0000 7fd429ffb640 1 -- 172.21.15.154:0/2911978592 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fd4300578b0 con 0x7fd4340cf320 2023-11-27T22:29:48.224 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:48.224 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd41806b1c0 msgr2=0x7fd41806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd41806b1c0 0x7fd41806d680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd424036000 tx=0x7fd424008030 comp rx=0 tx=0).stop 2023-11-27T22:29:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 msgr2=0x7fd4340b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340b1f70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd43000c450 tx=0x7fd43000c910 comp rx=0 tx=0).stop 2023-11-27T22:29:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 shutdown_connections 2023-11-27T22:29:48.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd43415f760 0x7fd4340cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd41806b1c0 0x7fd41806d680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd43415b130 0x7fd4340ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 --2- 172.21.15.154:0/2911978592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4340cf320 0x7fd4340b1f70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 >> 172.21.15.154:0/2911978592 conn(0x7fd4340b2c10 msgr2=0x7fd4340b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 shutdown_connections 2023-11-27T22:29:48.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.223+0000 7fd43b31d640 1 -- 172.21.15.154:0/2911978592 wait complete. 2023-11-27T22:29:48.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-27T22:29:48.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-27T22:29:48.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-27T22:29:48.238 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-27T22:29:48.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-27T22:29:48.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-27T22:29:48.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-27T22:29:48.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-27T22:29:48.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.407+0000 7fefb7ee1640 1 Processor -- start 2023-11-27T22:29:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.407+0000 7fde8398a640 1 Processor -- start 2023-11-27T22:29:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.407+0000 7efc10210640 1 Processor -- start 2023-11-27T22:29:48.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.407+0000 7efc10210640 1 -- start start 2023-11-27T22:29:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.407+0000 7fefb7ee1640 1 -- start start 2023-11-27T22:29:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.407+0000 7fde8398a640 1 -- start start 2023-11-27T22:29:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7efc10210640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc080b3100 0x7efc08070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7efc10210640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 0x7efc080b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7efc10210640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc080b3a20 con 0x7efc0806d6e0 2023-11-27T22:29:48.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7efc10210640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0806e010 con 0x7efc080b3100 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7efc10210640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc080702f0 con 0x7efc08165bf0 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7fefb7ee1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa80e3080 0x7fefa8057d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7fefb7ee1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fefa80542c0 0x7fefa8006890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7fefb7ee1640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa8058290 con 0x7fefa803e800 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7fefb7ee1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa8006160 con 0x7fefa80542c0 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7fefb7ee1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa8058530 con 0x7fefa80e3080 2023-11-27T22:29:48.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7f6ca94d7640 1 Processor -- start 2023-11-27T22:29:48.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.408+0000 7f6ca94d7640 1 -- start start 2023-11-27T22:29:48.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde8398a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde7c14b020 0x7fde7c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde8398a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c162530 0x7fde7c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7efc0d7ab640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 0x7efc080b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7efc0d7ab640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 0x7efc080b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:51442/0 (socket says 172.21.15.154:51442) 2023-11-27T22:29:48.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7efc0d7ab640 1 -- 172.21.15.154:0/201338813 learned_addr learned my addr 172.21.15.154:0/201338813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f70116c9640 1 Processor -- start 2023-11-27T22:29:48.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde8398a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c06d090 con 0x7fde7c06cc40 2023-11-27T22:29:48.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde8398a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0b2350 con 0x7fde7c14b020 2023-11-27T22:29:48.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde8398a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c14b400 con 0x7fde7c162530 2023-11-27T22:29:48.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fefb647e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fefa80542c0 0x7fefa8006890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca94d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 0x7f6c9c038050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde80f25640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c162530 0x7fde7c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde81726640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde7c14b020 0x7fde7c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde81726640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde7c14b020 0x7fde7c0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:56958/0 (socket says 172.21.15.154:56958) 2023-11-27T22:29:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca94d7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6c9c033ec0 0x7f6c9c04fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fefb647e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fefa80542c0 0x7fefa8006890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:56942/0 (socket says 172.21.15.154:56942) 2023-11-27T22:29:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fefb647e640 1 -- 172.21.15.154:0/361899784 learned_addr learned my addr 172.21.15.154:0/361899784 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fefb647e640 1 -- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa80e3080 msgr2=0x7fefa8057d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fde81726640 1 -- 172.21.15.154:0/757954288 learned_addr learned my addr 172.21.15.154:0/757954288 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7fefb5c7d640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa80e3080 0x7fefa8057d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 0x7f6c9c038050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 0x7f6c9c038050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:51452/0 (socket says 172.21.15.154:51452) 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca3fff640 1 -- 172.21.15.154:0/3273556405 learned_addr learned my addr 172.21.15.154:0/3273556405 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c054490 con 0x7f6c9c053c40 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0541b0 con 0x7f6c9c033ec0 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca8cd6640 1 --2- 172.21.15.154:0/3273556405 >> v2:172.21.15.194:3300/0 conn(0x7f6c9c033ec0 0x7f6c9c04fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7efc0dfac640 1 --2- 172.21.15.154:0/201338813 >> v2:172.21.15.194:3300/0 conn(0x7efc080b3100 0x7efc08070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c005f00 con 0x7f6c9c00c070 2023-11-27T22:29:48.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fefb647e640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa80e3080 0x7fefa8057d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7efc0d7ab640 1 -- 172.21.15.154:0/201338813 >> v2:172.21.15.194:3300/0 conn(0x7efc080b3100 msgr2=0x7efc08070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7efc0d7ab640 1 --2- 172.21.15.154:0/201338813 >> v2:172.21.15.194:3300/0 conn(0x7efc080b3100 0x7efc08070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fefb647e640 1 -- 172.21.15.154:0/361899784 >> v1:172.21.15.194:6789/0 conn(0x7fefa803e800 legacy=0x7fefa8053bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7efc0d7ab640 1 -- 172.21.15.154:0/201338813 >> v1:172.21.15.194:6789/0 conn(0x7efc0806d6e0 legacy=0x7efc0806c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7efc0d7ab640 1 -- 172.21.15.154:0/201338813 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080705d0 con 0x7efc08165bf0 2023-11-27T22:29:48.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fefb647e640 1 -- 172.21.15.154:0/361899784 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8058810 con 0x7fefa80542c0 2023-11-27T22:29:48.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.409+0000 7f70116c9640 1 -- start start 2023-11-27T22:29:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fde80f25640 1 -- 172.21.15.154:0/757954288 >> v2:172.21.15.194:3300/0 conn(0x7fde7c14b020 msgr2=0x7fde7c0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fde80f25640 1 --2- 172.21.15.154:0/757954288 >> v2:172.21.15.194:3300/0 conn(0x7fde7c14b020 0x7fde7c0b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fde80f25640 1 -- 172.21.15.154:0/757954288 >> v1:172.21.15.154:6789/0 conn(0x7fde7c06cc40 legacy=0x7fde7c165010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fde80f25640 1 -- 172.21.15.154:0/757954288 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c1629b0 con 0x7fde7c162530 2023-11-27T22:29:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7f6956cbb640 1 Processor -- start 2023-11-27T22:29:48.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7f6956cbb640 1 -- start start 2023-11-27T22:29:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fe4f2190640 1 Processor -- start 2023-11-27T22:29:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fe4f2190640 1 -- start start 2023-11-27T22:29:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fdfff59e640 1 Processor -- start 2023-11-27T22:29:48.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7fdfff59e640 1 -- start start 2023-11-27T22:29:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f70116c9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f700c159e10 0x7f700c0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fefb5c7d640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa80e3080 0x7fefa8057d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:48.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f70116c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f700c0b50f0 0x7f700c06e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f70116c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c06e5b0 0x7f700c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f70116c9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c0b5580 con 0x7f700c0b50f0 2023-11-27T22:29:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f70116c9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700c15a1f0 con 0x7f700c159e10 2023-11-27T22:29:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f70116c9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c160930 con 0x7f700c06e5b0 2023-11-27T22:29:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7efc0d7ab640 1 --2- 172.21.15.154:0/201338813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 0x7efc080b34e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009870 tx=0x7efbf802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=311b45fc26b2e483 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fefb647e640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80542c0 0x7fefa8006890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009870 tx=0x7fefa002ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3cc86390203732 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6956cbb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f694803e840 0x7f6948053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6956cbb640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6948054130 0x7f69480068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7f6ca3fff640 1 -- 172.21.15.154:0/3273556405 >> v2:172.21.15.194:3300/0 conn(0x7f6c9c033ec0 msgr2=0x7f6c9c04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7f6ca3fff640 1 --2- 172.21.15.154:0/3273556405 >> v2:172.21.15.194:3300/0 conn(0x7f6c9c033ec0 0x7f6c9c04fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7f6ca3fff640 1 -- 172.21.15.154:0/3273556405 >> v1:172.21.15.194:6789/0 conn(0x7f6c9c053c40 legacy=0x7f6c9c0df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6956cbb640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6948058570 con 0x7f69480e30c0 2023-11-27T22:29:48.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6956cbb640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69480545c0 con 0x7f6948054130 2023-11-27T22:29:48.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6956cbb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480061a0 con 0x7f694803e840 2023-11-27T22:29:48.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.410+0000 7f6ca3fff640 1 -- 172.21.15.154:0/3273556405 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0061e0 con 0x7f6c9c00c070 2023-11-27T22:29:48.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7efc0cfaa640 1 -- 172.21.15.154:0/201338813 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8030840 con 0x7efc08165bf0 2023-11-27T22:29:48.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fde80f25640 1 --2- 172.21.15.154:0/757954288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c162530 0x7fde7c06c700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d90 tx=0x7fde7402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c654d85cbf413c2a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f700a7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f700c0b50f0 0x7f700c06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6955258640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6948054130 0x7f69480068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7efc0cfaa640 1 -- 172.21.15.154:0/201338813 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80309a0 con 0x7efc08165bf0 2023-11-27T22:29:48.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7efc0cfaa640 1 -- 172.21.15.154:0/201338813 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8030d30 con 0x7efc08165bf0 2023-11-27T22:29:48.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fde73fff640 1 -- 172.21.15.154:0/757954288 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7402cbd0 con 0x7fde7c162530 2023-11-27T22:29:48.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f700a7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f700c0b50f0 0x7f700c06e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56614/0 (socket says 172.21.15.154:56614) 2023-11-27T22:29:48.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f700a7fc640 1 -- 172.21.15.154:0/4039355645 learned_addr learned my addr 172.21.15.154:0/4039355645 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f700b7fe640 1 --2- 172.21.15.154:0/4039355645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c06e5b0 0x7f700c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fde73fff640 1 -- 172.21.15.154:0/757954288 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7402cd30 con 0x7fde7c162530 2023-11-27T22:29:48.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fde73fff640 1 -- 172.21.15.154:0/757954288 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7402cea0 con 0x7fde7c162530 2023-11-27T22:29:48.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fefb4c7b640 1 -- 172.21.15.154:0/361899784 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa002f870 con 0x7fefa80542c0 2023-11-27T22:29:48.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6955258640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6948054130 0x7f69480068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:56978/0 (socket says 172.21.15.154:56978) 2023-11-27T22:29:48.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6955258640 1 -- 172.21.15.154:0/3147532378 learned_addr learned my addr 172.21.15.154:0/3147532378 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f700affd640 1 --2- 172.21.15.154:0/4039355645 >> v2:172.21.15.194:3300/0 conn(0x7f700c159e10 0x7f700c0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fe4f2190640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe4ec15d1e0 0x7fe4ec0d3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fefb4c7b640 1 -- 172.21.15.154:0/361899784 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa002f9d0 con 0x7fefa80542c0 2023-11-27T22:29:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fefb4c7b640 1 -- 172.21.15.154:0/361899784 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa002fda0 con 0x7fefa80542c0 2023-11-27T22:29:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f6ca3fff640 1 --2- 172.21.15.154:0/3273556405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 0x7f6c9c038050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009870 tx=0x7f6c9002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcc8288f7e9ff6d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fe4f2190640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec0cfb00 0x7fe4ec0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fe4f2190640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0d0cc0 con 0x7fe4ec0ce760 2023-11-27T22:29:48.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fe4f2190640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0d04f0 con 0x7fe4ec15d1e0 2023-11-27T22:29:48.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7fe4f2190640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0cef90 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.411+0000 7f694ffff640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f694803e840 0x7f6948053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fe4eaffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe4ec0ce760 0x7fe4ec0d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:44408/0 (socket says 172.21.15.154:44408) 2023-11-27T22:29:48.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fe4eaffd640 1 -- 172.21.15.154:0/364963125 learned_addr learned my addr 172.21.15.154:0/364963125 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:48.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6ca2ffd640 1 -- 172.21.15.154:0/3273556405 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90031640 con 0x7f6c9c00c070 2023-11-27T22:29:48.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6ca2ffd640 1 -- 172.21.15.154:0/3273556405 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900317a0 con 0x7f6c9c00c070 2023-11-27T22:29:48.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6ca2ffd640 1 -- 172.21.15.154:0/3273556405 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90031b30 con 0x7f6c9c00c070 2023-11-27T22:29:48.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6955258640 1 -- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f694803e840 msgr2=0x7f6948053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6955258640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f694803e840 0x7f6948053bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6955258640 1 -- 172.21.15.154:0/3147532378 >> v1:172.21.15.194:6789/0 conn(0x7f69480e30c0 legacy=0x7f6948057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f6955258640 1 -- 172.21.15.154:0/3147532378 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948058850 con 0x7f6948054130 2023-11-27T22:29:48.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f694ffff640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f694803e840 0x7f6948053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fdfff59e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdff80dfe90 0x7fdff80525d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fdfff59e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdff80398a0 0x7fdff804fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fdfff59e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff8039da0 con 0x7fdff8052b10 2023-11-27T22:29:48.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fdfff59e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff803a080 con 0x7fdff80dfe90 2023-11-27T22:29:48.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fdfff59e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff804f050 con 0x7fdff80398a0 2023-11-27T22:29:48.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fe4eb7fe640 1 --2- 172.21.15.154:0/364963125 >> v2:172.21.15.194:3300/0 conn(0x7fe4ec15d1e0 0x7fe4ec0d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f700a7fc640 1 -- 172.21.15.154:0/4039355645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c06e5b0 msgr2=0x7f700c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f700a7fc640 1 --2- 172.21.15.154:0/4039355645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c06e5b0 0x7f700c0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f700a7fc640 1 -- 172.21.15.154:0/4039355645 >> v2:172.21.15.194:3300/0 conn(0x7f700c159e10 msgr2=0x7f700c0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f700a7fc640 1 --2- 172.21.15.154:0/4039355645 >> v2:172.21.15.194:3300/0 conn(0x7f700c159e10 0x7f700c0b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7f700a7fc640 1 -- 172.21.15.154:0/4039355645 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c06eda0 con 0x7f700c0b50f0 2023-11-27T22:29:48.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fefb7ee1640 1 -- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80542c0 msgr2=0x7fefa8006890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fdffdd9b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdff80398a0 0x7fdff804fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.412+0000 7fefb7ee1640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80542c0 0x7fefa8006890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009870 tx=0x7fefa002ba50 comp rx=0 tx=0).stop 2023-11-27T22:29:48.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffdd9b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdff80398a0 0x7fdff804fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:57008/0 (socket says 172.21.15.154:57008) 2023-11-27T22:29:48.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffdd9b640 1 -- 172.21.15.154:0/2413811116 learned_addr learned my addr 172.21.15.154:0/2413811116 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fde8398a640 1 -- 172.21.15.154:0/757954288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c162530 msgr2=0x7fde7c06c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fde8398a640 1 --2- 172.21.15.154:0/757954288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c162530 0x7fde7c06c700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d90 tx=0x7fde7402be20 comp rx=0 tx=0).stop 2023-11-27T22:29:48.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 -- 172.21.15.154:0/201338813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 msgr2=0x7efc080b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 --2- 172.21.15.154:0/201338813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 0x7efc080b34e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009870 tx=0x7efbf802b980 comp rx=0 tx=0).stop 2023-11-27T22:29:48.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fefb7ee1640 1 -- 172.21.15.154:0/361899784 shutdown_connections 2023-11-27T22:29:48.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 -- 172.21.15.154:0/201338813 shutdown_connections 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 --2- 172.21.15.154:0/201338813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc08165bf0 0x7efc080b34e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 --2- 172.21.15.154:0/201338813 >> v2:172.21.15.194:3300/0 conn(0x7efc080b3100 0x7efc08070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 -- 172.21.15.154:0/201338813 >> 172.21.15.154:0/201338813 conn(0x7efc080b0b10 msgr2=0x7efc080b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fefb7ee1640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80542c0 0x7fefa8006890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fefb7ee1640 1 --2- 172.21.15.154:0/361899784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa80e3080 0x7fefa8057d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fefb7ee1640 1 -- 172.21.15.154:0/361899784 >> 172.21.15.154:0/361899784 conn(0x7fefa80559a0 msgr2=0x7fefa8055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fe4eb7fe640 1 -- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec0cfb00 msgr2=0x7fe4ec0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fe4eb7fe640 1 --2- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec0cfb00 0x7fe4ec0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fe4eb7fe640 1 -- 172.21.15.154:0/364963125 >> v1:172.21.15.154:6789/0 conn(0x7fe4ec0ce760 legacy=0x7fe4ec0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fefb7ee1640 1 -- 172.21.15.154:0/361899784 shutdown_connections 2023-11-27T22:29:48.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffe59c640 1 --2- 172.21.15.154:0/2413811116 >> v2:172.21.15.154:3300/0 conn(0x7fdff80dfe90 0x7fdff80525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 msgr2=0x7f6c9c038050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 --2- 172.21.15.154:0/3273556405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 0x7f6c9c038050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009870 tx=0x7f6c9002b8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fe4eb7fe640 1 -- 172.21.15.154:0/364963125 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0d0f80 con 0x7fe4ec15d1e0 2023-11-27T22:29:48.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fefb7ee1640 1 -- 172.21.15.154:0/361899784 wait complete. 2023-11-27T22:29:48.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 -- 172.21.15.154:0/201338813 shutdown_connections 2023-11-27T22:29:48.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffdd9b640 1 -- 172.21.15.154:0/2413811116 >> v2:172.21.15.154:3300/0 conn(0x7fdff80dfe90 msgr2=0x7fdff80525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6955258640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6948054130 0x7f69480068d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6944009870 tx=0x7f694402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d051aa1381a68a4f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffdd9b640 1 --2- 172.21.15.154:0/2413811116 >> v2:172.21.15.154:3300/0 conn(0x7fdff80dfe90 0x7fdff80525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffdd9b640 1 -- 172.21.15.154:0/2413811116 >> v1:172.21.15.154:6789/0 conn(0x7fdff8052b10 legacy=0x7fdff80506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fdffdd9b640 1 -- 172.21.15.154:0/2413811116 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff804f330 con 0x7fdff80398a0 2023-11-27T22:29:48.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 shutdown_connections 2023-11-27T22:29:48.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 --2- 172.21.15.154:0/3273556405 >> v2:172.21.15.194:3300/0 conn(0x7f6c9c033ec0 0x7f6c9c04fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 --2- 172.21.15.154:0/3273556405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c00c070 0x7f6c9c038050 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 >> 172.21.15.154:0/3273556405 conn(0x7f6c9c009f80 msgr2=0x7f6c9c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f700a7fc640 1 --2- 172.21.15.154:0/4039355645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c0b50f0 0x7f700c06e070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f700c0d09d0 tx=0x7f6ffc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89e132de1857392 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f694f7fe640 1 -- 172.21.15.154:0/3147532378 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944031520 con 0x7f6948054130 2023-11-27T22:29:48.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f694f7fe640 1 -- 172.21.15.154:0/3147532378 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944031680 con 0x7f6948054130 2023-11-27T22:29:48.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 shutdown_connections 2023-11-27T22:29:48.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f694f7fe640 1 -- 172.21.15.154:0/3147532378 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944031a10 con 0x7f6948054130 2023-11-27T22:29:48.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7f6ca94d7640 1 -- 172.21.15.154:0/3273556405 wait complete. 2023-11-27T22:29:48.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7efc10210640 1 -- 172.21.15.154:0/201338813 wait complete. 2023-11-27T22:29:48.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fde8398a640 1 -- 172.21.15.154:0/757954288 shutdown_connections 2023-11-27T22:29:48.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fde8398a640 1 --2- 172.21.15.154:0/757954288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c162530 0x7fde7c06c700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fde8398a640 1 --2- 172.21.15.154:0/757954288 >> v2:172.21.15.194:3300/0 conn(0x7fde7c14b020 0x7fde7c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.413+0000 7fde8398a640 1 -- 172.21.15.154:0/757954288 >> 172.21.15.154:0/757954288 conn(0x7fde7c06a6b0 msgr2=0x7fde7c06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f7009ffb640 1 -- 172.21.15.154:0/4039355645 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc031870 con 0x7f700c0b50f0 2023-11-27T22:29:48.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7fde8398a640 1 -- 172.21.15.154:0/757954288 shutdown_connections 2023-11-27T22:29:48.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f6956cbb640 1 -- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6948054130 msgr2=0x7f69480068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f6956cbb640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6948054130 0x7f69480068d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6944009870 tx=0x7f694402b840 comp rx=0 tx=0).stop 2023-11-27T22:29:48.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7fdffdd9b640 1 --2- 172.21.15.154:0/2413811116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff804fb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b370 tx=0x7fdff002da00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1faeba5291dab725 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f7009ffb640 1 -- 172.21.15.154:0/4039355645 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc0319d0 con 0x7f700c0b50f0 2023-11-27T22:29:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f6956cbb640 1 -- 172.21.15.154:0/3147532378 shutdown_connections 2023-11-27T22:29:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f6956cbb640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6948054130 0x7f69480068d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f6956cbb640 1 --2- 172.21.15.154:0/3147532378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f694803e840 0x7f6948053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7fe4eb7fe640 1 --2- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec15d1e0 0x7fe4ec0d3cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009d90 tx=0x7fe4e402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c154d12c49c105 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f6956cbb640 1 -- 172.21.15.154:0/3147532378 >> 172.21.15.154:0/3147532378 conn(0x7f69480559e0 msgr2=0x7f6948055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7f7009ffb640 1 -- 172.21.15.154:0/4039355645 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc031d60 con 0x7f700c0b50f0 2023-11-27T22:29:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.414+0000 7fe4ea7fc640 1 -- 172.21.15.154:0/364963125 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e402cc50 con 0x7fe4ec15d1e0 2023-11-27T22:29:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fefb7ee1640 1 Processor -- start 2023-11-27T22:29:48.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fe4ea7fc640 1 -- 172.21.15.154:0/364963125 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e402cdb0 con 0x7fe4ec15d1e0 2023-11-27T22:29:48.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fde8398a640 1 -- 172.21.15.154:0/757954288 wait complete. 2023-11-27T22:29:48.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fefb7ee1640 1 -- start start 2023-11-27T22:29:48.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7efc10210640 1 Processor -- start 2023-11-27T22:29:48.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7efc10210640 1 -- start start 2023-11-27T22:29:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fdffd59a640 1 -- 172.21.15.154:0/2413811116 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0031820 con 0x7fdff80398a0 2023-11-27T22:29:48.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fdffd59a640 1 -- 172.21.15.154:0/2413811116 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff0031980 con 0x7fdff80398a0 2023-11-27T22:29:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f6956cbb640 1 -- 172.21.15.154:0/3147532378 shutdown_connections 2023-11-27T22:29:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fdffd59a640 1 -- 172.21.15.154:0/2413811116 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0031d10 con 0x7fdff80398a0 2023-11-27T22:29:48.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f6956cbb640 1 -- 172.21.15.154:0/3147532378 wait complete. 2023-11-27T22:29:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f6ca94d7640 1 Processor -- start 2023-11-27T22:29:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 -- 172.21.15.154:0/4039355645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c0b50f0 msgr2=0x7f700c06e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 --2- 172.21.15.154:0/4039355645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c0b50f0 0x7f700c06e070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f700c0d09d0 tx=0x7f6ffc02b910 comp rx=0 tx=0).stop 2023-11-27T22:29:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 -- 172.21.15.154:0/4039355645 shutdown_connections 2023-11-27T22:29:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 --2- 172.21.15.154:0/4039355645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c06e5b0 0x7f700c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 --2- 172.21.15.154:0/4039355645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c0b50f0 0x7f700c06e070 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f700c0d09d0 tx=0x7f6ffc02b910 comp rx=0 tx=0).stop 2023-11-27T22:29:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f6ca94d7640 1 -- start start 2023-11-27T22:29:48.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7fe4ea7fc640 1 -- 172.21.15.154:0/364963125 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4034660 con 0x7fe4ec15d1e0 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 --2- 172.21.15.154:0/4039355645 >> v2:172.21.15.194:3300/0 conn(0x7f700c159e10 0x7f700c0b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.415+0000 7f70116c9640 1 -- 172.21.15.154:0/4039355645 >> 172.21.15.154:0/4039355645 conn(0x7f700c0cfec0 msgr2=0x7f700c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb7ee1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa803e800 0x7fefa80e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb7ee1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefa80542c0 0x7fefa80dd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb7ee1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80e3080 0x7fefa80dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb7ee1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa817cec0 con 0x7fefa80542c0 2023-11-27T22:29:48.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb7ee1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80e73f0 con 0x7fefa80e3080 2023-11-27T22:29:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb7ee1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa817d100 con 0x7fefa803e800 2023-11-27T22:29:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb5c7d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa803e800 0x7fefa80e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fdfff59e640 1 -- 172.21.15.154:0/2413811116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 msgr2=0x7fdff804fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7f70116c9640 1 -- 172.21.15.154:0/4039355645 shutdown_connections 2023-11-27T22:29:48.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fdfff59e640 1 --2- 172.21.15.154:0/2413811116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff804fb30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdff800b370 tx=0x7fdff002da00 comp rx=0 tx=0).stop 2023-11-27T22:29:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb547c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefa80542c0 0x7fefa80dd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb547c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefa80542c0 0x7fefa80dd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56628/0 (socket says 172.21.15.154:56628) 2023-11-27T22:29:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb547c640 1 -- 172.21.15.154:0/2391451371 learned_addr learned my addr 172.21.15.154:0/2391451371 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fefb647e640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80e3080 0x7fefa80dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fe4f2190640 1 -- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec15d1e0 msgr2=0x7fe4ec0d3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fe4f2190640 1 --2- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec15d1e0 0x7fe4ec0d3cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009d90 tx=0x7fe4e402bea0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fde8398a640 1 Processor -- start 2023-11-27T22:29:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fdfff59e640 1 -- 172.21.15.154:0/2413811116 shutdown_connections 2023-11-27T22:29:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fdfff59e640 1 --2- 172.21.15.154:0/2413811116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff804fb30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fdfff59e640 1 --2- 172.21.15.154:0/2413811116 >> v2:172.21.15.154:3300/0 conn(0x7fdff80dfe90 0x7fdff80525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fdfff59e640 1 -- 172.21.15.154:0/2413811116 >> 172.21.15.154:0/2413811116 conn(0x7fdff8009f80 msgr2=0x7fdff800a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fde8398a640 1 -- start start 2023-11-27T22:29:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fe4f2190640 1 -- 172.21.15.154:0/364963125 shutdown_connections 2023-11-27T22:29:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fe4f2190640 1 --2- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec0cfb00 0x7fe4ec0cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fe4f2190640 1 --2- 172.21.15.154:0/364963125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec15d1e0 0x7fe4ec0d3cb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7fe4f2190640 1 -- 172.21.15.154:0/364963125 >> 172.21.15.154:0/364963125 conn(0x7fe4ec09c300 msgr2=0x7fe4ec0d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.416+0000 7f70116c9640 1 -- 172.21.15.154:0/4039355645 wait complete. 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fdfff59e640 1 -- 172.21.15.154:0/2413811116 shutdown_connections 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb547c640 1 -- 172.21.15.154:0/2391451371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa803e800 msgr2=0x7fefa80e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb547c640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefa803e800 0x7fefa80e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb547c640 1 -- 172.21.15.154:0/2391451371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80e3080 msgr2=0x7fefa80dd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb547c640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80e3080 0x7fefa80dd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb547c640 1 -- 172.21.15.154:0/2391451371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00094d0 con 0x7fefa80542c0 2023-11-27T22:29:48.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb647e640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefa80e3080 0x7fefa80dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc10210640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc0806d6e0 0x7efc080a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc10210640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc080b3100 0x7efc0815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc10210640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc08165bf0 0x7efc0814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc0dfac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc0806d6e0 0x7efc080a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc0dfac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc0806d6e0 0x7efc080a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56644/0 (socket says 172.21.15.154:56644) 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc0dfac640 1 -- 172.21.15.154:0/335050185 learned_addr learned my addr 172.21.15.154:0/335050185 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0814da20 con 0x7efc0806d6e0 2023-11-27T22:29:48.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0814e880 con 0x7efc08165bf0 2023-11-27T22:29:48.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0814dc70 con 0x7efc080b3100 2023-11-27T22:29:48.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6ca94d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c00c070 0x7f6c9c175df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc0d7ab640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc080b3100 0x7efc0815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7efc0e7ad640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc08165bf0 0x7efc0814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6ca94d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c9c033ec0 0x7f6c9c177ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6ca94d7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c053c40 0x7f6c9c049610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6ca94d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0dfbc0 con 0x7f6c9c00c070 2023-11-27T22:29:48.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6ca94d7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c178020 con 0x7f6c9c033ec0 2023-11-27T22:29:48.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca94d7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c04cb70 con 0x7f6c9c053c40 2023-11-27T22:29:48.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c00c070 0x7f6c9c175df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fdfff59e640 1 -- 172.21.15.154:0/2413811116 wait complete. 2023-11-27T22:29:48.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6956cbb640 1 Processor -- start 2023-11-27T22:29:48.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7f6956cbb640 1 -- start start 2023-11-27T22:29:48.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fe4f2190640 1 -- 172.21.15.154:0/364963125 shutdown_connections 2023-11-27T22:29:48.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c9c033ec0 0x7f6c9c177ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c9c033ec0 0x7f6c9c177ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:57034/0 (socket says 172.21.15.154:57034) 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 -- 172.21.15.154:0/1315181352 learned_addr learned my addr 172.21.15.154:0/1315181352 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fefb547c640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefa80542c0 0x7fefa80dd2a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fefb00620a0 tx=0x7fefb0067f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb006bc30 con 0x7fefa80542c0 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa817d3e0 con 0x7fefa80542c0 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa817d9a0 con 0x7fefa80542c0 2023-11-27T22:29:48.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c00c070 0x7f6c9c175df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56646/0 (socket says 172.21.15.154:56646) 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca8cd6640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c053c40 0x7f6c9c049610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 -- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c053c40 msgr2=0x7f6c9c049610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c053c40 0x7f6c9c049610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 -- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c00c070 msgr2=0x7f6c9c175df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c9c00c070 0x7f6c9c175df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca37fe640 1 -- 172.21.15.154:0/1315181352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900094d0 con 0x7f6c9c033ec0 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f6ca8cd6640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c9c053c40 0x7f6c9c049610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde8398a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c06cc40 0x7fde7c142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde8398a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c14b020 0x7fde7c160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde81726640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c06cc40 0x7fde7c142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde81726640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c06cc40 0x7fde7c142540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:51528/0 (socket says 172.21.15.154:51528) 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde81726640 1 -- 172.21.15.154:0/890931912 learned_addr learned my addr 172.21.15.154:0/890931912 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde8398a640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c162530 0x7fde7c163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde80f25640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c14b020 0x7fde7c160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c143810 con 0x7fde7c14b020 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde81f27640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c162530 0x7fde7c163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c161070 con 0x7fde7c162530 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c142c00 con 0x7fde7c06cc40 2023-11-27T22:29:48.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7efc0e7ad640 1 -- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc080b3100 msgr2=0x7efc0815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7efc0e7ad640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc080b3100 0x7efc0815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7efc0e7ad640 1 -- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc0806d6e0 msgr2=0x7efc080a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7efc0e7ad640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc0806d6e0 0x7efc080a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7efc0e7ad640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80094d0 con 0x7efc08165bf0 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7fdfff59e640 1 Processor -- start 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fdfff59e640 1 -- start start 2023-11-27T22:29:48.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7efc0e7ad640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc08165bf0 0x7efc0814cbb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c690 tx=0x7efc0000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7f6956cbb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f694803e840 0x7f69480d7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7f6ca37fe640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c9c033ec0 0x7f6c9c177ae0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800b3f0 tx=0x7f6c9800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fde81f27640 1 -- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c06cc40 msgr2=0x7fde7c142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fde81f27640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde7c06cc40 0x7fde7c142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fde81f27640 1 -- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c14b020 msgr2=0x7fde7c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fde81f27640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde7c14b020 0x7fde7c160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00003b70 con 0x7efc08165bf0 2023-11-27T22:29:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc00003cd0 con 0x7efc08165bf0 2023-11-27T22:29:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00005310 con 0x7efc08165bf0 2023-11-27T22:29:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb006bd90 con 0x7fefa80542c0 2023-11-27T22:29:48.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fde81f27640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009a70 con 0x7fde7c162530 2023-11-27T22:29:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0814df50 con 0x7efc08165bf0 2023-11-27T22:29:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb006bc30 con 0x7fefa80542c0 2023-11-27T22:29:48.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0814e510 con 0x7efc08165bf0 2023-11-27T22:29:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f70116c9640 1 Processor -- start 2023-11-27T22:29:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.418+0000 7f70116c9640 1 -- start start 2023-11-27T22:29:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011830 con 0x7f6c9c033ec0 2023-11-27T22:29:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98011990 con 0x7f6c9c033ec0 2023-11-27T22:29:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011d40 con 0x7f6c9c033ec0 2023-11-27T22:29:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.417+0000 7fe4f2190640 1 -- 172.21.15.154:0/364963125 wait complete. 2023-11-27T22:29:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.419+0000 7fe4f2190640 1 Processor -- start 2023-11-27T22:29:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6956cbb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6948054130 0x7f694804eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fde81f27640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c162530 0x7fde7c163890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b410 tx=0x7fde6c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6954a57640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f694803e840 0x7f69480d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6954a57640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f694803e840 0x7f69480d7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:57056/0 (socket says 172.21.15.154:57056) 2023-11-27T22:29:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fdfff59e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff80d6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6956cbb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69480e30c0 0x7f694804eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6956cbb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480d7990 con 0x7f69480e30c0 2023-11-27T22:29:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6956cbb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69480db1a0 con 0x7f694803e840 2023-11-27T22:29:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6956cbb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69480db480 con 0x7f6948054130 2023-11-27T22:29:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f6954a57640 1 -- 172.21.15.154:0/1236022496 learned_addr learned my addr 172.21.15.154:0/1236022496 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fdfff59e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdff8052b10 0x7fdff804afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f694ffff640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6948054130 0x7f694804eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fdfff59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff80dfe90 0x7fdff80d8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fdfff59e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80d8ab0 con 0x7fdff80dfe90 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fdfff59e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80d8ce0 con 0x7fdff80398a0 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fdfff59e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff80d8fc0 con 0x7fdff8052b10 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f70116c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c06e5b0 0x7f700c15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f70116c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c159e10 0x7f700c136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f70116c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f700c159050 0x7f700c141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f70116c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c15d060 con 0x7f700c06e5b0 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f70116c9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c156c00 con 0x7f700c159050 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f70116c9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c15d9b0 con 0x7f700c159e10 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f700c159050 0x7f700c141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f700c159050 0x7f700c141740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:57066/0 (socket says 172.21.15.154:57066) 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 -- 172.21.15.154:0/620392387 learned_addr learned my addr 172.21.15.154:0/620392387 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef98000fc0 con 0x7fefa80542c0 2023-11-27T22:29:48.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 -- 172.21.15.154:0/620392387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c159e10 msgr2=0x7f700c136690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T22:29:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c011830 con 0x7fde7c162530 2023-11-27T22:29:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c0119b0 con 0x7fde7c162530 2023-11-27T22:29:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7efbebfff640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbe4000fc0 con 0x7efc08165bf0 2023-11-27T22:29:48.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f694ffff640 1 -- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f694803e840 msgr2=0x7f69480d7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0df290 con 0x7f6c9c033ec0 2023-11-27T22:29:48.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f700c159e10 0x7f700c136690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 -- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c06e5b0 msgr2=0x7f700c15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f700b7fe640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f700c06e5b0 0x7f700c15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f694ffff640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f694803e840 0x7f69480d7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c0df850 con 0x7f6c9c033ec0 2023-11-27T22:29:48.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f694ffff640 1 -- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69480e30c0 msgr2=0x7f694804eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f700b7fe640 1 -- 172.21.15.154:0/620392387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc0094d0 con 0x7f700c159050 2023-11-27T22:29:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f694ffff640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f69480e30c0 0x7f694804eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7f694ffff640 1 -- 172.21.15.154:0/1236022496 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c009400 con 0x7f6948054130 2023-11-27T22:29:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.420+0000 7fe4f2190640 1 -- start start 2023-11-27T22:29:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fe4f2190640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec0ce760 0x7fe4ec0c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fe4f2190640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec0cfb00 0x7fe4ec0c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c011d60 con 0x7fde7c162530 2023-11-27T22:29:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c142ee0 con 0x7fde7c162530 2023-11-27T22:29:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c1434a0 con 0x7fde7c162530 2023-11-27T22:29:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fe4f2190640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec15d1e0 0x7fe4ec160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f700b7fe640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f700c159050 0x7f700c141740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f700400efc0 tx=0x7f700400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fe4f2190640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec161020 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f694ffff640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6948054130 0x7f694804eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e870 tx=0x7f693c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fdffe59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff80d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004009b10 con 0x7f700c159050 2023-11-27T22:29:48.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fe4f2190640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec15caf0 con 0x7fe4ec0ce760 2023-11-27T22:29:48.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fdffe59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff80d6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:57080/0 (socket says 172.21.15.154:57080) 2023-11-27T22:29:48.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fdffe59c640 1 -- 172.21.15.154:0/2245549622 learned_addr learned my addr 172.21.15.154:0/2245549622 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fe4f2190640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c7470 con 0x7fe4ec15d1e0 2023-11-27T22:29:48.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c15d250 con 0x7f700c159050 2023-11-27T22:29:48.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c13e870 con 0x7f700c159050 2023-11-27T22:29:48.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.421+0000 7fdffdd9b640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdff8052b10 0x7fdff804afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c9c04ffa0 con 0x7f6c9c033ec0 2023-11-27T22:29:48.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700400f040 con 0x7f700c159050 2023-11-27T22:29:48.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70040146c0 con 0x7f700c159050 2023-11-27T22:29:48.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fdffe59c640 1 -- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdff8052b10 msgr2=0x7fdff804afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fdffe59c640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdff8052b10 0x7fdff804afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fdffe59c640 1 -- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff80dfe90 msgr2=0x7fdff80d8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fdffe59c640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdff80dfe90 0x7fdff80d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fdffe59c640 1 -- 172.21.15.154:0/2245549622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00094d0 con 0x7fdff80398a0 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c00c940 con 0x7f6948054130 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c00caa0 con 0x7f6948054130 2023-11-27T22:29:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c00ce30 con 0x7f6948054130 2023-11-27T22:29:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde7c0b2b00 con 0x7fde7c162530 2023-11-27T22:29:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fe4eb7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec0ce760 0x7fe4ec0c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69440094d0 con 0x7f6948054130 2023-11-27T22:29:48.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69480dba40 con 0x7f6948054130 2023-11-27T22:29:48.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fdffe59c640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff80d6240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe000068f20 tx=0x7fe0000678b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fe4eaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec0cfb00 0x7fe4ec0c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fe4eaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec0cfb00 0x7fe4ec0c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56684/0 (socket says 172.21.15.154:56684) 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fe4eaffd640 1 -- 172.21.15.154:0/2456121167 learned_addr learned my addr 172.21.15.154:0/2456121167 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eaffd640 1 -- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec15d1e0 msgr2=0x7fe4ec160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7fe4ebfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec15d1e0 0x7fe4ec160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eaffd640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec15d1e0 0x7fe4ec160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eaffd640 1 -- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec0ce760 msgr2=0x7fe4ec0c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eaffd640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec0ce760 0x7fe4ec0c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eaffd640 1 -- 172.21.15.154:0/2456121167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009a70 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6930000fc0 con 0x7f6948054130 2023-11-27T22:29:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eb7fe640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4ec0ce760 0x7fe4ec0c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4ebfff640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4ec15d1e0 0x7fe4ec160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:48.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fefb00721c0 con 0x7fefa80542c0 2023-11-27T22:29:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.422+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fec000fc0 con 0x7f700c159050 2023-11-27T22:29:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fde6c01a400 con 0x7fde7c162530 2023-11-27T22:29:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00006bb30 con 0x7fdff80398a0 2023-11-27T22:29:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00006bc90 con 0x7fdff80398a0 2023-11-27T22:29:48.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff80d39d0 con 0x7fdff80398a0 2023-11-27T22:29:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7004014820 con 0x7f700c159050 2023-11-27T22:29:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.423+0000 7fe4eaffd640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec0cfb00 0x7fe4ec0c6e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c440 tx=0x7fe4e0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efc00005470 con 0x7efc08165bf0 2023-11-27T22:29:48.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0005ce0 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7efbfe7fc640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efbec06b290 0x7efbec06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7f6ff37fe640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ff806b1c0 0x7f6ff806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0005e40 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc0008a170 con 0x7efc08165bf0 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fefa67fc640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fef9406b280 0x7fef9406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefb01036c0 con 0x7fefa80542c0 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fefa67fc640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7fef94073420 0x7fef94075840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 --> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef94075ef0 con 0x7fef94073420 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb006bc30 con 0x7fefa80542c0 2023-11-27T22:29:48.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7efbfe7fc640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7efbec0734a0 0x7efbec0758c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000093440 con 0x7fdff80398a0 2023-11-27T22:29:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff80d3f90 con 0x7fdff80398a0 2023-11-27T22:29:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6c9801a400 con 0x7f6c9c033ec0 2023-11-27T22:29:48.498 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbec075f70 con 0x7efbec0734a0 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc0008a520 con 0x7efc08165bf0 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fde71ffb640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b210 0x7fde6006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde6c089fe0 con 0x7fde7c162530 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fde71ffb640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fde60073430 0x7fde60075850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde60075f00 con 0x7fde60073430 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.424+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde6c08a3b0 con 0x7fde7c162530 2023-11-27T22:29:48.499 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7fefb5c7d640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fef9406b280 0x7fef9406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7fde80f25640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fde60073430 0x7fde60075850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7fde81726640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b210 0x7fde6006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f700408aa10 con 0x7f700c159050 2023-11-27T22:29:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ff37fe640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7f6ff80733e0 0x7f6ff8075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 --> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ff8075eb0 con 0x7f6ff80733e0 2023-11-27T22:29:48.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f700408adc0 con 0x7f700c159050 2023-11-27T22:29:48.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7efc0d7ab640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7efbec0734a0 0x7efbec0758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ca0ff9640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6c8806b210 0x7f6c8806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f700affd640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ff806b1c0 0x7f6ff806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.501 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7fefb647e640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7fef94073420 0x7fef94075840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f693c005990 con 0x7f6948054130 2023-11-27T22:29:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7efc0dfac640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efbec06b290 0x7efbec06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c9808a090 con 0x7f6c9c033ec0 2023-11-27T22:29:48.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ca0ff9640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7f6c88073430 0x7f6c88075850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f700a7fc640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7f6ff80733e0 0x7f6ff8075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 --> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c88075f00 con 0x7f6c88073430 2023-11-27T22:29:48.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.425+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c9808a400 con 0x7f6c9c033ec0 2023-11-27T22:29:48.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f694d7fa640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f693406b210 0x7f693406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f693c08a3c0 con 0x7f6948054130 2023-11-27T22:29:48.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0c7750 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7fde80f25640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fde60073430 0x7fde60075850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f6ca8cd6640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7f6c88073430 0x7f6c88075850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdff80e0270 con 0x7fdff80398a0 2023-11-27T22:29:48.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f6954a57640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f693406b210 0x7f693406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f694d7fa640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f6934073430 0x7f6934075850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 --> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6934075f00 con 0x7f6934073430 2023-11-27T22:29:48.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f693c08a730 con 0x7f6948054130 2023-11-27T22:29:48.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7fefb5c7d640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fef9406b280 0x7fef9406d740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefac00a990 tx=0x7fefac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7efc0d7ab640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7efbec0734a0 0x7efbec0758c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f6ca3fff640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6c8806b210 0x7f6c8806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7fefb647e640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7fef94073420 0x7fef94075840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f6955258640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f6934073430 0x7f6934075850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f6954a57640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f693406b210 0x7f693406d6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6950069d60 tx=0x7f695004f870 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7f6ca8cd6640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7f6c88073430 0x7f6c88075850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7fde81726640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b210 0x7fde6006d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde780094a0 tx=0x7fde78009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.426+0000 7efc0dfac640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efbec06b290 0x7efbec06d750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc04006fd0 tx=0x7efc04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7f700affd640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ff806b1c0 0x7f6ff806d680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f7000008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== osd.3 v2:172.21.15.154:6818/85167042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fde60075f00 con 0x7fde60073430 2023-11-27T22:29:48.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0c7d10 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== osd.0 v2:172.21.15.154:6808/1665928512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fef94075ef0 con 0x7fef94073420 2023-11-27T22:29:48.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7f6955258640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f6934073430 0x7f6934075850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e00072d0 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7f700a7fc640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7f6ff80733e0 0x7f6ff8075800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== osd.1 v2:172.21.15.154:6800/2129709276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6c88075f00 con 0x7f6c88073430 2023-11-27T22:29:48.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.427+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe000093660 con 0x7fdff80398a0 2023-11-27T22:29:48.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7f6ca3fff640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6c8806b210 0x7f6c8806d6d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c9003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7fdfeeffd640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfe006b210 0x7fdfe006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== osd.2 v2:172.21.15.154:6816/498194302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6ff8075eb0 con 0x7f6ff80733e0 2023-11-27T22:29:48.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== osd.4 v2:172.21.15.194:6800/3400970964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efbec075f70 con 0x7efbec0734a0 2023-11-27T22:29:48.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4ec0d2170 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.428+0000 7fdffdd9b640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfe006b210 0x7fdfe006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== osd.6 v2:172.21.15.194:6816/1458667325 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6934075f00 con 0x7f6934073430 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0000d23a0 con 0x7fdff80398a0 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdfeeffd640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7fdfe00732c0 0x7fdfe00756e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 --> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfe0075d90 con 0x7fdfe00732c0 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0000679a0 con 0x7fdff80398a0 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdffed9d640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7fdfe00732c0 0x7fdfe00756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdffdd9b640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfe006b210 0x7fdfe006d6d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdff0038000 tx=0x7fdff0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.429+0000 7fdffed9d640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7fdfe00732c0 0x7fdfe00756e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe4e00074f0 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4d3fff640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe4d806b290 0x7fe4d806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== osd.5 v2:172.21.15.194:6808/3406558424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdfe0075d90 con 0x7fdfe00732c0 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4e0088f70 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4eb7fe640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe4d806b290 0x7fe4d806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4d3fff640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7fe4d80734b0 0x7fe4d80758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 --> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe4d8075f80 con 0x7fe4d80734b0 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.430+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4e008b590 con 0x7fe4ec0cfb00 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.431+0000 7fe4ebfff640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7fe4d80734b0 0x7fe4d80758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.431+0000 7fe4eb7fe640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe4d806b290 0x7fe4d806d750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4036000 tx=0x7fe4e4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.431+0000 7fe4ebfff640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7fe4d80734b0 0x7fe4d80758d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.432+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== osd.7 v2:172.21.15.194:6824/1808763162 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe4d8075f80 con 0x7fe4d80734b0 2023-11-27T22:29:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.457+0000 7efbebfff640 1 -- 172.21.15.154:0/335050185 --> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbe4002cb0 con 0x7efbec0734a0 2023-11-27T22:29:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.458+0000 7efbfe7fc640 1 -- 172.21.15.154:0/335050185 <== osd.4 v2:172.21.15.194:6800/3400970964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efbe4002cb0 con 0x7efbec0734a0 2023-11-27T22:29:48.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7efbec0734a0 msgr2=0x7efbec0758c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7efc10210640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7efbec0734a0 0x7efbec0758c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 --> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde7c0b2820 con 0x7fde60073430 2023-11-27T22:29:48.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efbec06b290 msgr2=0x7efbec06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7efc10210640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efbec06b290 0x7efbec06d750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efc04006fd0 tx=0x7efc04008040 comp rx=0 tx=0).stop 2023-11-27T22:29:48.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc08165bf0 msgr2=0x7efc0814cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7efc10210640 1 --2- 172.21.15.154:0/335050185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc08165bf0 0x7efc0814cbb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c690 tx=0x7efc0000cb50 comp rx=0 tx=0).stop 2023-11-27T22:29:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.459+0000 7fde71ffb640 1 -- 172.21.15.154:0/890931912 <== osd.3 v2:172.21.15.154:6818/85167042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde740344c0 con 0x7fde60073430 2023-11-27T22:29:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7efc0e7ad640 1 -- 172.21.15.154:0/335050185 reap_dead start 2023-11-27T22:29:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 shutdown_connections 2023-11-27T22:29:48.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 >> 172.21.15.154:0/335050185 conn(0x7efc080b0b10 msgr2=0x7efc080cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fde60073430 msgr2=0x7fde60075850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7fde8398a640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fde60073430 0x7fde60075850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 shutdown_connections 2023-11-27T22:29:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.460+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b210 msgr2=0x7fde6006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde6006b210 0x7fde6006d6d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde780094a0 tx=0x7fde78009240 comp rx=0 tx=0).stop 2023-11-27T22:29:48.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 --> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef98002cb0 con 0x7fef94073420 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c162530 msgr2=0x7fde7c163890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 --2- 172.21.15.154:0/890931912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7c162530 0x7fde7c163890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00b410 tx=0x7fde6c00b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde81f27640 1 -- 172.21.15.154:0/890931912 reap_dead start 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 shutdown_connections 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 >> 172.21.15.154:0/890931912 conn(0x7fde7c06a6b0 msgr2=0x7fde7c0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 shutdown_connections 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7efc10210640 1 -- 172.21.15.154:0/335050185 wait complete. 2023-11-27T22:29:48.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fde8398a640 1 -- 172.21.15.154:0/890931912 wait complete. 2023-11-27T22:29:48.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7fefa67fc640 1 -- 172.21.15.154:0/2391451371 <== osd.0 v2:172.21.15.154:6808/1665928512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef98002cb0 con 0x7fef94073420 2023-11-27T22:29:48.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.461+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 --> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c9c005360 con 0x7f6c88073430 2023-11-27T22:29:48.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7fef94073420 msgr2=0x7fef94075840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7f6ca0ff9640 1 -- 172.21.15.154:0/1315181352 <== osd.1 v2:172.21.15.154:6800/2129709276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c9c005360 con 0x7f6c88073430 2023-11-27T22:29:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7fef94073420 0x7fef94075840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fef9406b280 msgr2=0x7fef9406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fef9406b280 0x7fef9406d740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fefac00a990 tx=0x7fefac008040 comp rx=0 tx=0).stop 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 --> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe4ec0d1540 con 0x7fe4d80734b0 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefa80542c0 msgr2=0x7fefa80dd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 --2- 172.21.15.154:0/2391451371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fefa80542c0 0x7fefa80dd2a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fefb00620a0 tx=0x7fefb0067f00 comp rx=0 tx=0).stop 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb647e640 1 -- 172.21.15.154:0/2391451371 reap_dead start 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 shutdown_connections 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 >> 172.21.15.154:0/2391451371 conn(0x7fefa80559a0 msgr2=0x7fefa80e1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 shutdown_connections 2023-11-27T22:29:48.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 --> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6930002cb0 con 0x7f6934073430 2023-11-27T22:29:48.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fefb7ee1640 1 -- 172.21.15.154:0/2391451371 wait complete. 2023-11-27T22:29:48.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.462+0000 7fe4d3fff640 1 -- 172.21.15.154:0/2456121167 <== osd.7 v2:172.21.15.194:6824/1808763162 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe4dc00a9f0 con 0x7fe4d80734b0 2023-11-27T22:29:48.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7f6c88073430 msgr2=0x7f6c88075850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7f6ca94d7640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7f6c88073430 0x7f6c88075850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7f694d7fa640 1 -- 172.21.15.154:0/1236022496 <== osd.6 v2:172.21.15.194:6816/1458667325 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6930002cb0 con 0x7f6934073430 2023-11-27T22:29:48.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6c8806b210 msgr2=0x7f6c8806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7f6ca94d7640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6c8806b210 0x7f6c8806d6d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c9003c040 comp rx=0 tx=0).stop 2023-11-27T22:29:48.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7fe4d80734b0 msgr2=0x7fe4d80758d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7fe4f2190640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7fe4d80734b0 0x7fe4d80758d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe4d806b290 msgr2=0x7fe4d806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.463+0000 7fe4f2190640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe4d806b290 0x7fe4d806d750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4036000 tx=0x7fe4e4030000 comp rx=0 tx=0).stop 2023-11-27T22:29:48.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec0cfb00 msgr2=0x7fe4ec0c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c9c033ec0 msgr2=0x7f6c9c177ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca94d7640 1 --2- 172.21.15.154:0/1315181352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c9c033ec0 0x7f6c9c177ae0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800b3f0 tx=0x7f6c9800b8b0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4f2190640 1 --2- 172.21.15.154:0/2456121167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec0cfb00 0x7fe4ec0c6e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000c440 tx=0x7fe4e0001e70 comp rx=0 tx=0).stop 2023-11-27T22:29:48.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca8cd6640 1 -- 172.21.15.154:0/1315181352 reap_dead start 2023-11-27T22:29:48.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4ebfff640 1 -- 172.21.15.154:0/2456121167 reap_dead start 2023-11-27T22:29:48.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f6934073430 msgr2=0x7f6934075850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 shutdown_connections 2023-11-27T22:29:48.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 >> 172.21.15.154:0/2456121167 conn(0x7fe4ec09c300 msgr2=0x7fe4ec0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f6934073430 0x7f6934075850 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f693406b210 msgr2=0x7f693406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f693406b210 0x7f693406d6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6950069d60 tx=0x7f695004f870 comp rx=0 tx=0).stop 2023-11-27T22:29:48.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6948054130 msgr2=0x7f694804eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 --2- 172.21.15.154:0/1236022496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6948054130 0x7f694804eab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e870 tx=0x7f693c00ed30 comp rx=0 tx=0).stop 2023-11-27T22:29:48.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6955258640 1 -- 172.21.15.154:0/1236022496 reap_dead start 2023-11-27T22:29:48.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 shutdown_connections 2023-11-27T22:29:48.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fe4f2190640 1 -- 172.21.15.154:0/2456121167 wait complete. 2023-11-27T22:29:48.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 shutdown_connections 2023-11-27T22:29:48.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 >> 172.21.15.154:0/1315181352 conn(0x7f6c9c009f80 msgr2=0x7f6c9c0dd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 shutdown_connections 2023-11-27T22:29:48.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 >> 172.21.15.154:0/1236022496 conn(0x7f69480559e0 msgr2=0x7f6948007350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 --> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fec002cb0 con 0x7f6ff80733e0 2023-11-27T22:29:48.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 shutdown_connections 2023-11-27T22:29:48.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7f6ca94d7640 1 -- 172.21.15.154:0/1315181352 wait complete. 2023-11-27T22:29:48.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.464+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 --> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdff8005360 con 0x7fdfe00732c0 2023-11-27T22:29:48.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.465+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 shutdown_connections 2023-11-27T22:29:48.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.465+0000 7f6956cbb640 1 -- 172.21.15.154:0/1236022496 wait complete. 2023-11-27T22:29:48.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.465+0000 7f6ff37fe640 1 -- 172.21.15.154:0/620392387 <== osd.2 v2:172.21.15.154:6816/498194302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fec002cb0 con 0x7f6ff80733e0 2023-11-27T22:29:48.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7f6ff80733e0 msgr2=0x7f6ff8075800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7f6ff80733e0 0x7f6ff8075800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7fdfeeffd640 1 -- 172.21.15.154:0/2245549622 <== osd.5 v2:172.21.15.194:6808/3406558424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdff8005360 con 0x7fdfe00732c0 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ff806b1c0 msgr2=0x7f6ff806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6ff806b1c0 0x7f6ff806d680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f7000008040 comp rx=0 tx=0).stop 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f700c159050 msgr2=0x7f700c141740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 --2- 172.21.15.154:0/620392387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f700c159050 0x7f700c141740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f700400efc0 tx=0x7f700400c490 comp rx=0 tx=0).stop 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f700b7fe640 1 -- 172.21.15.154:0/620392387 reap_dead start 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 shutdown_connections 2023-11-27T22:29:48.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.466+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 >> 172.21.15.154:0/620392387 conn(0x7f700c0cfec0 msgr2=0x7f700c0afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 shutdown_connections 2023-11-27T22:29:48.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7f70116c9640 1 -- 172.21.15.154:0/620392387 wait complete. 2023-11-27T22:29:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7fdfe00732c0 msgr2=0x7fdfe00756e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7fdfe00732c0 0x7fdfe00756e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfe006b210 msgr2=0x7fdfe006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.538 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfe006b210 0x7fdfe006d6d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdff0038000 tx=0x7fdff0008030 comp rx=0 tx=0).stop 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 msgr2=0x7fdff80d6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 --2- 172.21.15.154:0/2245549622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80398a0 0x7fdff80d6240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe000068f20 tx=0x7fe0000678b0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdffed9d640 1 -- 172.21.15.154:0/2245549622 reap_dead start 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 shutdown_connections 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.467+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 >> 172.21.15.154:0/2245549622 conn(0x7fdff8009f80 msgr2=0x7fdff80e3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.468+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 shutdown_connections 2023-11-27T22:29:48.539 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.468+0000 7fdfff59e640 1 -- 172.21.15.154:0/2245549622 wait complete. 2023-11-27T22:29:48.540 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:48.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T22:29:48.541 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:48.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T22:29:48.542 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2023-11-27T22:29:48.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T22:29:48.543 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:48.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T22:29:48.544 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:48.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T22:29:48.545 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:48.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T22:29:48.546 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:48.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T22:29:48.547 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:48.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T22:29:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.748+0000 7f0243436640 1 Processor -- start 2023-11-27T22:29:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.748+0000 7f0243436640 1 -- start start 2023-11-27T22:29:48.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.749+0000 7fc4acd0c640 1 Processor -- start 2023-11-27T22:29:48.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.749+0000 7fe9f742e640 1 Processor -- start 2023-11-27T22:29:48.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.749+0000 7f0243436640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02340df1e0 0x7f0234038040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f0243436640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0234053c30 0x7f023404fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f02411d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02340df1e0 0x7f0234038040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f02411d2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f02340df1e0 0x7f0234038040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53266/0 (socket says 172.21.15.154:53266) 2023-11-27T22:29:48.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f02411d2640 1 -- 172.21.15.154:0/3150602444 learned_addr learned my addr 172.21.15.154:0/3150602444 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.749+0000 7fc4acd0c640 1 -- start start 2023-11-27T22:29:48.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0234054480 con 0x7f0234033eb0 2023-11-27T22:29:48.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7fc4acd0c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4a00e02a0 0x7fc4a00e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f7c959e5640 1 Processor -- start 2023-11-27T22:29:48.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7fc4acd0c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a00e40d0 0x7fc4a00539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7fc4acd0c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a0009480 con 0x7fc4a00dfec0 2023-11-27T22:29:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f7c959e5640 1 -- start start 2023-11-27T22:29:48.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.750+0000 7f99a3b68640 1 Processor -- start 2023-11-27T22:29:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4a6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc4a00e02a0 0x7fc4a00e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4a77fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc4a00dfec0 0x7fc4a00085a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53616/0 (socket says 172.21.15.154:53616) 2023-11-27T22:29:48.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4a77fe640 1 -- 172.21.15.154:0/3351376056 learned_addr learned my addr 172.21.15.154:0/3351376056 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:48.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.749+0000 7fe9f742e640 1 -- start start 2023-11-27T22:29:48.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f742e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 0x7fe9e8053f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4a67fc640 1 -- 172.21.15.154:0/3351376056 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784353958 0 0) 0x7fc4a0009480 con 0x7fc4a00dfec0 2023-11-27T22:29:48.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7f0233fff640 1 -- 172.21.15.154:0/3150602444 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689901622 0 0) 0x7f0234054480 con 0x7f0234033eb0 2023-11-27T22:29:48.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340541a0 con 0x7f02340df1e0 2023-11-27T22:29:48.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f642c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 0x7fe9e8053f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f642c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 0x7fe9e8053f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55542/0 (socket says 172.21.15.154:55542) 2023-11-27T22:29:48.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0234005ef0 con 0x7f0234053c30 2023-11-27T22:29:48.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f642c640 1 -- 172.21.15.154:0/2726784559 learned_addr learned my addr 172.21.15.154:0/2726784559 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e8058c10 con 0x7fe9e80587a0 2023-11-27T22:29:48.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4a7fff640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a00e40d0 0x7fc4a00539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e8057a00 con 0x7fe9e8053760 2023-11-27T22:29:48.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8054540 con 0x7fe9e8005e50 2023-11-27T22:29:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00e4500 con 0x7fc4a00e02a0 2023-11-27T22:29:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0056560 con 0x7fc4a00e40d0 2023-11-27T22:29:48.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7f0233fff640 1 -- 172.21.15.154:0/3150602444 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0228005730 con 0x7f0234033eb0 2023-11-27T22:29:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7fc4a67fc640 1 -- 172.21.15.154:0/3351376056 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc498003520 con 0x7fc4a00dfec0 2023-11-27T22:29:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c959e5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7c90143b50 0x7f7c900ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fe9f642c640 1 -- 172.21.15.154:0/2726784559 >> v1:172.21.15.194:6789/0 conn(0x7fe9e8053760 legacy=0x7fe9e803c030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-27T22:29:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c959e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f000 0x7f7c9006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c959e5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900cf260 con 0x7f7c9006f630 2023-11-27T22:29:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c959e5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900cfde0 con 0x7f7c90143b50 2023-11-27T22:29:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c959e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900cf540 con 0x7f7c9006f000 2023-11-27T22:29:48.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fe9f642c640 1 -- 172.21.15.154:0/2726784559 >> v1:172.21.15.154:6789/0 conn(0x7fe9e80587a0 legacy=0x7fe9e8007240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c8effd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7c90143b50 0x7f7c900ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c8f7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f000 0x7f7c9006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c8e7fc640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7c9006f630 0x7f7c9006e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53632/0 (socket says 172.21.15.154:53632) 2023-11-27T22:29:48.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.751+0000 7f99a3b68640 1 -- start start 2023-11-27T22:29:48.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fa4d54d3640 1 Processor -- start 2023-11-27T22:29:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f99a3b68640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f999c153c50 0x7f999c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f99a3b68640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c06bbf0 0x7f999c0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f99a3b68640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c0b3490 con 0x7f999c0cee90 2023-11-27T22:29:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f99a3b68640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c154030 con 0x7f999c153c50 2023-11-27T22:29:48.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f99a3b68640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0b28a0 con 0x7f999c06bbf0 2023-11-27T22:29:48.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f7c8e7fc640 1 -- 172.21.15.154:0/1543137983 learned_addr learned my addr 172.21.15.154:0/1543137983 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:48.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f02411d2640 1 -- 172.21.15.154:0/3150602444 >> v2:172.21.15.194:3300/0 conn(0x7f0234053c30 msgr2=0x7f023404fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f99a1103640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f999c0cee90 0x7f999c06b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53644/0 (socket says 172.21.15.154:53644) 2023-11-27T22:29:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f99a1103640 1 -- 172.21.15.154:0/263310202 learned_addr learned my addr 172.21.15.154:0/263310202 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fc4a6ffd640 1 -- 172.21.15.154:0/3351376056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a00e40d0 msgr2=0x7fc4a00539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fc4a6ffd640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a00e40d0 0x7fc4a00539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fc4a6ffd640 1 -- 172.21.15.154:0/3351376056 >> v1:172.21.15.194:6789/0 conn(0x7fc4a00dfec0 legacy=0x7fc4a00085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fc4a6ffd640 1 -- 172.21.15.154:0/3351376056 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0056840 con 0x7fc4a00e02a0 2023-11-27T22:29:48.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7fc4a7fff640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a00e40d0 0x7fc4a00539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f99a2105640 1 --2- 172.21.15.154:0/263310202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c06bbf0 0x7f999c0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f02411d2640 1 --2- 172.21.15.154:0/3150602444 >> v2:172.21.15.194:3300/0 conn(0x7f0234053c30 0x7f023404fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f02411d2640 1 -- 172.21.15.154:0/3150602444 >> v1:172.21.15.154:6789/0 conn(0x7f0234033eb0 legacy=0x7f02340069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7f02411d2640 1 -- 172.21.15.154:0/3150602444 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02340061d0 con 0x7f02340df1e0 2023-11-27T22:29:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f7c8dffb640 1 -- 172.21.15.154:0/1543137983 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054858974 0 0) 0x7f7c900cf260 con 0x7f7c9006f630 2023-11-27T22:29:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f7c8f7fe640 1 -- 172.21.15.154:0/1543137983 >> v2:172.21.15.194:3300/0 conn(0x7f7c90143b50 msgr2=0x7f7c900ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f7c8f7fe640 1 --2- 172.21.15.154:0/1543137983 >> v2:172.21.15.194:3300/0 conn(0x7f7c90143b50 0x7f7c900ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fe9f642c640 1 -- 172.21.15.154:0/2726784559 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8057cc0 con 0x7fe9e8005e50 2023-11-27T22:29:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f7c8f7fe640 1 -- 172.21.15.154:0/1543137983 >> v1:172.21.15.194:6789/0 conn(0x7f7c9006f630 legacy=0x7f7c9006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f7c8f7fe640 1 -- 172.21.15.154:0/1543137983 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900cf820 con 0x7f7c9006f000 2023-11-27T22:29:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f02411d2640 1 --2- 172.21.15.154:0/3150602444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f0234038040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f023400b3b0 tx=0x7f022c00abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2da2293d2d32aa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7fe9f642c640 1 --2- 172.21.15.154:0/2726784559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 0x7fe9e8053f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0098a0 tx=0x7fe9ec02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c990f8ef734de2fa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7f99a2105640 1 -- 172.21.15.154:0/263310202 >> v2:172.21.15.154:3300/0 conn(0x7f999c153c50 msgr2=0x7f999c15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.753+0000 7fe9f542a640 1 -- 172.21.15.154:0/2726784559 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec030840 con 0x7fe9e8005e50 2023-11-27T22:29:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fe9f542a640 1 -- 172.21.15.154:0/2726784559 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0309a0 con 0x7fe9e8005e50 2023-11-27T22:29:48.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fe9f542a640 1 -- 172.21.15.154:0/2726784559 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec030d30 con 0x7fe9e8005e50 2023-11-27T22:29:48.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f99a2105640 1 --2- 172.21.15.154:0/263310202 >> v2:172.21.15.154:3300/0 conn(0x7f999c153c50 0x7f999c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f99a2105640 1 -- 172.21.15.154:0/263310202 >> v1:172.21.15.194:6789/0 conn(0x7f999c0cee90 legacy=0x7f999c06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.752+0000 7fa4d54d3640 1 -- start start 2023-11-27T22:29:48.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f99a2105640 1 -- 172.21.15.154:0/263310202 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0b2b60 con 0x7f999c06bbf0 2023-11-27T22:29:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fc4a6ffd640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00e02a0 0x7fc4a00e3b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0097a0 tx=0x7fc49c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff29c88623b7b61 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f0233fff640 1 -- 172.21.15.154:0/3150602444 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c008bf0 con 0x7f02340df1e0 2023-11-27T22:29:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f0233fff640 1 -- 172.21.15.154:0/3150602444 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c008d50 con 0x7f02340df1e0 2023-11-27T22:29:48.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f0233fff640 1 -- 172.21.15.154:0/3150602444 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c00a2f0 con 0x7f02340df1e0 2023-11-27T22:29:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4d54d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fc4a67fc640 1 -- 172.21.15.154:0/3351376056 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c030800 con 0x7fc4a00e02a0 2023-11-27T22:29:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fc4a67fc640 1 -- 172.21.15.154:0/3351376056 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c030960 con 0x7fc4a00e02a0 2023-11-27T22:29:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fc4a67fc640 1 -- 172.21.15.154:0/3351376056 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c030800 con 0x7fc4a00e02a0 2023-11-27T22:29:48.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4d54d3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 0x7fa4d00b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4d54d3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d015a830 con 0x7fa4d015ce60 2023-11-27T22:29:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7f7c8f7fe640 1 --2- 172.21.15.154:0/1543137983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f000 0x7f7c9006a4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009d90 tx=0x7f7c8802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa57ad901b549f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4d54d3640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00b4a70 con 0x7fa4d00b40b0 2023-11-27T22:29:48.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4d54d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00cd020 con 0x7fa4d0159210 2023-11-27T22:29:48.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 msgr2=0x7fe9e8053f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fe9f742e640 1 --2- 172.21.15.154:0/2726784559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 0x7fe9e8053f60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0098a0 tx=0x7fe9ec02b980 comp rx=0 tx=0).stop 2023-11-27T22:29:48.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f7c8dffb640 1 -- 172.21.15.154:0/1543137983 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8802cbc0 con 0x7f7c9006f000 2023-11-27T22:29:48.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ce7fc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 0x7fa4d00b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ceffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ce7fc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 0x7fa4d00b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:49980/0 (socket says 172.21.15.154:49980) 2023-11-27T22:29:48.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f7c8dffb640 1 -- 172.21.15.154:0/1543137983 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8802cd20 con 0x7f7c9006f000 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ce7fc640 1 -- 172.21.15.154:0/15980926 learned_addr learned my addr 172.21.15.154:0/15980926 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ceffd640 1 -- 172.21.15.154:0/15980926 >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 msgr2=0x7fa4d00b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ceffd640 1 --2- 172.21.15.154:0/15980926 >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 0x7fa4d00b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ceffd640 1 -- 172.21.15.154:0/15980926 >> v1:172.21.15.194:6789/0 conn(0x7fa4d015ce60 legacy=0x7fa4d015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.754+0000 7fa4ceffd640 1 -- 172.21.15.154:0/15980926 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00cd300 con 0x7fa4d0159210 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fa4ce7fc640 1 --2- 172.21.15.154:0/15980926 >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 0x7fa4d00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 msgr2=0x7f0234038040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f7c8dffb640 1 -- 172.21.15.154:0/1543137983 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88034660 con 0x7f7c9006f000 2023-11-27T22:29:48.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f0243436640 1 --2- 172.21.15.154:0/3150602444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f0234038040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f023400b3b0 tx=0x7f022c00abe0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f99a2105640 1 --2- 172.21.15.154:0/263310202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c06bbf0 0x7f999c0cd890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99980097a0 tx=0x7f999802ca20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fc501117e80b2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00e02a0 msgr2=0x7fc4a00e3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00e02a0 0x7fc4a00e3b90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0097a0 tx=0x7fc49c02b940 comp rx=0 tx=0).stop 2023-11-27T22:29:48.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 shutdown_connections 2023-11-27T22:29:48.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fe9f742e640 1 --2- 172.21.15.154:0/2726784559 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8005e50 0x7fe9e8053f60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 >> 172.21.15.154:0/2726784559 conn(0x7fe9e803a9f0 msgr2=0x7fe9e803add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 shutdown_connections 2023-11-27T22:29:48.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fe9f742e640 1 -- 172.21.15.154:0/2726784559 wait complete. 2023-11-27T22:29:48.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 shutdown_connections 2023-11-27T22:29:48.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f0243436640 1 --2- 172.21.15.154:0/3150602444 >> v2:172.21.15.194:3300/0 conn(0x7f0234053c30 0x7f023404fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f0243436640 1 --2- 172.21.15.154:0/3150602444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f0234038040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 shutdown_connections 2023-11-27T22:29:48.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a00e40d0 0x7fc4a00539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/3351376056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00e02a0 0x7fc4a00e3b90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 >> 172.21.15.154:0/3351376056 conn(0x7fc4a001ef10 msgr2=0x7fc4a0055c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 >> 172.21.15.154:0/3150602444 conn(0x7f0234009f70 msgr2=0x7f023400a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 shutdown_connections 2023-11-27T22:29:48.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7f99a0902640 1 -- 172.21.15.154:0/263310202 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998031860 con 0x7f999c06bbf0 2023-11-27T22:29:48.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.755+0000 7fc4acd0c640 1 -- 172.21.15.154:0/3351376056 wait complete. 2023-11-27T22:29:48.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f99a0902640 1 -- 172.21.15.154:0/263310202 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99980319c0 con 0x7f999c06bbf0 2023-11-27T22:29:48.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 shutdown_connections 2023-11-27T22:29:48.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f99a0902640 1 -- 172.21.15.154:0/263310202 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998031860 con 0x7f999c06bbf0 2023-11-27T22:29:48.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 -- 172.21.15.154:0/1543137983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f000 msgr2=0x7f7c9006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 --2- 172.21.15.154:0/1543137983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f000 0x7f7c9006a4d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009d90 tx=0x7f7c8802be10 comp rx=0 tx=0).stop 2023-11-27T22:29:48.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f0243436640 1 -- 172.21.15.154:0/3150602444 wait complete. 2023-11-27T22:29:48.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 -- 172.21.15.154:0/1543137983 shutdown_connections 2023-11-27T22:29:48.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 --2- 172.21.15.154:0/1543137983 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f000 0x7f7c9006a4d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 --2- 172.21.15.154:0/1543137983 >> v2:172.21.15.194:3300/0 conn(0x7f7c90143b50 0x7f7c900ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 -- 172.21.15.154:0/1543137983 >> 172.21.15.154:0/1543137983 conn(0x7f7c9006d3b0 msgr2=0x7f7c9006d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 -- 172.21.15.154:0/1543137983 shutdown_connections 2023-11-27T22:29:48.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f7c959e5640 1 -- 172.21.15.154:0/1543137983 wait complete. 2023-11-27T22:29:48.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7fa4ceffd640 1 --2- 172.21.15.154:0/15980926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d015a2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000eb50 tx=0x7fa4c0034680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a117d0d840c398de server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f659372c640 1 Processor -- start 2023-11-27T22:29:48.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7f659372c640 1 -- start start 2023-11-27T22:29:48.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7ffadb5ea640 1 Processor -- start 2023-11-27T22:29:48.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.756+0000 7ffadb5ea640 1 -- start start 2023-11-27T22:29:48.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f99a3b68640 1 -- 172.21.15.154:0/263310202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c06bbf0 msgr2=0x7f999c0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f99a3b68640 1 --2- 172.21.15.154:0/263310202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c06bbf0 0x7f999c0cd890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99980097a0 tx=0x7f999802ca20 comp rx=0 tx=0).stop 2023-11-27T22:29:48.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7fe9f742e640 1 Processor -- start 2023-11-27T22:29:48.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7fa4cdffb640 1 -- 172.21.15.154:0/15980926 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000e390 con 0x7fa4d0159210 2023-11-27T22:29:48.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f99a3b68640 1 -- 172.21.15.154:0/263310202 shutdown_connections 2023-11-27T22:29:48.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f99a3b68640 1 --2- 172.21.15.154:0/263310202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c06bbf0 0x7f999c0cd890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f99a3b68640 1 --2- 172.21.15.154:0/263310202 >> v2:172.21.15.154:3300/0 conn(0x7f999c153c50 0x7f999c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f99a3b68640 1 -- 172.21.15.154:0/263310202 >> 172.21.15.154:0/263310202 conn(0x7f999c070ec0 msgr2=0x7f999c0712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7fa4cdffb640 1 -- 172.21.15.154:0/15980926 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0037070 con 0x7fa4d0159210 2023-11-27T22:29:48.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7fa4cdffb640 1 -- 172.21.15.154:0/15980926 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000c730 con 0x7fa4d0159210 2023-11-27T22:29:48.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7fc4acd0c640 1 Processor -- start 2023-11-27T22:29:48.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7ffadb5ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffad406e480 0x7ffad40b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7ffadb5ea640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad415d280 con 0x7ffad40b2630 2023-11-27T22:29:48.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7ffadb5ea640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad415d560 con 0x7ffad40b0db0 2023-11-27T22:29:48.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7ffadb5ea640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad415de90 con 0x7ffad406e480 2023-11-27T22:29:48.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f659372c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c1640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f659372c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c162db0 con 0x7f658c0b4c40 2023-11-27T22:29:48.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f659372c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c163020 con 0x7f658c164600 2023-11-27T22:29:48.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7f659372c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0b5020 con 0x7f658c1659a0 2023-11-27T22:29:48.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f65914c8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f658c0b4c40 0x7f658c165290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41322/0 (socket says 172.21.15.154:41322) 2023-11-27T22:29:48.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f65914c8640 1 -- 172.21.15.154:0/446693383 learned_addr learned my addr 172.21.15.154:0/446693383 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:48.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f7c959e5640 1 Processor -- start 2023-11-27T22:29:48.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f6590cc7640 1 --2- 172.21.15.154:0/446693383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c1640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f0243436640 1 Processor -- start 2023-11-27T22:29:48.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f0243436640 1 -- start start 2023-11-27T22:29:48.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f7c959e5640 1 -- start start 2023-11-27T22:29:48.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f6583fff640 1 -- 172.21.15.154:0/446693383 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173824108 0 0) 0x7f658c163020 con 0x7f658c164600 2023-11-27T22:29:48.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f6583fff640 1 -- 172.21.15.154:0/446693383 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6578003520 con 0x7f658c164600 2023-11-27T22:29:48.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f6590cc7640 1 -- 172.21.15.154:0/446693383 >> v1:172.21.15.194:6789/0 conn(0x7f658c164600 legacy=0x7f658c164ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f6590cc7640 1 -- 172.21.15.154:0/446693383 >> v1:172.21.15.154:6789/0 conn(0x7f658c0b4c40 legacy=0x7f658c165290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f99a3b68640 1 -- 172.21.15.154:0/263310202 shutdown_connections 2023-11-27T22:29:48.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fc4acd0c640 1 -- start start 2023-11-27T22:29:48.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7ffad9b87640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ffad40b0db0 0x7ffad40b11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53666/0 (socket says 172.21.15.154:53666) 2023-11-27T22:29:48.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7ffad9b87640 1 -- 172.21.15.154:0/1404053625 learned_addr learned my addr 172.21.15.154:0/1404053625 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:48.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.757+0000 7fe9f742e640 1 -- start start 2023-11-27T22:29:48.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fa4d54d3640 1 -- 172.21.15.154:0/15980926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 msgr2=0x7fa4d015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fa4d54d3640 1 --2- 172.21.15.154:0/15980926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d015a2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000eb50 tx=0x7fa4c0034680 comp rx=0 tx=0).stop 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2492375430 0 0) 0x7ffad415d560 con 0x7ffad40b0db0 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffac0003520 con 0x7ffad40b0db0 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fa4d54d3640 1 -- 172.21.15.154:0/15980926 shutdown_connections 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fa4d54d3640 1 --2- 172.21.15.154:0/15980926 >> v2:172.21.15.194:3300/0 conn(0x7fa4d00b40b0 0x7fa4d00b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fa4d54d3640 1 --2- 172.21.15.154:0/15980926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d015a2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fa4d54d3640 1 -- 172.21.15.154:0/15980926 >> 172.21.15.154:0/15980926 conn(0x7fa4d00b0d60 msgr2=0x7fa4d00b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399012124 0 0) 0x7ffad415d280 con 0x7ffad40b2630 2023-11-27T22:29:48.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad415d560 con 0x7ffad40b2630 2023-11-27T22:29:48.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fa4d54d3640 1 -- 172.21.15.154:0/15980926 shutdown_connections 2023-11-27T22:29:48.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffad9386640 1 --2- 172.21.15.154:0/1404053625 >> v2:172.21.15.154:3300/0 conn(0x7ffad406e480 0x7ffad40b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2178559876 0 0) 0x7ffac0003520 con 0x7ffad40b0db0 2023-11-27T22:29:48.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 >> v2:172.21.15.154:3300/0 conn(0x7ffad406e480 msgr2=0x7ffad40b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4acd0c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00dfec0 0x7fc4a0173fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4acd0c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4a00e40d0 0x7fc4a000b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4acd0c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 0x7fc4a000bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 --2- 172.21.15.154:0/1404053625 >> v2:172.21.15.154:3300/0 conn(0x7ffad406e480 0x7ffad40b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 >> v1:172.21.15.154:6789/0 conn(0x7ffad40b2630 legacy=0x7ffad40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad415d840 con 0x7ffad40b0db0 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7ffad0001670 con 0x7ffad40b0db0 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 >> v1:172.21.15.194:6789/0 conn(0x7ffad40b0db0 legacy=0x7ffad40b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffac0003b00 0x7ffac0003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffac00047c0 0x7ffac0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffac000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0014c0 con 0x7ffac0005180 2023-11-27T22:29:48.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4acd0c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0050b40 con 0x7fc4a00dfec0 2023-11-27T22:29:48.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4acd0c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0050250 con 0x7fc4a00e40d0 2023-11-27T22:29:48.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4acd0c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0175600 con 0x7fc4a0050fd0 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f7c959e5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9006f000 0x7f7c900cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4a6ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4a00e40d0 0x7fc4a000b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 0x7fc4a000bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 0x7fc4a000bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55592/0 (socket says 172.21.15.154:55592) 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4a7fff640 1 -- 172.21.15.154:0/2746505263 learned_addr learned my addr 172.21.15.154:0/2746505263 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fc4a77fe640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00dfec0 0x7fc4a0173fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f7c959e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 0x7f7c900ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f7c959e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c90143b50 0x7f7c901fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f7c959e5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c8020 con 0x7f7c90143b50 2023-11-27T22:29:48.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f7c959e5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c901507a0 con 0x7f7c9006f000 2023-11-27T22:29:48.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f7c959e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c90150a80 con 0x7f7c9006f630 2023-11-27T22:29:48.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7f0243436640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0234033eb0 0x7f02340485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f0243436640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0234053c30 0x7f023404af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8e7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 0x7f7c900ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f0243436640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f02340e20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8e7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 0x7f7c900ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55624/0 (socket says 172.21.15.154:55624) 2023-11-27T22:29:48.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8e7fc640 1 -- 172.21.15.154:0/2797047588 learned_addr learned my addr 172.21.15.154:0/2797047588 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8effd640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9006f000 0x7f7c900cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8f7fe640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c90143b50 0x7f7c901fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f02411d2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0234033eb0 0x7f02340485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f02411d2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0234033eb0 0x7f02340485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:50004/0 (socket says 172.21.15.154:50004) 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7fe9f742e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e8005e50 0x7fe9e804c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fe9f742e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 0x7fe9e80e5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fe9f742e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e80587a0 0x7fe9e80df680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fe9f742e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80e1110 con 0x7fe9e80587a0 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fe9f742e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e8052e20 con 0x7fe9e8005e50 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fe9f742e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80ddc10 con 0x7fe9e8053760 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 0x7fe9e80e5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 0x7fe9e80e5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55608/0 (socket says 172.21.15.154:55608) 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 -- 172.21.15.154:0/3610268081 learned_addr learned my addr 172.21.15.154:0/3610268081 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f02419d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f02340e20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f6590cc7640 1 -- 172.21.15.154:0/446693383 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c163300 con 0x7f658c1659a0 2023-11-27T22:29:48.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f02419d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f02340e20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53312/0 (socket says 172.21.15.154:53312) 2023-11-27T22:29:48.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f02411d2640 1 -- 172.21.15.154:0/3211391269 learned_addr learned my addr 172.21.15.154:0/3211391269 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7fa4d54d3640 1 -- 172.21.15.154:0/15980926 wait complete. 2023-11-27T22:29:48.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.758+0000 7f99a3b68640 1 -- 172.21.15.154:0/263310202 wait complete. 2023-11-27T22:29:48.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023404b4c0 con 0x7f02340df1e0 2023-11-27T22:29:48.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f99a3b68640 1 Processor -- start 2023-11-27T22:29:48.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0234048c20 con 0x7f0234033eb0 2023-11-27T22:29:48.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023404bb50 con 0x7f0234053c30 2023-11-27T22:29:48.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f99a3b68640 1 -- start start 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 -- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e8005e50 msgr2=0x7fe9e804c3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e8005e50 0x7fe9e804c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 -- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e80587a0 msgr2=0x7fe9e80df680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e80587a0 0x7fe9e80df680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fe9f5c2b640 1 -- 172.21.15.154:0/3610268081 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0094d0 con 0x7fe9e8053760 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8f7fe640 1 -- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 msgr2=0x7f7c900ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8f7fe640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 0x7f7c900ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f7c8f7fe640 1 -- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9006f000 msgr2=0x7f7c900cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fa4d54d3640 1 Processor -- start 2023-11-27T22:29:48.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7f6590cc7640 1 --2- 172.21.15.154:0/446693383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c1640c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6584009dc0 tx=0x7f658402bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=508724a5eed2e32f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fc4a7fff640 1 -- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4a00e40d0 msgr2=0x7fc4a000b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fc4a7fff640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4a00e40d0 0x7fc4a000b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7fc4a7fff640 1 -- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00dfec0 msgr2=0x7fc4a0173fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fe9f5c2b640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 0x7fe9e80e5d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0013f40 tx=0x7fe9e0013f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fa4d54d3640 1 -- start start 2023-11-27T22:29:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad415de90 con 0x7ffac00047c0 2023-11-27T22:29:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fc4a7fff640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00dfec0 0x7fc4a0173fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fc4a7fff640 1 -- 172.21.15.154:0/2746505263 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c009400 con 0x7fc4a0050fd0 2023-11-27T22:29:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f7c8f7fe640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9006f000 0x7f7c900cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f7c8f7fe640 1 -- 172.21.15.154:0/2797047588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009a70 con 0x7f7c90143b50 2023-11-27T22:29:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f7c8e7fc640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 0x7f7c900ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f7c8effd640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9006f000 0x7f7c900cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fc4a77fe640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00dfec0 0x7fc4a0173fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac000c110 con 0x7ffac0003b00 2023-11-27T22:29:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffad9b87640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffac000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffad8b85640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffac00047c0 0x7ffac0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffad9b87640 1 -- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffac0003b00 msgr2=0x7ffac0003ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T22:29:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.759+0000 7ffad9b87640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffac0003b00 0x7ffac0003ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7ffad9b87640 1 -- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffac00047c0 msgr2=0x7ffac0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7ffad9b87640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffac00047c0 0x7ffac0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.760+0000 7ffad9b87640 1 -- 172.21.15.154:0/1404053625 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad415d840 con 0x7ffac0005180 2023-11-27T22:29:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7ffad9b87640 1 -- 172.21.15.154:0/1404053625 reap_dead start 2023-11-27T22:29:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7ffad9386640 1 --2- 172.21.15.154:0/1404053625 >> v2:172.21.15.154:3300/0 conn(0x7ffad406e480 0x7ffad40b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7ffad9b87640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffac000b980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffad0001b10 tx=0x7ffac00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcedf351a04ebed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0014e70 con 0x7fe9e8053760 2023-11-27T22:29:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fe9f742e640 1 -- 172.21.15.154:0/3610268081 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e80e0490 con 0x7fe9e8053760 2023-11-27T22:29:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e00110d0 con 0x7fe9e8053760 2023-11-27T22:29:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0011480 con 0x7fe9e8053760 2023-11-27T22:29:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f7c8f7fe640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c90143b50 0x7f7c901fa7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c88033000 tx=0x7f7c88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0005ad0 con 0x7ffac0005180 2023-11-27T22:29:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0037070 con 0x7ffac0005180 2023-11-27T22:29:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7ffacbfff640 1 -- 172.21.15.154:0/1404053625 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0005ad0 con 0x7ffac0005180 2023-11-27T22:29:48.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fc4a7fff640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 0x7fc4a000bb20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc49400c7c0 tx=0x7fc49400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fa4d54d3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 0x7fa4d014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fa4d54d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d0151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fa4ceffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 0x7fa4d014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7fe9f742e640 1 -- 172.21.15.154:0/3610268081 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e80e0a50 con 0x7fe9e8053760 2023-11-27T22:29:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fa4ceffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 0x7fa4d014f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:50032/0 (socket says 172.21.15.154:50032) 2023-11-27T22:29:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a3b68640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 0x7f999c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a3b68640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f999c0cee90 0x7f999c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a3b68640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c153c50 0x7f999c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fa4ceffd640 1 -- 172.21.15.154:0/441464769 learned_addr learned my addr 172.21.15.154:0/441464769 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a3b68640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c13f710 con 0x7f999c06bbf0 2023-11-27T22:29:48.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a3b68640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c156030 con 0x7f999c0cee90 2023-11-27T22:29:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a3b68640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c156310 con 0x7f999c153c50 2023-11-27T22:29:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a1904640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 0x7f999c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a1904640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 0x7f999c155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53316/0 (socket says 172.21.15.154:53316) 2023-11-27T22:29:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a1904640 1 -- 172.21.15.154:0/566600592 learned_addr learned my addr 172.21.15.154:0/566600592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a2105640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c153c50 0x7f999c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a1103640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f999c0cee90 0x7f999c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7ffadb5ea640 1 -- 172.21.15.154:0/1404053625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 msgr2=0x7ffac000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffac000b980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffad0001b10 tx=0x7ffac00057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494004230 con 0x7fc4a0050fd0 2023-11-27T22:29:48.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc494004390 con 0x7fc4a0050fd0 2023-11-27T22:29:48.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8803e610 con 0x7f7c90143b50 2023-11-27T22:29:48.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8802ce90 con 0x7f7c90143b50 2023-11-27T22:29:48.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8803e9f0 con 0x7f7c90143b50 2023-11-27T22:29:48.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494007860 con 0x7fc4a0050fd0 2023-11-27T22:29:48.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c90150d60 con 0x7f7c90143b50 2023-11-27T22:29:48.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f02409d1640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0234053c30 0x7f023404af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a00504f0 con 0x7fc4a0050fd0 2023-11-27T22:29:48.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7fa4ce7fc640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d0151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7fa4d54d3640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d015ce60 0x7fa4d00af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a01744f0 con 0x7fc4a0050fd0 2023-11-27T22:29:48.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c900cbfd0 con 0x7f7c90143b50 2023-11-27T22:29:48.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f02419d3640 1 -- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0234053c30 msgr2=0x7f023404af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7fe9f742e640 1 -- 172.21.15.154:0/3610268081 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e8058240 con 0x7fe9e8053760 2023-11-27T22:29:48.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f02419d3640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0234053c30 0x7f023404af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f02419d3640 1 -- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0234033eb0 msgr2=0x7f02340485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f02419d3640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0234033eb0 0x7f02340485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f02419d3640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c008050 con 0x7f02340df1e0 2023-11-27T22:29:48.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f02409d1640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0234053c30 0x7f023404af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:48.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f6583fff640 1 -- 172.21.15.154:0/446693383 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658402ccc0 con 0x7f658c1659a0 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.761+0000 7f6583fff640 1 -- 172.21.15.154:0/446693383 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658402ce20 con 0x7f658c1659a0 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 -- 172.21.15.154:0/446693383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 msgr2=0x7f658c1640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f6583fff640 1 -- 172.21.15.154:0/446693383 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658402ccc0 con 0x7f658c1659a0 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 --2- 172.21.15.154:0/446693383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c1640c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6584009dc0 tx=0x7f658402bf10 comp rx=0 tx=0).stop 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 -- 172.21.15.154:0/446693383 shutdown_connections 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 --2- 172.21.15.154:0/446693383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c1640c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 -- 172.21.15.154:0/446693383 >> 172.21.15.154:0/446693383 conn(0x7f658c070900 msgr2=0x7f658c070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 -- 172.21.15.154:0/446693383 shutdown_connections 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f659372c640 1 -- 172.21.15.154:0/446693383 wait complete. 2023-11-27T22:29:48.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.762+0000 7f99a1904640 1 -- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c153c50 msgr2=0x7f999c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f99a1904640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c153c50 0x7f999c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f99a1904640 1 -- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f999c0cee90 msgr2=0x7f999c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f99a1904640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f999c0cee90 0x7f999c154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f99a1904640 1 -- 172.21.15.154:0/566600592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009400 con 0x7f999c06bbf0 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7f99a1904640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 0x7f999c155620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b410 tx=0x7f998c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7ffadb5ea640 1 -- 172.21.15.154:0/1404053625 shutdown_connections 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/1404053625 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffac000b980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7ffadb5ea640 1 -- 172.21.15.154:0/1404053625 >> 172.21.15.154:0/1404053625 conn(0x7ffad406a4d0 msgr2=0x7ffad406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:48.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7ffadb5ea640 1 -- 172.21.15.154:0/1404053625 shutdown_connections 2023-11-27T22:29:48.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.763+0000 7ffadb5ea640 1 -- 172.21.15.154:0/1404053625 wait complete. 2023-11-27T22:29:48.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.764+0000 7f659372c640 1 Processor -- start 2023-11-27T22:29:48.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.764+0000 7f02419d3640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f02340e20d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f023c069d60 tx=0x7f023c067f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.764+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a00057b0 con 0x7fc4a0050fd0 2023-11-27T22:29:48.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.764+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c900b52a0 con 0x7f7c90143b50 2023-11-27T22:29:48.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fa4d54d3640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01502e0 con 0x7fa4d015ce60 2023-11-27T22:29:48.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.764+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe9e000f850 con 0x7fe9e8053760 2023-11-27T22:29:48.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fe9e6ffd640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe9d406b240 0x7fe9d406d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc4940079c0 con 0x7fc4a0050fd0 2023-11-27T22:29:48.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fa4d54d3640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d014fc20 con 0x7fa4d00b40b0 2023-11-27T22:29:48.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fa4cf7fe640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d015ce60 0x7fa4d00af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fa4d54d3640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d01512b0 con 0x7fa4d0159210 2023-11-27T22:29:48.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c06bbb0 con 0x7f02340df1e0 2023-11-27T22:29:48.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fc493fff640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc48c06b2c0 0x7fc48c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc494089ae0 con 0x7fc4a0050fd0 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c011830 con 0x7f999c06bbf0 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0119b0 con 0x7f999c06bbf0 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c011d60 con 0x7f999c06bbf0 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c13f050 con 0x7f999c06bbf0 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c1565f0 con 0x7f999c06bbf0 2023-11-27T22:29:48.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9e0060950 con 0x7fe9e8053760 2023-11-27T22:29:48.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023c06bd10 con 0x7f02340df1e0 2023-11-27T22:29:48.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.764+0000 7f659372c640 1 -- start start 2023-11-27T22:29:48.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f659372c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c0b4c40 0x7f658c143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f659372c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c164600 0x7f658c146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f659372c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f659372c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c15cac0 con 0x7f658c164600 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f659372c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c146400 con 0x7f658c0b4c40 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f659372c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c160990 con 0x7f658c1659a0 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f65914c8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c0b4c40 0x7f658c143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f65914c8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c0b4c40 0x7f658c143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:50042/0 (socket says 172.21.15.154:50042) 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f65914c8640 1 -- 172.21.15.154:0/3782223783 learned_addr learned my addr 172.21.15.154:0/3782223783 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f6591cc9640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f6590cc7640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c164600 0x7f658c146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7ffadb5ea640 1 Processor -- start 2023-11-27T22:29:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7ffadb5ea640 1 -- start start 2023-11-27T22:29:48.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.765+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7c8803b050 con 0x7f7c90143b50 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6591cc9640 1 -- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c0b4c40 msgr2=0x7f658c143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6591cc9640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c0b4c40 0x7f658c143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6591cc9640 1 -- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c164600 msgr2=0x7f658c146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6591cc9640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c164600 0x7f658c146780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6591cc9640 1 -- 172.21.15.154:0/3782223783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584009a70 con 0x7f658c1659a0 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6590cc7640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c164600 0x7f658c146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.842 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f6591cc9640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c0ce330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c3c0 tx=0x7f657c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f7c77fff640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7c7c06b210 0x7f7c7c06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c880ac090 con 0x7f7c90143b50 2023-11-27T22:29:48.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fc4a77fe640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc48c06b2c0 0x7fc48c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023c0723e0 con 0x7f02340df1e0 2023-11-27T22:29:48.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023404be30 con 0x7f02340df1e0 2023-11-27T22:29:48.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fa4ce7fc640 1 -- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 msgr2=0x7fa4d014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fa4ce7fc640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 0x7fa4d014f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fa4ce7fc640 1 -- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d015ce60 msgr2=0x7fa4d00af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fa4ce7fc640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d015ce60 0x7fa4d00af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fa4ce7fc640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c800ca80 con 0x7fa4d0159210 2023-11-27T22:29:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fa4ceffd640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 0x7fa4d014f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023404c3f0 con 0x7f02340df1e0 2023-11-27T22:29:48.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984005250 con 0x7f999c06bbf0 2023-11-27T22:29:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.766+0000 7fe9f642c640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe9d406b240 0x7fe9d406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7f7c8effd640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7c7c06b210 0x7f7c7c06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7fa4ce7fc640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d0151b60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800aa10 tx=0x7fa4c800aed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffadb5ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffad4158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffad9386640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffad4158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffad9386640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffad4158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53348/0 (socket says 172.21.15.154:53348) 2023-11-27T22:29:48.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7fc4a77fe640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc48c06b2c0 0x7fc48c06d780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4a804f5f0 tx=0x7fc4a80696d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7fe9f642c640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe9d406b240 0x7fe9d406d700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec036000 tx=0x7fe9ec03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7f7c8effd640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7c7c06b210 0x7f7c7c06d6d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009e90 tx=0x7f7c80009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffadb5ea640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad414f2b0 0x7ffad414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7fa4cf7fe640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d015ce60 0x7fa4d00af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:48.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffad9386640 1 -- 172.21.15.154:0/2498806456 learned_addr learned my addr 172.21.15.154:0/2498806456 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:48.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad414e540 0x7ffad414e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad414ef00 con 0x7ffac0005180 2023-11-27T22:29:48.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad41eec10 con 0x7ffad414e540 2023-11-27T22:29:48.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad415bfb0 con 0x7ffad414f2b0 2023-11-27T22:29:48.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffad8b85640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad414f2b0 0x7ffad414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023404c610 con 0x7f02340df1e0 2023-11-27T22:29:48.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.767+0000 7ffad9b87640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad414e540 0x7ffad414e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9386640 1 -- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad414f2b0 msgr2=0x7ffad414f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9386640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad414f2b0 0x7ffad414f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9386640 1 -- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad414e540 msgr2=0x7ffad414e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:48.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9386640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad414e540 0x7ffad414e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:48.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9386640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad414fe20 con 0x7ffac0005180 2023-11-27T22:29:48.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9b87640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad414e540 0x7ffad414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:48.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7ffad9386640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffad4158b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffac4006fd0 tx=0x7ffac400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f998c01a400 con 0x7f999c06bbf0 2023-11-27T22:29:48.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.768+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe9e005cd20 con 0x7fe9e8053760 2023-11-27T22:29:48.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.769+0000 7f99927fc640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f998006b210 0x7f998006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.769+0000 7f99a1103640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f998006b210 0x7f998006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.769+0000 7f99a1103640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f998006b210 0x7f998006d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f999c0cba90 tx=0x7f99940018b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.772+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f998c0591b0 con 0x7f999c06bbf0 2023-11-27T22:29:48.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4004230 con 0x7ffac0005180 2023-11-27T22:29:48.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8016400 con 0x7fa4d0159210 2023-11-27T22:29:48.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8016560 con 0x7fa4d0159210 2023-11-27T22:29:48.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80168f0 con 0x7fa4d0159210 2023-11-27T22:29:48.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad4150100 con 0x7ffac0005180 2023-11-27T22:29:48.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7fa4d54d3640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c000e7b0 con 0x7fa4d0159210 2023-11-27T22:29:48.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc494054960 con 0x7fc4a0050fd0 2023-11-27T22:29:48.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7c88076e50 con 0x7f7c90143b50 2023-11-27T22:29:48.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7fa4d54d3640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d01507d0 con 0x7fa4d0159210 2023-11-27T22:29:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.773+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad41506c0 con 0x7ffac0005180 2023-11-27T22:29:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.774+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c0035f0 con 0x7f658c1659a0 2023-11-27T22:29:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.774+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c003750 con 0x7f658c1659a0 2023-11-27T22:29:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.774+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c003b40 con 0x7f658c1659a0 2023-11-27T22:29:48.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.774+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c1600f0 con 0x7f658c1659a0 2023-11-27T22:29:48.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.774+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c1606b0 con 0x7f658c1659a0 2023-11-27T22:29:48.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.775+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad4069400 con 0x7ffac0005180 2023-11-27T22:29:48.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.775+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d0069400 con 0x7fa4d0159210 2023-11-27T22:29:48.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.776+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa4c8016a50 con 0x7fa4d0159210 2023-11-27T22:29:48.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.776+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f023c072540 con 0x7f02340df1e0 2023-11-27T22:29:48.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.776+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f657c003ca0 con 0x7f658c1659a0 2023-11-27T22:29:48.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.776+0000 7fa4b77fe640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa4bc06b2c0 0x7fa4bc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.776+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4c8011070 con 0x7fa4d0159210 2023-11-27T22:29:48.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.777+0000 7fa4ceffd640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa4bc06b2c0 0x7fa4bc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.777+0000 7f0231ffb640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f022006b210 0x7f022006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.777+0000 7f6581ffb640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f657006b290 0x7f657006d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.777+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f657c088ec0 con 0x7f658c1659a0 2023-11-27T22:29:48.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.776+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c15cc00 con 0x7f658c1659a0 2023-11-27T22:29:48.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.777+0000 7f65914c8640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f657006b290 0x7f657006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.777+0000 7fa4ceffd640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa4bc06b2c0 0x7fa4bc06d780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0000c00 tx=0x7fa4c000e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.778+0000 7f65914c8640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f657006b290 0x7f657006d750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6588005880 tx=0x7f6588009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.778+0000 7f02411d2640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f022006b210 0x7f022006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.778+0000 7f02411d2640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f022006b210 0x7f022006d6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c080 tx=0x7f022c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.780+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f998c054df0 con 0x7f999c06bbf0 2023-11-27T22:29:48.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.780+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4004390 con 0x7ffac0005180 2023-11-27T22:29:48.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.780+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4005b90 con 0x7ffac0005180 2023-11-27T22:29:48.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.780+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f023c0d2930 con 0x7f02340df1e0 2023-11-27T22:29:48.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.780+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa4c8055100 con 0x7fa4d0159210 2023-11-27T22:29:48.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.782+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ffac4003610 con 0x7ffac0005180 2023-11-27T22:29:48.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.783+0000 7ffac9ffb640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ffab806b1c0 0x7ffab806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:48.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.783+0000 7ffad8b85640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ffab806b1c0 0x7ffab806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:48.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.783+0000 7ffad8b85640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ffab806b1c0 0x7ffab806d680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffad415bbd0 tx=0x7ffacc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:48.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.786+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f658c15cc00 con 0x7f658c1659a0 2023-11-27T22:29:48.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.786+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffac4058220 con 0x7ffac0005180 2023-11-27T22:29:48.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.787+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f023c0ced00 con 0x7f02340df1e0 2023-11-27T22:29:48.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:48.795+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ffac4054560 con 0x7ffac0005180 2023-11-27T22:29:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.159+0000 7fe9f742e640 1 -- 172.21.15.154:0/3610268081 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe9e8053d40 con 0x7fe9e8053760 2023-11-27T22:29:49.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.159+0000 7fe9e6ffd640 1 -- 172.21.15.154:0/3610268081 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9e005cd20 con 0x7fe9e8053760 2023-11-27T22:29:49.162 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 -- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe9d406b240 msgr2=0x7fe9d406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe9d406b240 0x7fe9d406d700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec036000 tx=0x7fe9ec03b040 comp rx=0 tx=0).stop 2023-11-27T22:29:49.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 -- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 msgr2=0x7fe9e80e5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 0x7fe9e80e5d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0013f40 tx=0x7fe9e0013f70 comp rx=0 tx=0).stop 2023-11-27T22:29:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 -- 172.21.15.154:0/3610268081 shutdown_connections 2023-11-27T22:29:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe9d406b240 0x7fe9d406d700 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec036000 tx=0x7fe9ec03b040 comp rx=0 tx=0).stop 2023-11-27T22:29:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9e80587a0 0x7fe9e80df680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9e8053760 0x7fe9e80e5d60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 --2- 172.21.15.154:0/3610268081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e8005e50 0x7fe9e804c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.163+0000 7fe9e4ff9640 1 -- 172.21.15.154:0/3610268081 >> 172.21.15.154:0/3610268081 conn(0x7fe9e803a9f0 msgr2=0x7fe9e803d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.164+0000 7fe9e4ff9640 1 -- 172.21.15.154:0/3610268081 shutdown_connections 2023-11-27T22:29:49.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.164+0000 7fe9e4ff9640 1 -- 172.21.15.154:0/3610268081 wait complete. 2023-11-27T22:29:49.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.179+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f99840057d0 con 0x7f999c06bbf0 2023-11-27T22:29:49.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.179+0000 7f99927fc640 1 -- 172.21.15.154:0/566600592 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f998c015020 con 0x7f999c06bbf0 2023-11-27T22:29:49.183 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:49.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-11-27T22:29:49.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.180+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa4d00affe0 con 0x7fa4d0159210 2023-11-27T22:29:49.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.181+0000 7fa4b77fe640 1 -- 172.21.15.154:0/441464769 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4c8058720 con 0x7fa4d0159210 2023-11-27T22:29:49.184 INFO:teuthology.orchestra.run.smithi154.stdout:55834574853 2023-11-27T22:29:49.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c90140f40 con 0x7f7c90143b50 2023-11-27T22:29:49.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc4a000f390 con 0x7fc4a0050fd0 2023-11-27T22:29:49.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f998006b210 msgr2=0x7f998006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7fc493fff640 1 -- 172.21.15.154:0/2746505263 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc494057f80 con 0x7fc4a0050fd0 2023-11-27T22:29:49.187 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:49.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f7c77fff640 1 -- 172.21.15.154:0/2797047588 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c8804e020 con 0x7f7c90143b50 2023-11-27T22:29:49.187 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:49.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f998006b210 0x7f998006d6d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f999c0cba90 tx=0x7f99940018b0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 msgr2=0x7f999c155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 0x7f999c155620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f998c00b410 tx=0x7f998c00b8d0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 shutdown_connections 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f999c0cee90 0x7f999c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f998006b210 0x7f998006d6d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f999c153c50 0x7f999c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 --2- 172.21.15.154:0/566600592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f999c06bbf0 0x7f999c155620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.183+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 >> 172.21.15.154:0/566600592 conn(0x7f999c070ec0 msgr2=0x7f999c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa4bc06b2c0 msgr2=0x7fa4bc06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 shutdown_connections 2023-11-27T22:29:49.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa4bc06b2c0 0x7fa4bc06d780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0000c00 tx=0x7fa4c000e000 comp rx=0 tx=0).stop 2023-11-27T22:29:49.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 msgr2=0x7fa4d0151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d0151b60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800aa10 tx=0x7fa4c800aed0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7f99a3b68640 1 -- 172.21.15.154:0/566600592 wait complete. 2023-11-27T22:29:49.190 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 shutdown_connections 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa4bc06b2c0 0x7fa4bc06d780 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d015ce60 0x7fa4d00af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa4d0159210 0x7fa4d0151b60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 --2- 172.21.15.154:0/441464769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4d00b40b0 0x7fa4d014f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 >> 172.21.15.154:0/441464769 conn(0x7fa4d00b0d60 msgr2=0x7fa4d00b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 shutdown_connections 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.184+0000 7fa4b57fa640 1 -- 172.21.15.154:0/441464769 wait complete. 2023-11-27T22:29:49.191 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.186+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f658c15cc00 con 0x7f658c1659a0 2023-11-27T22:29:49.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7c7c06b210 msgr2=0x7f7c7c06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7c7c06b210 0x7f7c7c06d6d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009e90 tx=0x7f7c80009190 comp rx=0 tx=0).stop 2023-11-27T22:29:49.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f6581ffb640 1 -- 172.21.15.154:0/3782223783 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f658c15cc00 con 0x7f658c1659a0 2023-11-27T22:29:49.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c90143b50 msgr2=0x7f7c901fa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c90143b50 0x7f7c901fa7e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c88033000 tx=0x7f7c88004a40 comp rx=0 tx=0).stop 2023-11-27T22:29:49.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 shutdown_connections 2023-11-27T22:29:49.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7c7c06b210 0x7f7c7c06d6d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.193 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:49.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7c90143b50 0x7f7c901fa7e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c9006f630 0x7f7c900ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 --2- 172.21.15.154:0/2797047588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c9006f000 0x7f7c900cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 >> 172.21.15.154:0/2797047588 conn(0x7f7c9006d3b0 msgr2=0x7f7c9006d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc48c06b2c0 msgr2=0x7fc48c06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc48c06b2c0 0x7fc48c06d780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc4a804f5f0 tx=0x7fc4a80696d0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 msgr2=0x7fc4a000bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 0x7fc4a000bb20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc49400c7c0 tx=0x7fc49400cc80 comp rx=0 tx=0).stop 2023-11-27T22:29:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 shutdown_connections 2023-11-27T22:29:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 shutdown_connections 2023-11-27T22:29:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4a00e40d0 0x7fc4a000b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc48c06b2c0 0x7fc48c06d780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4a0050fd0 0x7fc4a000bb20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 --2- 172.21.15.154:0/2746505263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc4a00dfec0 0x7fc4a0173fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7f7c959e5640 1 -- 172.21.15.154:0/2797047588 wait complete. 2023-11-27T22:29:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.187+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 >> 172.21.15.154:0/2746505263 conn(0x7fc4a001ef10 msgr2=0x7fc4a00539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.188+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 shutdown_connections 2023-11-27T22:29:49.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.188+0000 7fc4acd0c640 1 -- 172.21.15.154:0/2746505263 wait complete. 2023-11-27T22:29:49.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.190+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f657006b290 msgr2=0x7f657006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.190+0000 7f659372c640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f657006b290 0x7f657006d750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6588005880 tx=0x7f6588009040 comp rx=0 tx=0).stop 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.190+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 msgr2=0x7f658c0ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.190+0000 7f659372c640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c0ce330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c3c0 tx=0x7f657c00c880 comp rx=0 tx=0).stop 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 shutdown_connections 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f657006b290 0x7f657006d750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f658c1659a0 0x7f658c0ce330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f658c164600 0x7f658c146780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 --2- 172.21.15.154:0/3782223783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c0b4c40 0x7f658c143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 >> 172.21.15.154:0/3782223783 conn(0x7f658c070900 msgr2=0x7f658c1591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 shutdown_connections 2023-11-27T22:29:49.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.191+0000 7f659372c640 1 -- 172.21.15.154:0/3782223783 wait complete. 2023-11-27T22:29:49.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.197+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0234005350 con 0x7f02340df1e0 2023-11-27T22:29:49.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.197+0000 7f0231ffb640 1 -- 172.21.15.154:0/3211391269 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f023c0ceea0 con 0x7f02340df1e0 2023-11-27T22:29:49.200 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f022006b210 msgr2=0x7f022006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f022006b210 0x7f022006d6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c080 tx=0x7f022c03c040 comp rx=0 tx=0).stop 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 msgr2=0x7f02340e20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f02340e20d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f023c069d60 tx=0x7f023c067f00 comp rx=0 tx=0).stop 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 shutdown_connections 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f022006b210 0x7f022006d6d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02340df1e0 0x7f02340e20d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.204 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0234053c30 0x7f023404af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 --2- 172.21.15.154:0/3211391269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0234033eb0 0x7f02340485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.201+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 >> 172.21.15.154:0/3211391269 conn(0x7f0234009f70 msgr2=0x7f02340dbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.202+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 shutdown_connections 2023-11-27T22:29:49.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.202+0000 7f0243436640 1 -- 172.21.15.154:0/3211391269 wait complete. 2023-11-27T22:29:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.202+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffad40cd950 con 0x7ffac0005180 2023-11-27T22:29:49.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.203+0000 7ffac9ffb640 1 -- 172.21.15.154:0/2498806456 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffac4020090 con 0x7ffac0005180 2023-11-27T22:29:49.207 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:49.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-11-27T22:29:49.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-27T22:29:49.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ffab806b1c0 msgr2=0x7ffab806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ffab806b1c0 0x7ffab806d680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffad415bbd0 tx=0x7ffacc009040 comp rx=0 tx=0).stop 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 msgr2=0x7ffad4158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffad4158b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffac4006fd0 tx=0x7ffac400e940 comp rx=0 tx=0).stop 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 shutdown_connections 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffad414e540 0x7ffad414e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ffab806b1c0 0x7ffab806d680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffad414f2b0 0x7ffad414f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 --2- 172.21.15.154:0/2498806456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffac0005180 0x7ffad4158b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:49.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 >> 172.21.15.154:0/2498806456 conn(0x7ffad406a4d0 msgr2=0x7ffad40ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:49.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 shutdown_connections 2023-11-27T22:29:49.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:49.207+0000 7ffadb5ea640 1 -- 172.21.15.154:0/2498806456 wait complete. 2023-11-27T22:29:49.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-11-27T22:29:49.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-11-27T22:29:49.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-11-27T22:29:49.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-27T22:29:50.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T22:29:50.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T22:29:50.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T22:29:50.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T22:29:50.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T22:29:50.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T22:29:50.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T22:29:50.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T22:29:50.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.349+0000 7fdfb7fff640 1 Processor -- start 2023-11-27T22:29:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.349+0000 7fdfb7fff640 1 -- start start 2023-11-27T22:29:50.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfb8161360 0x7fdfb806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.355 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb8071ea0 0x7fdfb80b3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb7fff640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb8071070 con 0x7fdfb8072300 2023-11-27T22:29:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb7fff640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb806c8b0 con 0x7fdfb8161360 2023-11-27T22:29:50.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb7fff640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb806cb90 con 0x7fdfb8071ea0 2023-11-27T22:29:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfb8161360 0x7fdfb806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb6ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdfb8161360 0x7fdfb806d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53358/0 (socket says 172.21.15.154:53358) 2023-11-27T22:29:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb6ffd640 1 -- 172.21.15.154:0/1778592502 learned_addr learned my addr 172.21.15.154:0/1778592502 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.351+0000 7fdfb67fc640 1 --2- 172.21.15.154:0/1778592502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb8071ea0 0x7fdfb80b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.352+0000 7fdfb6ffd640 1 -- 172.21.15.154:0/1778592502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb8071ea0 msgr2=0x7fdfb80b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.352+0000 7fdfb6ffd640 1 --2- 172.21.15.154:0/1778592502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb8071ea0 0x7fdfb80b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.352+0000 7fdfb6ffd640 1 -- 172.21.15.154:0/1778592502 >> v1:172.21.15.194:6789/0 conn(0x7fdfb8072300 legacy=0x7fdfb80cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.352+0000 7fdfb6ffd640 1 -- 172.21.15.154:0/1778592502 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb806ce70 con 0x7fdfb8161360 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.353+0000 7fdfb6ffd640 1 --2- 172.21.15.154:0/1778592502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8161360 0x7fdfb806d950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009870 tx=0x7fdfac02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c605e1b1c0346d6b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.353+0000 7fdfb5ffb640 1 -- 172.21.15.154:0/1778592502 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac030880 con 0x7fdfb8161360 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.353+0000 7fdfb5ffb640 1 -- 172.21.15.154:0/1778592502 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac0309e0 con 0x7fdfb8161360 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.354+0000 7fdfb7fff640 1 -- 172.21.15.154:0/1778592502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8161360 msgr2=0x7fdfb806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.354+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/1778592502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8161360 0x7fdfb806d950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009870 tx=0x7fdfac02b9c0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.354+0000 7fdfb7fff640 1 -- 172.21.15.154:0/1778592502 shutdown_connections 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.354+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/1778592502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb8071ea0 0x7fdfb80b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.354+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/1778592502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8161360 0x7fdfb806d950 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.354+0000 7fdfb7fff640 1 -- 172.21.15.154:0/1778592502 >> 172.21.15.154:0/1778592502 conn(0x7fdfb806a4d0 msgr2=0x7fdfb806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.355+0000 7fdfb7fff640 1 -- 172.21.15.154:0/1778592502 shutdown_connections 2023-11-27T22:29:50.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.355+0000 7fdfb7fff640 1 -- 172.21.15.154:0/1778592502 wait complete. 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.357+0000 7fdfb7fff640 1 Processor -- start 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.357+0000 7fdfb7fff640 1 -- start start 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb8071ea0 0x7fdfb814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 0x7fdfb80afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 0x7fdfb80afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb813df20 0x7fdfb80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 0x7fdfb80afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53366/0 (socket says 172.21.15.154:53366) 2023-11-27T22:29:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb67fc640 1 -- 172.21.15.154:0/3102825434 learned_addr learned my addr 172.21.15.154:0/3102825434 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815a250 con 0x7fdfb8072300 2023-11-27T22:29:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81501a0 con 0x7fdfb8071ea0 2023-11-27T22:29:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.358+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb813f240 con 0x7fdfb813df20 2023-11-27T22:29:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.359+0000 7fdfb6ffd640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb8071ea0 0x7fdfb814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.359+0000 7fdfb67fc640 1 -- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb813df20 msgr2=0x7fdfb80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.359+0000 7fdfb67fc640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb813df20 0x7fdfb80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.359+0000 7fdfb67fc640 1 -- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb8071ea0 msgr2=0x7fdfb814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.359+0000 7fdfb67fc640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb8071ea0 0x7fdfb814fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.359+0000 7fdfb67fc640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac0094d0 con 0x7fdfb8072300 2023-11-27T22:29:50.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.360+0000 7fdfb67fc640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 0x7fdfb80afd70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e9b0 tx=0x7fdfa800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.360+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800c9a0 con 0x7fdfb8072300 2023-11-27T22:29:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.360+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa800cb00 con 0x7fdfb8072300 2023-11-27T22:29:50.378 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.360+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8013470 con 0x7fdfb8072300 2023-11-27T22:29:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.360+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb813e480 con 0x7fdfb8072300 2023-11-27T22:29:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.360+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb813ea40 con 0x7fdfb8072300 2023-11-27T22:29:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.363+0000 7fdf9d7fa640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf98005250 con 0x7fdfb8072300 2023-11-27T22:29:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.373+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdfa80135d0 con 0x7fdfb8072300 2023-11-27T22:29:50.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.374+0000 7fdf9f7fe640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfa006b470 0x7fdfa006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.375+0000 7fdfb6ffd640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfa006b470 0x7fdfa006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.376+0000 7fdfb6ffd640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfa006b470 0x7fdfa006d930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfac036000 tx=0x7fdfac03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.376+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfa8089b80 con 0x7fdfb8072300 2023-11-27T22:29:50.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.376+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdfa808d2a0 con 0x7fdfb8072300 2023-11-27T22:29:50.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7effb99c9640 1 Processor -- start 2023-11-27T22:29:50.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.398+0000 7fdb31048640 1 Processor -- start 2023-11-27T22:29:50.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.398+0000 7fdb31048640 1 -- start start 2023-11-27T22:29:50.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7effb99c9640 1 -- start start 2023-11-27T22:29:50.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7fdb31048640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 0x7fdb2c0cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7fdb31048640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c14b7b0 con 0x7fdb2c0c3e80 2023-11-27T22:29:50.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7fdb31048640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c0cbd50 con 0x7fdb2c14b3d0 2023-11-27T22:29:50.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7fdb31048640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c161d60 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.399+0000 7f0f52390640 1 Processor -- start 2023-11-27T22:29:50.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7fdb2a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 0x7fdb2c0cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7fdb2a59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 0x7fdb2c0cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55698/0 (socket says 172.21.15.154:55698) 2023-11-27T22:29:50.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7fdb2a59c640 1 -- 172.21.15.154:0/2761928121 learned_addr learned my addr 172.21.15.154:0/2761928121 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7effb99c9640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7effb4161620 0x7effb406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7f0f52390640 1 -- start start 2023-11-27T22:29:50.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7effb99c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40b3710 0x7effb40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7effb99c9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40710a0 con 0x7effb4071e70 2023-11-27T22:29:50.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7fdb2a59c640 1 -- 172.21.15.154:0/2761928121 >> v1:172.21.15.194:6789/0 conn(0x7fdb2c14b3d0 legacy=0x7fdb2c0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7fdb2a59c640 1 -- 172.21.15.154:0/2761928121 >> v1:172.21.15.154:6789/0 conn(0x7fdb2c0c3e80 legacy=0x7fdb2c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7fdb2a59c640 1 -- 172.21.15.154:0/2761928121 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0cc030 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7effb99c9640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb406c910 con 0x7effb4161620 2023-11-27T22:29:50.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.400+0000 7effb99c9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb406cbf0 con 0x7effb40b3710 2023-11-27T22:29:50.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb3fff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7effb4071e70 0x7effb40b3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53704/0 (socket says 172.21.15.154:53704) 2023-11-27T22:29:50.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb3fff640 1 -- 172.21.15.154:0/1830318622 learned_addr learned my addr 172.21.15.154:0/1830318622 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:50.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f52390640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f4c0b0cf0 0x7f0f4c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb89c7640 1 --2- 172.21.15.154:0/1830318622 >> v2:172.21.15.194:3300/0 conn(0x7effb4161620 0x7effb406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb91c8640 1 --2- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40b3710 0x7effb40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7fdb2a59c640 1 --2- 172.21.15.154:0/2761928121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 0x7fdb2c0cb500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009e80 tx=0x7fdb2402bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df54acfae348af server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f52390640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c162d80 con 0x7f0f4c0b2060 2023-11-27T22:29:50.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f52390640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c0705a0 con 0x7f0f4c158690 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f52390640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c0b4c00 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f4b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f4c0b0cf0 0x7f0f4c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f4b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f4c0b0cf0 0x7f0f4c0b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:50064/0 (socket says 172.21.15.154:50064) 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f0f4b7fe640 1 -- 172.21.15.154:0/2218251096 learned_addr learned my addr 172.21.15.154:0/2218251096 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb89c7640 1 -- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40b3710 msgr2=0x7effb40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb89c7640 1 --2- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40b3710 0x7effb40cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb89c7640 1 -- 172.21.15.154:0/1830318622 >> v1:172.21.15.194:6789/0 conn(0x7effb4071e70 legacy=0x7effb40b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7effb89c7640 1 -- 172.21.15.154:0/1830318622 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb406ced0 con 0x7effb4161620 2023-11-27T22:29:50.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7f0f4b7fe640 1 -- 172.21.15.154:0/2218251096 >> v1:172.21.15.194:6789/0 conn(0x7f0f4c158690 legacy=0x7f0f4c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f1df9f4c640 1 Processor -- start 2023-11-27T22:29:50.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.401+0000 7f1df9f4c640 1 -- start start 2023-11-27T22:29:50.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7f0f4b7fe640 1 -- 172.21.15.154:0/2218251096 >> v1:172.21.15.154:6789/0 conn(0x7f0f4c0b2060 legacy=0x7f0f4c0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7f0f4affd640 1 -- 172.21.15.154:0/2218251096 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580517812 0 0) 0x7f0f4c162d80 con 0x7f0f4c0b2060 2023-11-27T22:29:50.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7f0f4b7fe640 1 -- 172.21.15.154:0/2218251096 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c070880 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7fdb29d9b640 1 -- 172.21.15.154:0/2761928121 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2402cae0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7fdb29d9b640 1 -- 172.21.15.154:0/2761928121 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2402cc40 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7fdb29d9b640 1 -- 172.21.15.154:0/2761928121 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb240343f0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.402+0000 7fdb78768640 1 Processor -- start 2023-11-27T22:29:50.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1df41594b0 0x7f1df4070570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41342/0 (socket says 172.21.15.154:41342) 2023-11-27T22:29:50.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 -- 172.21.15.154:0/2761928121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 msgr2=0x7fdb2c0cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 --2- 172.21.15.154:0/2761928121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 0x7fdb2c0cb500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009e80 tx=0x7fdb2402bf40 comp rx=0 tx=0).stop 2023-11-27T22:29:50.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df9f4c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1df40b3cc0 0x7f1df40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df37fe640 1 -- 172.21.15.154:0/2887446105 learned_addr learned my addr 172.21.15.154:0/2887446105 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:50.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb78768640 1 -- start start 2023-11-27T22:29:50.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df4069320 0x7f1df40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 -- 172.21.15.154:0/2761928121 shutdown_connections 2023-11-27T22:29:50.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 --2- 172.21.15.154:0/2761928121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0d19d0 0x7fdb2c0cb500 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 -- 172.21.15.154:0/2761928121 >> 172.21.15.154:0/2761928121 conn(0x7fdb2c0d0eb0 msgr2=0x7fdb2c0d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7effb89c7640 1 --2- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4161620 0x7effb406d9b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effa40097d0 tx=0x7effa402b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58f5bc6d76b2a8b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 -- 172.21.15.154:0/2761928121 shutdown_connections 2023-11-27T22:29:50.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df2ffd640 1 --2- 172.21.15.154:0/2887446105 >> v2:172.21.15.154:3300/0 conn(0x7f1df40b3cc0 0x7f1df40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f0f4b7fe640 1 --2- 172.21.15.154:0/2218251096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c0b1180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097f0 tx=0x7f0f3c02b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b405b4daf535a18 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df40b42f0 con 0x7f1df41594b0 2023-11-27T22:29:50.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7fdb31048640 1 -- 172.21.15.154:0/2761928121 wait complete. 2023-11-27T22:29:50.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7effb37fe640 1 -- 172.21.15.154:0/1830318622 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4030710 con 0x7effb4161620 2023-11-27T22:29:50.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7effb37fe640 1 -- 172.21.15.154:0/1830318622 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa402e050 con 0x7effb4161620 2023-11-27T22:29:50.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f0f4affd640 1 -- 172.21.15.154:0/2218251096 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c031760 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df40ce950 con 0x7f1df40b3cc0 2023-11-27T22:29:50.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f0f4affd640 1 -- 172.21.15.154:0/2218251096 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c0318c0 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f0f4affd640 1 -- 172.21.15.154:0/2218251096 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c031c50 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7fdb78768640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdb6803a060 0x7fdb6803a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7fdb76504640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fdb680df7c0 0x7fdb68036660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53716/0 (socket says 172.21.15.154:53716) 2023-11-27T22:29:50.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7fdb76504640 1 -- 172.21.15.154:0/3488701499 learned_addr learned my addr 172.21.15.154:0/3488701499 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:50.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb76d05640 1 --2- 172.21.15.154:0/3488701499 >> v2:172.21.15.194:3300/0 conn(0x7fdb6803a060 0x7fdb6803a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f6ced413640 1 Processor -- start 2023-11-27T22:29:50.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f6ced413640 1 -- start start 2023-11-27T22:29:50.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6803a9b0 con 0x7fdb68055cd0 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 -- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4161620 msgr2=0x7effb406d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 --2- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4161620 0x7effb406d9b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effa40097d0 tx=0x7effa402b6e0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 -- 172.21.15.154:0/1830318622 shutdown_connections 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 --2- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40b3710 0x7effb40cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 --2- 172.21.15.154:0/1830318622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4161620 0x7effb406d9b0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effa40097d0 tx=0x7effa402b6e0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 -- 172.21.15.154:0/1830318622 >> 172.21.15.154:0/1830318622 conn(0x7effb406a4d0 msgr2=0x7effb406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.420 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb68056140 con 0x7fdb680df7c0 2023-11-27T22:29:50.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7f0f52390640 1 -- 172.21.15.154:0/2218251096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 msgr2=0x7f0f4c0b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7f0f52390640 1 --2- 172.21.15.154:0/2218251096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c0b1180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0097f0 tx=0x7f0f3c02b800 comp rx=0 tx=0).stop 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb68050110 con 0x7fdb6803a060 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378682748 0 0) 0x7fdb6803a9b0 con 0x7fdb68055cd0 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5c003520 con 0x7fdb68055cd0 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40b2120 con 0x7f1df4069320 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.403+0000 7f1df3fff640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df4069320 0x7f1df40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f1df2ffd640 1 -- 172.21.15.154:0/2887446105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df4069320 msgr2=0x7f1df40ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f1df2ffd640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df4069320 0x7f1df40ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f1df2ffd640 1 -- 172.21.15.154:0/2887446105 >> v1:172.21.15.154:6789/0 conn(0x7f1df41594b0 legacy=0x7f1df4070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.404+0000 7f1df2ffd640 1 -- 172.21.15.154:0/2887446105 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40b2400 con 0x7f1df40b3cc0 2023-11-27T22:29:50.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 -- 172.21.15.154:0/1830318622 shutdown_connections 2023-11-27T22:29:50.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb31048640 1 Processor -- start 2023-11-27T22:29:50.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7f0f52390640 1 -- 172.21.15.154:0/2218251096 shutdown_connections 2023-11-27T22:29:50.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7f0f52390640 1 --2- 172.21.15.154:0/2218251096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c0b1180 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7f0f52390640 1 -- 172.21.15.154:0/2218251096 >> 172.21.15.154:0/2218251096 conn(0x7f0f4c06a4d0 msgr2=0x7f0f4c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7fdb31048640 1 -- start start 2023-11-27T22:29:50.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7effb99c9640 1 -- 172.21.15.154:0/1830318622 wait complete. 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730420588 0 0) 0x7fdb68056140 con 0x7fdb680df7c0 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6803a9b0 con 0x7fdb680df7c0 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165321461 0 0) 0x7fdb5c003520 con 0x7fdb68055cd0 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 >> v2:172.21.15.194:3300/0 conn(0x7fdb6803a060 msgr2=0x7fdb6803a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 --2- 172.21.15.154:0/3488701499 >> v2:172.21.15.194:3300/0 conn(0x7fdb6803a060 0x7fdb6803a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 >> v1:172.21.15.194:6789/0 conn(0x7fdb680df7c0 legacy=0x7fdb68036660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68006bf0 con 0x7fdb68055cd0 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fdb600015f0 con 0x7fdb68055cd0 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 >> v1:172.21.15.154:6789/0 conn(0x7fdb68055cd0 legacy=0x7fdb6804fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c003b00 0x7fdb5c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb5c0047c0 0x7fdb5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb5c0052a0 0x7fdb5c00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68050110 con 0x7fdb5c0047c0 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0104e0 con 0x7fdb5c0052a0 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5c0106a0 con 0x7fdb5c003b00 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb76d05640 1 --2- 172.21.15.154:0/3488701499 >> v2:172.21.15.194:3300/0 conn(0x7fdb6803a060 0x7fdb6803a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb76504640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c003b00 0x7fdb5c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7fdb76d05640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb5c0052a0 0x7fdb5c00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f0f52390640 1 -- 172.21.15.154:0/2218251096 shutdown_connections 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f0f52390640 1 -- 172.21.15.154:0/2218251096 wait complete. 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.405+0000 7f6ced413640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ced413640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6ce8069320 0x7f6ce806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ced413640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce806e060 con 0x7f6ce8070780 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ced413640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce806c870 con 0x7f6ce8069320 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ced413640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80b2040 con 0x7f6ce81592c0 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce806d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55730/0 (socket says 172.21.15.154:55730) 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ce7fff640 1 -- 172.21.15.154:0/3783329725 learned_addr learned my addr 172.21.15.154:0/3783329725 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ce6ffd640 1 -- 172.21.15.154:0/3783329725 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712794185 0 0) 0x7f6ce806e060 con 0x7f6ce8070780 2023-11-27T22:29:50.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.406+0000 7f6ce6ffd640 1 -- 172.21.15.154:0/3783329725 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd0003520 con 0x7f6ce8070780 2023-11-27T22:29:50.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7f6ce7fff640 1 -- 172.21.15.154:0/3783329725 >> v2:172.21.15.154:3300/0 conn(0x7f6ce8069320 msgr2=0x7f6ce806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7f6ce7fff640 1 --2- 172.21.15.154:0/3783329725 >> v2:172.21.15.154:3300/0 conn(0x7f6ce8069320 0x7f6ce806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7f6ce7fff640 1 -- 172.21.15.154:0/3783329725 >> v1:172.21.15.194:6789/0 conn(0x7f6ce8070780 legacy=0x7f6ce815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb31048640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0c3e80 0x7fdb2c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb31048640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 0x7fdb2c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7f6ce7fff640 1 -- 172.21.15.154:0/3783329725 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80b2320 con 0x7f6ce81592c0 2023-11-27T22:29:50.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb2a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 0x7fdb2c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb2a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 0x7fdb2c0c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53408/0 (socket says 172.21.15.154:53408) 2023-11-27T22:29:50.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb2a59c640 1 -- 172.21.15.154:0/1032750129 learned_addr learned my addr 172.21.15.154:0/1032750129 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb2c14b3d0 0x7fdb2c06f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0ca7c0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0c9e20 con 0x7fdb2c14b3d0 2023-11-27T22:29:50.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0ca100 con 0x7fdb2c0c3e80 2023-11-27T22:29:50.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7effb99c9640 1 Processor -- start 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb75d03640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb5c0047c0 0x7fdb5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb75d03640 1 -- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c003b00 msgr2=0x7fdb5c003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb75d03640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c003b00 0x7fdb5c003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb75d03640 1 -- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb5c0052a0 msgr2=0x7fdb5c00fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb75d03640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb5c0052a0 0x7fdb5c00fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.407+0000 7fdb75d03640 1 -- 172.21.15.154:0/3488701499 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c003520 con 0x7fdb5c0047c0 2023-11-27T22:29:50.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb76d05640 1 -- 172.21.15.154:0/3488701499 reap_dead start 2023-11-27T22:29:50.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7f0f52390640 1 Processor -- start 2023-11-27T22:29:50.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2b59e640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb2c14b3d0 0x7fdb2c06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2ad9d640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0c3e80 0x7fdb2c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7effb99c9640 1 -- start start 2023-11-27T22:29:50.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2a59c640 1 -- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0c3e80 msgr2=0x7fdb2c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2a59c640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0c3e80 0x7fdb2c0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2a59c640 1 -- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb2c14b3d0 msgr2=0x7fdb2c06f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2a59c640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb2c14b3d0 0x7fdb2c06f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2a59c640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24009b30 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7f6ce7fff640 1 --2- 172.21.15.154:0/3783329725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce806d4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009870 tx=0x7f6cdc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85da5cc6ee9afb5e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7f0f52390640 1 -- start start 2023-11-27T22:29:50.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7f6ce6ffd640 1 -- 172.21.15.154:0/3783329725 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc031640 con 0x7f6ce81592c0 2023-11-27T22:29:50.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f0f52390640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c1370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f0f52390640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4c0b2060 0x7f0f4c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f0f52390640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f4c158690 0x7f0f4c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f0f52390640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c138100 con 0x7f0f4c158690 2023-11-27T22:29:50.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f0f52390640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0cd4c0 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f0f52390640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0cd7a0 con 0x7f0f4c0b2060 2023-11-27T22:29:50.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7f1df2ffd640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df40b3cc0 0x7f1df40cded0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1de40097a0 tx=0x7f1de402d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0bdcefb981b7e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f1df27fc640 1 -- 172.21.15.154:0/2887446105 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4033750 con 0x7f1df40b3cc0 2023-11-27T22:29:50.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f1df27fc640 1 -- 172.21.15.154:0/2887446105 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de40338b0 con 0x7f1df40b3cc0 2023-11-27T22:29:50.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f1df27fc640 1 -- 172.21.15.154:0/2887446105 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4033c40 con 0x7f1df40b3cc0 2023-11-27T22:29:50.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb2a59c640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 0x7fdb2c0c7f80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb2402c480 tx=0x7fdb24004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2403e450 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2403e5b0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2403e960 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2c0ca3e0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c0c8870 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7f6ce6ffd640 1 -- 172.21.15.154:0/3783329725 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc0317a0 con 0x7f6ce81592c0 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f6ced413640 1 -- 172.21.15.154:0/3783329725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 msgr2=0x7f6ce806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7f6ced413640 1 --2- 172.21.15.154:0/3783329725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce806d4f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009870 tx=0x7f6cdc02b8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7effb99c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4071e70 0x7effb415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7effb99c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40b3710 0x7effb414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f5092d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f4c158690 0x7f0f4c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c1370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f5092d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f4c158690 0x7f0f4c0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53430/0 (socket says 172.21.15.154:53430) 2023-11-27T22:29:50.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f5092d640 1 -- 172.21.15.154:0/3417408709 learned_addr learned my addr 172.21.15.154:0/3417408709 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4b7fe640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4c0b2060 0x7f0f4c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f6ced413640 1 -- 172.21.15.154:0/3783329725 shutdown_connections 2023-11-27T22:29:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f6ced413640 1 --2- 172.21.15.154:0/3783329725 >> v2:172.21.15.154:3300/0 conn(0x7f6ce8069320 0x7f6ce806da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f6ced413640 1 --2- 172.21.15.154:0/3783329725 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce806d4f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f6ced413640 1 -- 172.21.15.154:0/3783329725 >> 172.21.15.154:0/3783329725 conn(0x7f6ce80b0c10 msgr2=0x7f6ce80b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7effb89c7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4071e70 0x7effb415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df40b3cc0 msgr2=0x7f1df40cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df40b3cc0 0x7f1df40cded0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1de40097a0 tx=0x7f1de402d870 comp rx=0 tx=0).stop 2023-11-27T22:29:50.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7effb99c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40ae020 0x7effb40abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb89c7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4071e70 0x7effb415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:50110/0 (socket says 172.21.15.154:50110) 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb89c7640 1 -- 172.21.15.154:0/1255566231 learned_addr learned my addr 172.21.15.154:0/1255566231 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb414d210 con 0x7effb40b3710 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb414d490 con 0x7effb4071e70 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb415fd50 con 0x7effb40ae020 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb91c8640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40ae020 0x7effb40abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.408+0000 7fdb75d03640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb5c0047c0 0x7fdb5c004c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb60007a30 tx=0x7fdb5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470bc0e98d1e8f78 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6003b600 con 0x7fdb5c0047c0 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60037050 con 0x7fdb5c0047c0 2023-11-27T22:29:50.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.409+0000 7fdb75502640 1 -- 172.21.15.154:0/3488701499 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6003b9c0 con 0x7fdb5c0047c0 2023-11-27T22:29:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7effb3fff640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40b3710 0x7effb414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f6ced413640 1 -- 172.21.15.154:0/3783329725 shutdown_connections 2023-11-27T22:29:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 shutdown_connections 2023-11-27T22:29:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df4069320 0x7f1df40ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/2887446105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df40b3cc0 0x7f1df40cded0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 >> 172.21.15.154:0/2887446105 conn(0x7f1df40cf000 msgr2=0x7f1df40cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb3fff640 1 -- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40ae020 msgr2=0x7effb40abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb3fff640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40ae020 0x7effb40abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb3fff640 1 -- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4071e70 msgr2=0x7effb415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb3fff640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4071e70 0x7effb415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb5c0047c0 msgr2=0x7fdb5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb5c0047c0 0x7fdb5c004c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdb60007a30 tx=0x7fdb5c0057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb3fff640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa4009400 con 0x7effb40b3710 2023-11-27T22:29:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb3fff640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40b3710 0x7effb414ccd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effac00cac0 tx=0x7effac00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4bfff640 1 -- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4c0b2060 msgr2=0x7f0f4c148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4bfff640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4c0b2060 0x7f0f4c148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4bfff640 1 -- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f4c158690 msgr2=0x7f0f4c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4bfff640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f4c158690 0x7f0f4c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4bfff640 1 -- 172.21.15.154:0/3417408709 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0094d0 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.410+0000 7f0f4b7fe640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4c0b2060 0x7f0f4c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 shutdown_connections 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 --2- 172.21.15.154:0/3488701499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb5c0047c0 0x7fdb5c004c40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 >> 172.21.15.154:0/3488701499 conn(0x7fdb6801e680 msgr2=0x7fdb680553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f0f4bfff640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c1370f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c4e0 tx=0x7f0f4000c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00a700 con 0x7effb40b3710 2023-11-27T22:29:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 shutdown_connections 2023-11-27T22:29:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 shutdown_connections 2023-11-27T22:29:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb78768640 1 -- 172.21.15.154:0/3488701499 wait complete. 2023-11-27T22:29:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c005250 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005480 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.412+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4160030 con 0x7effb40b3710 2023-11-27T22:29:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.412+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb41605f0 con 0x7effb40b3710 2023-11-27T22:29:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.412+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00a860 con 0x7effb40b3710 2023-11-27T22:29:50.448 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.412+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00abf0 con 0x7effb40b3710 2023-11-27T22:29:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f400035f0 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.412+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005480 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4c0cda80 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c0ce040 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7fdb78768640 1 Processor -- start 2023-11-27T22:29:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f1df9f4c640 1 -- 172.21.15.154:0/2887446105 wait complete. 2023-11-27T22:29:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7f1df9f4c640 1 Processor -- start 2023-11-27T22:29:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.412+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdb2403eac0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7fdb137fe640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb1806b290 0x7fdb1806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb240ac7c0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7fdb2ad9d640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb1806b290 0x7fdb1806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.411+0000 7f6ced413640 1 -- 172.21.15.154:0/3783329725 wait complete. 2023-11-27T22:29:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7f6ced413640 1 Processor -- start 2023-11-27T22:29:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.413+0000 7f6ced413640 1 -- start start 2023-11-27T22:29:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.414+0000 7f1df9f4c640 1 -- start start 2023-11-27T22:29:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.414+0000 7fdb2ad9d640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb1806b290 0x7fdb1806d750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c000f60 tx=0x7fdb1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df9f4c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 0x7f1df4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.414+0000 7f6ced413640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 0x7f6ce8146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ced413640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ce8070780 0x7f6ce8147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ced413640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce8145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ced413640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce809a2d0 con 0x7f6ce8069320 2023-11-27T22:29:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df9f4c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df40b3cc0 0x7f1df40ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df9f4c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1df41594b0 0x7f1df40ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.414+0000 7fdb78768640 1 -- start start 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb78768640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c0047c0 0x7fdb680488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb78768640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb681784b0 0x7fdb680e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb78768640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 0x7fdb6804b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb78768640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6804abe0 con 0x7fdb6804b000 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb78768640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68033730 con 0x7fdb681784b0 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb78768640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb68033a10 con 0x7fdb5c0047c0 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb76d05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 0x7fdb6804b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb76d05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 0x7fdb6804b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53452/0 (socket says 172.21.15.154:53452) 2023-11-27T22:29:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7fdb76d05640 1 -- 172.21.15.154:0/272572640 learned_addr learned my addr 172.21.15.154:0/272572640 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df9f4c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4159930 con 0x7f1df4069320 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df9f4c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4159c10 con 0x7f1df41594b0 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df9f4c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df4159ef0 con 0x7f1df40b3cc0 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 0x7f1df4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 0x7f1df4156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53440/0 (socket says 172.21.15.154:53440) 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df37fe640 1 -- 172.21.15.154:0/3882666842 learned_addr learned my addr 172.21.15.154:0/3882666842 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.455 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f1df3fff640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1df41594b0 0x7f1df40ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ced413640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80cc450 con 0x7f6ce8070780 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ced413640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80cc730 con 0x7f6ce81592c0 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 0x7f6ce8146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 0x7f6ce8146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53438/0 (socket says 172.21.15.154:53438) 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ce7fff640 1 -- 172.21.15.154:0/3782594010 learned_addr learned my addr 172.21.15.154:0/3782594010 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.415+0000 7f6ce77fe640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ce8070780 0x7f6ce8147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce8145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c0ce230 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7effac00ad50 con 0x7effb40b3710 2023-11-27T22:29:50.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff94005250 con 0x7effb40b3710 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 -- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ce8070780 msgr2=0x7f6ce8147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ce8070780 0x7f6ce8147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 -- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 msgr2=0x7f6ce8146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 0x7f6ce8146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 -- 172.21.15.154:0/3782594010 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0094d0 con 0x7f6ce81592c0 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6ce7fff640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 0x7f6ce8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:50.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6ce77fe640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ce8070780 0x7f6ce8147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7f6cecc12640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce8145cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c730 tx=0x7f6ce000cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7fdb76d05640 1 -- 172.21.15.154:0/272572640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c0047c0 msgr2=0x7fdb680488c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T22:29:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7fdb76d05640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c0047c0 0x7fdb680488c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7fdb76d05640 1 -- 172.21.15.154:0/272572640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb681784b0 msgr2=0x7fdb680e1a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T22:29:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7fdb76d05640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb681784b0 0x7fdb680e1a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7fdb76d05640 1 -- 172.21.15.154:0/272572640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68033cf0 con 0x7fdb6804b000 2023-11-27T22:29:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.416+0000 7effb17fa640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7effa006b240 0x7effa006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0f400037a0 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0003b70 con 0x7f6ce81592c0 2023-11-27T22:29:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0003cf0 con 0x7f6ce81592c0 2023-11-27T22:29:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0005310 con 0x7f6ce81592c0 2023-11-27T22:29:50.461 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7effb89c7640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7effa006b240 0x7effa006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce80cca10 con 0x7f6ce81592c0 2023-11-27T22:29:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ccfd0 con 0x7f6ce81592c0 2023-11-27T22:29:50.462 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f0f48ff9640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0f3806b220 0x7f0f3806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7fdb76d05640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 0x7fdb6804b480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb70069280 tx=0x7fdb70067f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7effb89c7640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7effa006b240 0x7effa006d700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effa402b720 tx=0x7effa4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df37fe640 1 -- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df40b3cc0 msgr2=0x7f1df40ad020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df37fe640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df40b3cc0 0x7f1df40ad020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df37fe640 1 -- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1df41594b0 msgr2=0x7f1df40ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df37fe640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1df41594b0 0x7f1df40ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df37fe640 1 -- 172.21.15.154:0/3882666842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4009400 con 0x7f1df4069320 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df37fe640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 0x7f1df4156380 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1de800c7c0 tx=0x7f1de800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f1df3fff640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1df41594b0 0x7f1df40ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:50.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f40088be0 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.417+0000 7f44422b4640 1 Processor -- start 2023-11-27T22:29:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.418+0000 7f0f4b7fe640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0f3806b220 0x7f0f3806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.418+0000 7f44422b4640 1 -- start start 2023-11-27T22:29:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.418+0000 7f0f4b7fe640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0f3806b220 0x7f0f3806d6e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c036000 tx=0x7f0f3c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f44422b4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44340078a0 0x7f44340edd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f44422b4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4434058530 con 0x7f44340e3080 2023-11-27T22:29:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f44422b4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4434058810 con 0x7f443403e800 2023-11-27T22:29:50.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f44422b4640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4434006160 con 0x7f44340078a0 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f4440ab1640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f443403e800 0x7f4434053bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53732/0 (socket says 172.21.15.154:53732) 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f4441ab3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44340078a0 0x7f44340edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f4440ab1640 1 -- 172.21.15.154:0/2816697548 learned_addr learned my addr 172.21.15.154:0/2816697548 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f4441ab3640 1 -- 172.21.15.154:0/2816697548 >> v1:172.21.15.194:6789/0 conn(0x7f443403e800 legacy=0x7f4434053bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f4441ab3640 1 -- 172.21.15.154:0/2816697548 >> v1:172.21.15.154:6789/0 conn(0x7f44340e3080 legacy=0x7f4434057d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f4441ab3640 1 -- 172.21.15.154:0/2816697548 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4434058af0 con 0x7f44340078a0 2023-11-27T22:29:50.467 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6ce0005470 con 0x7f6ce81592c0 2023-11-27T22:29:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce80cd1f0 con 0x7f6ce81592c0 2023-11-27T22:29:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.419+0000 7f6ce4ff9640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6cd406b1c0 0x7f6cd406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.420+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce0089610 con 0x7f6ce81592c0 2023-11-27T22:29:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.420+0000 7f4441ab3640 1 --2- 172.21.15.154:0/2816697548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44340078a0 0x7f44340edd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f442c0097a0 tx=0x7f442c02b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d3e78708be6edf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.420+0000 7f6ce7fff640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6cd406b1c0 0x7f6cd406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.420+0000 7f6ce7fff640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6cd406b1c0 0x7f6cd406d680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc02b930 tx=0x7f6cdc03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effac057ea0 con 0x7effb40b3710 2023-11-27T22:29:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7006adb0 con 0x7fdb6804b000 2023-11-27T22:29:50.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8007a80 con 0x7f1df4069320 2023-11-27T22:29:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb680de8f0 con 0x7fdb6804b000 2023-11-27T22:29:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7f4433fff640 1 -- 172.21.15.154:0/2816697548 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c02f800 con 0x7f44340078a0 2023-11-27T22:29:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdb240774d0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb680e2170 con 0x7fdb6804b000 2023-11-27T22:29:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df415a1d0 con 0x7f1df4069320 2023-11-27T22:29:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.421+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df41568c0 con 0x7f1df4069320 2023-11-27T22:29:50.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.422+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb680057a0 con 0x7fdb6804b000 2023-11-27T22:29:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.422+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df415a6f0 con 0x7f1df4069320 2023-11-27T22:29:50.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.424+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0f40053960 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7f4433fff640 1 -- 172.21.15.154:0/2816697548 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c02f960 con 0x7f44340078a0 2023-11-27T22:29:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7f4433fff640 1 -- 172.21.15.154:0/2816697548 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c02fcf0 con 0x7f44340078a0 2023-11-27T22:29:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70071050 con 0x7fdb6804b000 2023-11-27T22:29:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7009f680 con 0x7fdb6804b000 2023-11-27T22:29:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de800ce10 con 0x7f1df4069320 2023-11-27T22:29:50.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de8007de0 con 0x7f1df4069320 2023-11-27T22:29:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.426+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7effac0541e0 con 0x7effb40b3710 2023-11-27T22:29:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.427+0000 7f44422b4640 1 -- 172.21.15.154:0/2816697548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44340078a0 msgr2=0x7f44340edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.427+0000 7f44422b4640 1 --2- 172.21.15.154:0/2816697548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44340078a0 0x7f44340edd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f442c0097a0 tx=0x7f442c02b9e0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.427+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6ce0054340 con 0x7f6ce81592c0 2023-11-27T22:29:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.429+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdb70092030 con 0x7fdb6804b000 2023-11-27T22:29:50.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.429+0000 7fdb66ffd640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb5406b1c0 0x7fdb5406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.429+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb70090070 con 0x7fdb6804b000 2023-11-27T22:29:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f44422b4640 1 -- 172.21.15.154:0/2816697548 shutdown_connections 2023-11-27T22:29:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f44422b4640 1 --2- 172.21.15.154:0/2816697548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44340078a0 0x7f44340edd50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f44422b4640 1 -- 172.21.15.154:0/2816697548 >> 172.21.15.154:0/2816697548 conn(0x7f44340559a0 msgr2=0x7f4434055db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7fdb76504640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb5406b1c0 0x7fdb5406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.431+0000 7fdb76504640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb5406b1c0 0x7fdb5406d680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb68003e40 tx=0x7fdb6c007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1de800f070 con 0x7f1df4069320 2023-11-27T22:29:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f1ddbfff640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1de006b1c0 0x7f1de006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.431+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1de808a2e0 con 0x7f1df4069320 2023-11-27T22:29:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f44422b4640 1 -- 172.21.15.154:0/2816697548 shutdown_connections 2023-11-27T22:29:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.430+0000 7f44422b4640 1 -- 172.21.15.154:0/2816697548 wait complete. 2023-11-27T22:29:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.431+0000 7f1df2ffd640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1de006b1c0 0x7f1de006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.432+0000 7f1df2ffd640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1de006b1c0 0x7f1de006d680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1de4037000 tx=0x7f1de4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.432+0000 7f44422b4640 1 Processor -- start 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.432+0000 7f44422b4640 1 -- start start 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.433+0000 7f44422b4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 0x7f4434052590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.433+0000 7f44422b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 0x7f4434051570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f4440ab1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 0x7f4434051570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f4440ab1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 0x7f4434051570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53470/0 (socket says 172.21.15.154:53470) 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f44412b2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 0x7f4434052590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f44412b2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 0x7f4434052590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:55808/0 (socket says 172.21.15.154:55808) 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f4440ab1640 1 -- 172.21.15.154:0/3659367032 learned_addr learned my addr 172.21.15.154:0/3659367032 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44340e3080 0x7f443417e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44340ddbc0 con 0x7f443403e800 2023-11-27T22:29:50.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4434052c20 con 0x7f44340e3080 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4434038750 con 0x7f44340078a0 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.434+0000 7f4441ab3640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44340e3080 0x7f443417e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f44412b2640 1 -- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44340e3080 msgr2=0x7f443417e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f44412b2640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44340e3080 0x7f443417e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f44412b2640 1 -- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 msgr2=0x7f4434051570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f44412b2640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 0x7f4434051570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f44412b2640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c009400 con 0x7f44340078a0 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f4440ab1640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 0x7f4434051570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:29:50.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f4441ab3640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44340e3080 0x7f443417e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f44412b2640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 0x7f4434052590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f443800c390 tx=0x7f443800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380052d0 con 0x7f44340078a0 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438005430 con 0x7f44340078a0 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.435+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438003830 con 0x7f44340078a0 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.436+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44340dd220 con 0x7f44340078a0 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.436+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44340dd7e0 con 0x7f44340078a0 2023-11-27T22:29:50.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.436+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1de8054ff0 con 0x7f1df4069320 2023-11-27T22:29:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.438+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4434054240 con 0x7f44340078a0 2023-11-27T22:29:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.440+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4438003990 con 0x7f44340078a0 2023-11-27T22:29:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.440+0000 7f4431ffb640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f442006b1c0 0x7f442006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.440+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4438088e50 con 0x7f44340078a0 2023-11-27T22:29:50.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.441+0000 7f4440ab1640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f442006b1c0 0x7f442006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.441+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdb700ce270 con 0x7fdb6804b000 2023-11-27T22:29:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.442+0000 7f4440ab1640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f442006b1c0 0x7f442006d680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f443c064320 tx=0x7f443c068a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:50.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.444+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4438053ca0 con 0x7f44340078a0 2023-11-27T22:29:50.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.758+0000 7fdf9d7fa640 1 -- 172.21.15.154:0/3102825434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdf98005500 con 0x7fdfb8072300 2023-11-27T22:29:50.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.759+0000 7fdf9f7fe640 1 -- 172.21.15.154:0/3102825434 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfa8017090 con 0x7fdfb8072300 2023-11-27T22:29:50.762 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.762+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfa006b470 msgr2=0x7fdfa006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.762+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfa006b470 0x7fdfa006d930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfac036000 tx=0x7fdfac03b040 comp rx=0 tx=0).stop 2023-11-27T22:29:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.762+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 msgr2=0x7fdfb80afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.762+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 0x7fdfb80afd70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e9b0 tx=0x7fdfa800ee70 comp rx=0 tx=0).stop 2023-11-27T22:29:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 shutdown_connections 2023-11-27T22:29:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdfa006b470 0x7fdfa006d930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfb813df20 0x7fdfb80b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdfb8072300 0x7fdfb80afd70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 --2- 172.21.15.154:0/3102825434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfb8071ea0 0x7fdfb814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 >> 172.21.15.154:0/3102825434 conn(0x7fdfb806a4d0 msgr2=0x7fdfb80b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 shutdown_connections 2023-11-27T22:29:50.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.763+0000 7fdfb7fff640 1 -- 172.21.15.154:0/3102825434 wait complete. 2023-11-27T22:29:50.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-11-27T22:29:50.783 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.800+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdb680e2170 con 0x7fdb6804b000 2023-11-27T22:29:50.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.800+0000 7fdb66ffd640 1 -- 172.21.15.154:0/272572640 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb7009a020 con 0x7fdb6804b000 2023-11-27T22:29:50.803 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:50.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb5406b1c0 msgr2=0x7fdb5406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb5406b1c0 0x7fdb5406d680 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb68003e40 tx=0x7fdb6c007d90 comp rx=0 tx=0).stop 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 msgr2=0x7fdb6804b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 0x7fdb6804b480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb70069280 tx=0x7fdb70067f00 comp rx=0 tx=0).stop 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 shutdown_connections 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb681784b0 0x7fdb680e1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb5406b1c0 0x7fdb5406d680 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb6804b000 0x7fdb6804b480 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 --2- 172.21.15.154:0/272572640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb5c0047c0 0x7fdb680488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.802+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 >> 172.21.15.154:0/272572640 conn(0x7fdb6801e680 msgr2=0x7fdb680078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.803+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 shutdown_connections 2023-11-27T22:29:50.807 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.803+0000 7fdb78768640 1 -- 172.21.15.154:0/272572640 wait complete. 2023-11-27T22:29:50.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-11-27T22:29:50.816 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.827+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdb0c005500 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.827+0000 7fdb137fe640 1 -- 172.21.15.154:0/1032750129 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb2407aaf0 con 0x7fdb2c0d19d0 2023-11-27T22:29:50.831 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.828+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f4c069400 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.828+0000 7f0f48ff9640 1 -- 172.21.15.154:0/3417408709 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f40017090 con 0x7f0f4c0b0cf0 2023-11-27T22:29:50.833 INFO:teuthology.orchestra.run.smithi154.stdout:55834574854 2023-11-27T22:29:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb1806b290 msgr2=0x7fdb1806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb1806b290 0x7fdb1806d750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c000f60 tx=0x7fdb1c009040 comp rx=0 tx=0).stop 2023-11-27T22:29:50.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 msgr2=0x7fdb2c0c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 0x7fdb2c0c7f80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb2402c480 tx=0x7fdb24004a70 comp rx=0 tx=0).stop 2023-11-27T22:29:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 shutdown_connections 2023-11-27T22:29:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb2c14b3d0 0x7fdb2c06f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdb1806b290 0x7fdb1806d750 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c000f60 tx=0x7fdb1c009040 comp rx=0 tx=0).stop 2023-11-27T22:29:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb2c0d19d0 0x7fdb2c0c7f80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 --2- 172.21.15.154:0/1032750129 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb2c0c3e80 0x7fdb2c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.830+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 >> 172.21.15.154:0/1032750129 conn(0x7fdb2c0d0eb0 msgr2=0x7fdb2c0d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 shutdown_connections 2023-11-27T22:29:50.836 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7fdb31048640 1 -- 172.21.15.154:0/1032750129 wait complete. 2023-11-27T22:29:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0f3806b220 msgr2=0x7f0f3806d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0f3806b220 0x7f0f3806d6e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c036000 tx=0x7f0f3c03d040 comp rx=0 tx=0).stop 2023-11-27T22:29:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 msgr2=0x7f0f4c1370f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c1370f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c4e0 tx=0x7f0f4000c9a0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 shutdown_connections 2023-11-27T22:29:50.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0f3806b220 0x7f0f3806d6e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f4c158690 0x7f0f4c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4c0b2060 0x7f0f4c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 --2- 172.21.15.154:0/3417408709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c0b0cf0 0x7f0f4c1370f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.831+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 >> 172.21.15.154:0/3417408709 conn(0x7f0f4c06a4d0 msgr2=0x7f0f4c152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.839 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.832+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 shutdown_connections 2023-11-27T22:29:50.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.832+0000 7f0f52390640 1 -- 172.21.15.154:0/3417408709 wait complete. 2023-11-27T22:29:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.832+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7eff94005500 con 0x7effb40b3710 2023-11-27T22:29:50.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.832+0000 7effb17fa640 1 -- 172.21.15.154:0/1255566231 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effac018070 con 0x7effb40b3710 2023-11-27T22:29:50.841 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.834+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7effa006b240 msgr2=0x7effa006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7effa006b240 0x7effa006d700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7effa402b720 tx=0x7effa4008030 comp rx=0 tx=0).stop 2023-11-27T22:29:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40b3710 msgr2=0x7effb414ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40b3710 0x7effb414ccd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effac00cac0 tx=0x7effac00cf80 comp rx=0 tx=0).stop 2023-11-27T22:29:50.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 shutdown_connections 2023-11-27T22:29:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7effa006b240 0x7effa006d700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effb40ae020 0x7effb40abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effb40b3710 0x7effb414ccd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 --2- 172.21.15.154:0/1255566231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb4071e70 0x7effb415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 >> 172.21.15.154:0/1255566231 conn(0x7effb406a4d0 msgr2=0x7effb4163ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 shutdown_connections 2023-11-27T22:29:50.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7effb99c9640 1 -- 172.21.15.154:0/1255566231 wait complete. 2023-11-27T22:29:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.835+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ce8067420 con 0x7f6ce81592c0 2023-11-27T22:29:50.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.836+0000 7f6ce4ff9640 1 -- 172.21.15.154:0/3782594010 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ce0003e60 con 0x7f6ce81592c0 2023-11-27T22:29:50.846 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6cd406b1c0 msgr2=0x7f6cd406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6cd406b1c0 0x7f6cd406d680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc02b930 tx=0x7f6cdc03c040 comp rx=0 tx=0).stop 2023-11-27T22:29:50.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1df415a6f0 con 0x7f1df4069320 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 msgr2=0x7f6ce8145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce8145cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000c730 tx=0x7f6ce000cb30 comp rx=0 tx=0).stop 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 shutdown_connections 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ce8070780 0x7f6ce8147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6cd406b1c0 0x7f6cd406d680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ce81592c0 0x7f6ce8145cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.848 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 --2- 172.21.15.154:0/3782594010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ce8069320 0x7f6ce8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 >> 172.21.15.154:0/3782594010 conn(0x7f6ce80b0c10 msgr2=0x7f6ce80af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 shutdown_connections 2023-11-27T22:29:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.838+0000 7f6ced413640 1 -- 172.21.15.154:0/3782594010 wait complete. 2023-11-27T22:29:50.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.839+0000 7f1ddbfff640 1 -- 172.21.15.154:0/3882666842 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1df415a6f0 con 0x7f1df4069320 2023-11-27T22:29:50.850 INFO:teuthology.orchestra.run.smithi154.stdout:55834574856 2023-11-27T22:29:50.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1de006b1c0 msgr2=0x7f1de006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1de006b1c0 0x7f1de006d680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1de4037000 tx=0x7f1de4008030 comp rx=0 tx=0).stop 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 msgr2=0x7f1df4156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 0x7f1df4156380 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1de800c7c0 tx=0x7f1de800cbc0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 shutdown_connections 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1df41594b0 0x7f1df40ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1de006b1c0 0x7f1de006d680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1df40b3cc0 0x7f1df40ad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 --2- 172.21.15.154:0/3882666842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1df4069320 0x7f1df4156380 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1de800c7c0 tx=0x7f1de800cbc0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.842+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 >> 172.21.15.154:0/3882666842 conn(0x7f1df40cf000 msgr2=0x7f1df40af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.843+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 shutdown_connections 2023-11-27T22:29:50.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.843+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44340057a0 con 0x7f44340078a0 2023-11-27T22:29:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.843+0000 7f1df9f4c640 1 -- 172.21.15.154:0/3882666842 wait complete. 2023-11-27T22:29:50.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.843+0000 7f4431ffb640 1 -- 172.21.15.154:0/3659367032 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4438017020 con 0x7f44340078a0 2023-11-27T22:29:50.854 INFO:teuthology.orchestra.run.smithi154.stdout:55834574855 2023-11-27T22:29:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f442006b1c0 msgr2=0x7f442006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f442006b1c0 0x7f442006d680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f443c064320 tx=0x7f443c068a70 comp rx=0 tx=0).stop 2023-11-27T22:29:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 msgr2=0x7f4434052590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 0x7f4434052590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f443800c390 tx=0x7f443800c850 comp rx=0 tx=0).stop 2023-11-27T22:29:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 shutdown_connections 2023-11-27T22:29:50.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44340e3080 0x7f443417e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f442006b1c0 0x7f442006d680 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f443c064320 tx=0x7f443c068a70 comp rx=0 tx=0).stop 2023-11-27T22:29:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f443403e800 0x7f4434051570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:50.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 --2- 172.21.15.154:0/3659367032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44340078a0 0x7f4434052590 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f443800c390 tx=0x7f443800c850 comp rx=0 tx=0).stop 2023-11-27T22:29:50.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.846+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 >> 172.21.15.154:0/3659367032 conn(0x7f44340559a0 msgr2=0x7f443403a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.847+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 shutdown_connections 2023-11-27T22:29:50.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:50.847+0000 7f44422b4640 1 -- 172.21.15.154:0/3659367032 wait complete. 2023-11-27T22:29:50.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-11-27T22:29:50.859 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-11-27T22:29:50.860 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-27T22:29:50.860 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-11-27T22:29:50.862 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-11-27T22:29:50.863 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-11-27T22:29:50.864 DEBUG:teuthology.parallel:result is None 2023-11-27T22:29:50.865 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T22:29:50.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:51.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.002+0000 7f9591497640 1 Processor -- start 2023-11-27T22:29:51.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.002+0000 7f9591497640 1 -- start start 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9591497640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 0x7f958c1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9591497640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c1406f0 con 0x7f958c06abe0 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9591497640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c143960 con 0x7f958c140310 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9591497640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c161e20 con 0x7f958c1409d0 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f958a7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f958c06abe0 0x7f958c06efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41370/0 (socket says 172.21.15.154:41370) 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f958a7fc640 1 -- 172.21.15.154:0/3290321114 learned_addr learned my addr 172.21.15.154:0/3290321114 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832717579 0 0) 0x7f958c1406f0 con 0x7f958c06abe0 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9574003520 con 0x7f958c06abe0 2023-11-27T22:29:51.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f958b7fe640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 0x7f958c1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2780810470 0 0) 0x7f9574003520 con 0x7f958c06abe0 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 msgr2=0x7f958c1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 0x7f958c1618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 >> v1:172.21.15.194:6789/0 conn(0x7f958c140310 legacy=0x7f958c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c142de0 con 0x7f958c06abe0 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f9580001670 con 0x7f958c06abe0 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 >> v1:172.21.15.154:6789/0 conn(0x7f958c06abe0 legacy=0x7f958c06efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.003+0000 7f9589ffb640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 0x7f95740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f9589ffb640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f95740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f9589ffb640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9574004d00 0x7f9574005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c161e20 con 0x7f9574003fd0 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957400bbc0 con 0x7f9574004d00 2023-11-27T22:29:51.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957400bd80 con 0x7f958c1409d0 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958a7fc640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f95740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958affd640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 0x7f95740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958b7fe640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9574004d00 0x7f9574005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958a7fc640 1 -- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 msgr2=0x7f95740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958a7fc640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1409d0 0x7f95740039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958a7fc640 1 -- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9574004d00 msgr2=0x7f9574005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958a7fc640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9574004d00 0x7f9574005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.004+0000 7f958a7fc640 1 -- 172.21.15.154:0/3290321114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9574003520 con 0x7f9574003fd0 2023-11-27T22:29:51.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f958a7fc640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f95740047c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f958000c240 tx=0x7f95740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbccc8a133dfc313 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580005ad0 con 0x7f9574003fd0 2023-11-27T22:29:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580005c30 con 0x7f9574003fd0 2023-11-27T22:29:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9589ffb640 1 -- 172.21.15.154:0/3290321114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958002caf0 con 0x7f9574003fd0 2023-11-27T22:29:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9591497640 1 -- 172.21.15.154:0/3290321114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 msgr2=0x7f95740047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9591497640 1 --2- 172.21.15.154:0/3290321114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f95740047c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f958000c240 tx=0x7f95740057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f958b7fe640 1 -- 172.21.15.154:0/3290321114 reap_dead start 2023-11-27T22:29:51.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9591497640 1 -- 172.21.15.154:0/3290321114 shutdown_connections 2023-11-27T22:29:51.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9591497640 1 -- 172.21.15.154:0/3290321114 >> 172.21.15.154:0/3290321114 conn(0x7f958c0b1e50 msgr2=0x7f958c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:51.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9591497640 1 -- 172.21.15.154:0/3290321114 shutdown_connections 2023-11-27T22:29:51.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.005+0000 7f9591497640 1 -- 172.21.15.154:0/3290321114 wait complete. 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 Processor -- start 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 -- start start 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f958c13f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1f2f60 0x7f958c0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958c1f33e0 0x7f958c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c1f3f00 con 0x7f9574003fd0 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c1440d0 con 0x7f958c1f33e0 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f9591497640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c13ff10 con 0x7f958c1f2f60 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f958affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f958c13f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f958affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f958c13f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53488/0 (socket says 172.21.15.154:53488) 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.007+0000 7f958affd640 1 -- 172.21.15.154:0/2008882318 learned_addr learned my addr 172.21.15.154:0/2008882318 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958b7fe640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958c1f33e0 0x7f958c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958a7fc640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1f2f60 0x7f958c0714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958affd640 1 -- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1f2f60 msgr2=0x7f958c0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958affd640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1f2f60 0x7f958c0714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958affd640 1 -- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958c1f33e0 msgr2=0x7f958c0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958affd640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958c1f33e0 0x7f958c0719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958affd640 1 -- 172.21.15.154:0/2008882318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c1f3940 con 0x7f9574003fd0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f958affd640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f958c13f9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f957c00f960 tx=0x7f957c00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c006d60 con 0x7f9574003fd0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c003970 con 0x7f9574003fd0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c003d20 con 0x7f9574003fd0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c1f3c20 con 0x7f9574003fd0 2023-11-27T22:29:51.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.008+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c157450 con 0x7f9574003fd0 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.009+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c143b50 con 0x7f9574003fd0 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.009+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f957c00d7f0 con 0x7f9574003fd0 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.010+0000 7f95737fe640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f957806b1f0 0x7f957806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.010+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f957c089340 con 0x7f9574003fd0 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.010+0000 7f958a7fc640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f957806b1f0 0x7f957806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.010+0000 7f958a7fc640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f957806b1f0 0x7f957806d6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9580034000 tx=0x7f9580009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:51.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.014+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f958c143b50 con 0x7f9574003fd0 2023-11-27T22:29:51.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.178+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f958c143680 con 0x7f957806b1f0 2023-11-27T22:29:51.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.185+0000 7f95737fe640 1 -- 172.21.15.154:0/2008882318 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264563 (secure 0 0 0) 0x7f95800059c0 con 0x7f957806b1f0 2023-11-27T22:29:51.191 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:51.192 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f957806b1f0 msgr2=0x7f957806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f957806b1f0 0x7f957806d6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9580034000 tx=0x7f9580009030 comp rx=0 tx=0).stop 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 msgr2=0x7f958c13f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f958c13f9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f957c00f960 tx=0x7f957c00fe20 comp rx=0 tx=0).stop 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 shutdown_connections 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f958c1f33e0 0x7f958c0719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f957806b1f0 0x7f957806d6b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f958c1f2f60 0x7f958c0714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 --2- 172.21.15.154:0/2008882318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9574003fd0 0x7f958c13f9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:51.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 >> 172.21.15.154:0/2008882318 conn(0x7f958c0b1e50 msgr2=0x7f958c15f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:51.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 shutdown_connections 2023-11-27T22:29:51.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:51.188+0000 7f9591497640 1 -- 172.21.15.154:0/2008882318 wait complete. 2023-11-27T22:29:51.202 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-27T22:29:50.964092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.327173"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138285+0000","last_change":"2023-11-27T22:29:39.657258+0000","last_active":"2023-11-27T22:29:41.138285+0000","last_peered":"2023-11-27T22:29:41.138285+0000","last_clean":"2023-11-27T22:29:41.138285+0000","last_became_active":"2023-11-27T22:29:39.656994+0000","last_became_peered":"2023-11-27T22:29:39.656994+0000","last_unstale":"2023-11-27T22:29:41.138285+0000","last_undegraded":"2023-11-27T22:29:41.138285+0000","last_fullsized":"2023-11-27T22:29:41.138285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:23:47.348952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638662+0000","last_change":"2023-11-27T22:29:39.646837+0000","last_active":"2023-11-27T22:29:40.638662+0000","last_peered":"2023-11-27T22:29:40.638662+0000","last_clean":"2023-11-27T22:29:40.638662+0000","last_became_active":"2023-11-27T22:29:39.645981+0000","last_became_peered":"2023-11-27T22:29:39.645981+0000","last_unstale":"2023-11-27T22:29:40.638662+0000","last_undegraded":"2023-11-27T22:29:40.638662+0000","last_fullsized":"2023-11-27T22:29:40.638662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136530+0000","last_change":"2023-11-27T22:29:39.643286+0000","last_active":"2023-11-27T22:29:41.136530+0000","last_peered":"2023-11-27T22:29:41.136530+0000","last_clean":"2023-11-27T22:29:41.136530+0000","last_became_active":"2023-11-27T22:29:39.642812+0000","last_became_peered":"2023-11-27T22:29:39.642812+0000","last_unstale":"2023-11-27T22:29:41.136530+0000","last_undegraded":"2023-11-27T22:29:41.136530+0000","last_fullsized":"2023-11-27T22:29:41.136530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138267+0000","last_change":"2023-11-27T22:29:39.649850+0000","last_active":"2023-11-27T22:29:41.138267+0000","last_peered":"2023-11-27T22:29:41.138267+0000","last_clean":"2023-11-27T22:29:41.138267+0000","last_became_active":"2023-11-27T22:29:39.649553+0000","last_became_peered":"2023-11-27T22:29:39.649553+0000","last_unstale":"2023-11-27T22:29:41.138267+0000","last_undegraded":"2023-11-27T22:29:41.138267+0000","last_fullsized":"2023-11-27T22:29:41.138267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:23:47.348952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138169+0000","last_change":"2023-11-27T22:29:39.653809+0000","last_active":"2023-11-27T22:29:41.138169+0000","last_peered":"2023-11-27T22:29:41.138169+0000","last_clean":"2023-11-27T22:29:41.138169+0000","last_became_active":"2023-11-27T22:29:39.653442+0000","last_became_peered":"2023-11-27T22:29:39.653442+0000","last_unstale":"2023-11-27T22:29:41.138169+0000","last_undegraded":"2023-11-27T22:29:41.138169+0000","last_fullsized":"2023-11-27T22:29:41.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137163+0000","last_change":"2023-11-27T22:29:39.650707+0000","last_active":"2023-11-27T22:29:41.137163+0000","last_peered":"2023-11-27T22:29:41.137163+0000","last_clean":"2023-11-27T22:29:41.137163+0000","last_became_active":"2023-11-27T22:29:39.649995+0000","last_became_peered":"2023-11-27T22:29:39.649995+0000","last_unstale":"2023-11-27T22:29:41.137163+0000","last_undegraded":"2023-11-27T22:29:41.137163+0000","last_fullsized":"2023-11-27T22:29:41.137163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137235+0000","last_change":"2023-11-27T22:29:39.654105+0000","last_active":"2023-11-27T22:29:41.137235+0000","last_peered":"2023-11-27T22:29:41.137235+0000","last_clean":"2023-11-27T22:29:41.137235+0000","last_became_active":"2023-11-27T22:29:39.653603+0000","last_became_peered":"2023-11-27T22:29:39.653603+0000","last_unstale":"2023-11-27T22:29:41.137235+0000","last_undegraded":"2023-11-27T22:29:41.137235+0000","last_fullsized":"2023-11-27T22:29:41.137235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637398+0000","last_change":"2023-11-27T22:29:39.654077+0000","last_active":"2023-11-27T22:29:40.637398+0000","last_peered":"2023-11-27T22:29:40.637398+0000","last_clean":"2023-11-27T22:29:40.637398+0000","last_became_active":"2023-11-27T22:29:39.653518+0000","last_became_peered":"2023-11-27T22:29:39.653518+0000","last_unstale":"2023-11-27T22:29:40.637398+0000","last_undegraded":"2023-11-27T22:29:40.637398+0000","last_fullsized":"2023-11-27T22:29:40.637398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138343+0000","last_change":"2023-11-27T22:29:39.657910+0000","last_active":"2023-11-27T22:29:41.138343+0000","last_peered":"2023-11-27T22:29:41.138343+0000","last_clean":"2023-11-27T22:29:41.138343+0000","last_became_active":"2023-11-27T22:29:39.657639+0000","last_became_peered":"2023-11-27T22:29:39.657639+0000","last_unstale":"2023-11-27T22:29:41.138343+0000","last_undegraded":"2023-11-27T22:29:41.138343+0000","last_fullsized":"2023-11-27T22:29:41.138343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:50.558601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637203+0000","last_change":"2023-11-27T22:29:39.645292+0000","last_active":"2023-11-27T22:29:40.637203+0000","last_peered":"2023-11-27T22:29:40.637203+0000","last_clean":"2023-11-27T22:29:40.637203+0000","last_became_active":"2023-11-27T22:29:39.645012+0000","last_became_peered":"2023-11-27T22:29:39.645012+0000","last_unstale":"2023-11-27T22:29:40.637203+0000","last_undegraded":"2023-11-27T22:29:40.637203+0000","last_fullsized":"2023-11-27T22:29:40.637203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637000+0000","last_change":"2023-11-27T22:29:39.645072+0000","last_active":"2023-11-27T22:29:40.637000+0000","last_peered":"2023-11-27T22:29:40.637000+0000","last_clean":"2023-11-27T22:29:40.637000+0000","last_became_active":"2023-11-27T22:29:39.644771+0000","last_became_peered":"2023-11-27T22:29:39.644771+0000","last_unstale":"2023-11-27T22:29:40.637000+0000","last_undegraded":"2023-11-27T22:29:40.637000+0000","last_fullsized":"2023-11-27T22:29:40.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137914+0000","last_change":"2023-11-27T22:29:39.644172+0000","last_active":"2023-11-27T22:29:41.137914+0000","last_peered":"2023-11-27T22:29:41.137914+0000","last_clean":"2023-11-27T22:29:41.137914+0000","last_became_active":"2023-11-27T22:29:39.643298+0000","last_became_peered":"2023-11-27T22:29:39.643298+0000","last_unstale":"2023-11-27T22:29:41.137914+0000","last_undegraded":"2023-11-27T22:29:41.137914+0000","last_fullsized":"2023-11-27T22:29:41.137914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637594+0000","last_change":"2023-11-27T22:29:39.657540+0000","last_active":"2023-11-27T22:29:40.637594+0000","last_peered":"2023-11-27T22:29:40.637594+0000","last_clean":"2023-11-27T22:29:40.637594+0000","last_became_active":"2023-11-27T22:29:39.657283+0000","last_became_peered":"2023-11-27T22:29:39.657283+0000","last_unstale":"2023-11-27T22:29:40.637594+0000","last_undegraded":"2023-11-27T22:29:40.637594+0000","last_fullsized":"2023-11-27T22:29:40.637594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136428+0000","last_change":"2023-11-27T22:29:39.646882+0000","last_active":"2023-11-27T22:29:41.136428+0000","last_peered":"2023-11-27T22:29:41.136428+0000","last_clean":"2023-11-27T22:29:41.136428+0000","last_became_active":"2023-11-27T22:29:39.646580+0000","last_became_peered":"2023-11-27T22:29:39.646580+0000","last_unstale":"2023-11-27T22:29:41.136428+0000","last_undegraded":"2023-11-27T22:29:41.136428+0000","last_fullsized":"2023-11-27T22:29:41.136428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:37.746015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638442+0000","last_change":"2023-11-27T22:29:39.645413+0000","last_active":"2023-11-27T22:29:40.638442+0000","last_peered":"2023-11-27T22:29:40.638442+0000","last_clean":"2023-11-27T22:29:40.638442+0000","last_became_active":"2023-11-27T22:29:39.645150+0000","last_became_peered":"2023-11-27T22:29:39.645150+0000","last_unstale":"2023-11-27T22:29:40.638442+0000","last_undegraded":"2023-11-27T22:29:40.638442+0000","last_fullsized":"2023-11-27T22:29:40.638442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137158+0000","last_change":"2023-11-27T22:29:39.650165+0000","last_active":"2023-11-27T22:29:41.137158+0000","last_peered":"2023-11-27T22:29:41.137158+0000","last_clean":"2023-11-27T22:29:41.137158+0000","last_became_active":"2023-11-27T22:29:39.649783+0000","last_became_peered":"2023-11-27T22:29:39.649783+0000","last_unstale":"2023-11-27T22:29:41.137158+0000","last_undegraded":"2023-11-27T22:29:41.137158+0000","last_fullsized":"2023-11-27T22:29:41.137158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137800+0000","last_change":"2023-11-27T22:29:39.654571+0000","last_active":"2023-11-27T22:29:41.137800+0000","last_peered":"2023-11-27T22:29:41.137800+0000","last_clean":"2023-11-27T22:29:41.137800+0000","last_became_active":"2023-11-27T22:29:39.654278+0000","last_became_peered":"2023-11-27T22:29:39.654278+0000","last_unstale":"2023-11-27T22:29:41.137800+0000","last_undegraded":"2023-11-27T22:29:41.137800+0000","last_fullsized":"2023-11-27T22:29:41.137800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765150+0000","last_change":"2023-11-27T22:29:39.648168+0000","last_active":"2023-11-27T22:29:40.765150+0000","last_peered":"2023-11-27T22:29:40.765150+0000","last_clean":"2023-11-27T22:29:40.765150+0000","last_became_active":"2023-11-27T22:29:39.647900+0000","last_became_peered":"2023-11-27T22:29:39.647900+0000","last_unstale":"2023-11-27T22:29:40.765150+0000","last_undegraded":"2023-11-27T22:29:40.765150+0000","last_fullsized":"2023-11-27T22:29:40.765150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138592+0000","last_change":"2023-11-27T22:29:39.655501+0000","last_active":"2023-11-27T22:29:41.138592+0000","last_peered":"2023-11-27T22:29:41.138592+0000","last_clean":"2023-11-27T22:29:41.138592+0000","last_became_active":"2023-11-27T22:29:39.655220+0000","last_became_peered":"2023-11-27T22:29:39.655220+0000","last_unstale":"2023-11-27T22:29:41.138592+0000","last_undegraded":"2023-11-27T22:29:41.138592+0000","last_fullsized":"2023-11-27T22:29:41.138592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:53:34.262936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636971+0000","last_change":"2023-11-27T22:29:39.645941+0000","last_active":"2023-11-27T22:29:40.636971+0000","last_peered":"2023-11-27T22:29:40.636971+0000","last_clean":"2023-11-27T22:29:40.636971+0000","last_became_active":"2023-11-27T22:29:39.645663+0000","last_became_peered":"2023-11-27T22:29:39.645663+0000","last_unstale":"2023-11-27T22:29:40.636971+0000","last_undegraded":"2023-11-27T22:29:40.636971+0000","last_fullsized":"2023-11-27T22:29:40.636971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136618+0000","last_change":"2023-11-27T22:29:39.655808+0000","last_active":"2023-11-27T22:29:41.136618+0000","last_peered":"2023-11-27T22:29:41.136618+0000","last_clean":"2023-11-27T22:29:41.136618+0000","last_became_active":"2023-11-27T22:29:39.655505+0000","last_became_peered":"2023-11-27T22:29:39.655505+0000","last_unstale":"2023-11-27T22:29:41.136618+0000","last_undegraded":"2023-11-27T22:29:41.136618+0000","last_fullsized":"2023-11-27T22:29:41.136618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137325+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:41.137325+0000","last_peered":"2023-11-27T22:29:41.137325+0000","last_clean":"2023-11-27T22:29:41.137325+0000","last_became_active":"2023-11-27T22:29:39.654007+0000","last_became_peered":"2023-11-27T22:29:39.654007+0000","last_unstale":"2023-11-27T22:29:41.137325+0000","last_undegraded":"2023-11-27T22:29:41.137325+0000","last_fullsized":"2023-11-27T22:29:41.137325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637799+0000","last_change":"2023-11-27T22:29:39.648110+0000","last_active":"2023-11-27T22:29:40.637799+0000","last_peered":"2023-11-27T22:29:40.637799+0000","last_clean":"2023-11-27T22:29:40.637799+0000","last_became_active":"2023-11-27T22:29:39.647846+0000","last_became_peered":"2023-11-27T22:29:39.647846+0000","last_unstale":"2023-11-27T22:29:40.637799+0000","last_undegraded":"2023-11-27T22:29:40.637799+0000","last_fullsized":"2023-11-27T22:29:40.637799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137328+0000","last_change":"2023-11-27T22:29:39.649954+0000","last_active":"2023-11-27T22:29:41.137328+0000","last_peered":"2023-11-27T22:29:41.137328+0000","last_clean":"2023-11-27T22:29:41.137328+0000","last_became_active":"2023-11-27T22:29:39.649652+0000","last_became_peered":"2023-11-27T22:29:39.649652+0000","last_unstale":"2023-11-27T22:29:41.137328+0000","last_undegraded":"2023-11-27T22:29:41.137328+0000","last_fullsized":"2023-11-27T22:29:41.137328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637719+0000","last_change":"2023-11-27T22:29:39.649200+0000","last_active":"2023-11-27T22:29:40.637719+0000","last_peered":"2023-11-27T22:29:40.637719+0000","last_clean":"2023-11-27T22:29:40.637719+0000","last_became_active":"2023-11-27T22:29:39.648825+0000","last_became_peered":"2023-11-27T22:29:39.648825+0000","last_unstale":"2023-11-27T22:29:40.637719+0000","last_undegraded":"2023-11-27T22:29:40.637719+0000","last_fullsized":"2023-11-27T22:29:40.637719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637255+0000","last_change":"2023-11-27T22:29:39.654267+0000","last_active":"2023-11-27T22:29:40.637255+0000","last_peered":"2023-11-27T22:29:40.637255+0000","last_clean":"2023-11-27T22:29:40.637255+0000","last_became_active":"2023-11-27T22:29:39.654008+0000","last_became_peered":"2023-11-27T22:29:39.654008+0000","last_unstale":"2023-11-27T22:29:40.637255+0000","last_undegraded":"2023-11-27T22:29:40.637255+0000","last_fullsized":"2023-11-27T22:29:40.637255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638583+0000","last_change":"2023-11-27T22:29:39.647097+0000","last_active":"2023-11-27T22:29:40.638583+0000","last_peered":"2023-11-27T22:29:40.638583+0000","last_clean":"2023-11-27T22:29:40.638583+0000","last_became_active":"2023-11-27T22:29:39.646828+0000","last_became_peered":"2023-11-27T22:29:39.646828+0000","last_unstale":"2023-11-27T22:29:40.638583+0000","last_undegraded":"2023-11-27T22:29:40.638583+0000","last_fullsized":"2023-11-27T22:29:40.638583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637906+0000","last_change":"2023-11-27T22:29:39.653574+0000","last_active":"2023-11-27T22:29:40.637906+0000","last_peered":"2023-11-27T22:29:40.637906+0000","last_clean":"2023-11-27T22:29:40.637906+0000","last_became_active":"2023-11-27T22:29:39.653270+0000","last_became_peered":"2023-11-27T22:29:39.653270+0000","last_unstale":"2023-11-27T22:29:40.637906+0000","last_undegraded":"2023-11-27T22:29:40.637906+0000","last_fullsized":"2023-11-27T22:29:40.637906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136725+0000","last_change":"2023-11-27T22:29:39.648704+0000","last_active":"2023-11-27T22:29:41.136725+0000","last_peered":"2023-11-27T22:29:41.136725+0000","last_clean":"2023-11-27T22:29:41.136725+0000","last_became_active":"2023-11-27T22:29:39.648254+0000","last_became_peered":"2023-11-27T22:29:39.648254+0000","last_unstale":"2023-11-27T22:29:41.136725+0000","last_undegraded":"2023-11-27T22:29:41.136725+0000","last_fullsized":"2023-11-27T22:29:41.136725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137535+0000","last_change":"2023-11-27T22:29:39.648662+0000","last_active":"2023-11-27T22:29:41.137535+0000","last_peered":"2023-11-27T22:29:41.137535+0000","last_clean":"2023-11-27T22:29:41.137535+0000","last_became_active":"2023-11-27T22:29:39.647607+0000","last_became_peered":"2023-11-27T22:29:39.647607+0000","last_unstale":"2023-11-27T22:29:41.137535+0000","last_undegraded":"2023-11-27T22:29:41.137535+0000","last_fullsized":"2023-11-27T22:29:41.137535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765029+0000","last_change":"2023-11-27T22:29:39.646354+0000","last_active":"2023-11-27T22:29:40.765029+0000","last_peered":"2023-11-27T22:29:40.765029+0000","last_clean":"2023-11-27T22:29:40.765029+0000","last_became_active":"2023-11-27T22:29:39.646090+0000","last_became_peered":"2023-11-27T22:29:39.646090+0000","last_unstale":"2023-11-27T22:29:40.765029+0000","last_undegraded":"2023-11-27T22:29:40.765029+0000","last_fullsized":"2023-11-27T22:29:40.765029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636897+0000","last_change":"2023-11-27T22:29:39.649555+0000","last_active":"2023-11-27T22:29:40.636897+0000","last_peered":"2023-11-27T22:29:40.636897+0000","last_clean":"2023-11-27T22:29:40.636897+0000","last_became_active":"2023-11-27T22:29:39.649055+0000","last_became_peered":"2023-11-27T22:29:39.649055+0000","last_unstale":"2023-11-27T22:29:40.636897+0000","last_undegraded":"2023-11-27T22:29:40.636897+0000","last_fullsized":"2023-11-27T22:29:40.636897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137222+0000","last_change":"2023-11-27T22:29:39.651646+0000","last_active":"2023-11-27T22:29:41.137222+0000","last_peered":"2023-11-27T22:29:41.137222+0000","last_clean":"2023-11-27T22:29:41.137222+0000","last_became_active":"2023-11-27T22:29:39.651358+0000","last_became_peered":"2023-11-27T22:29:39.651358+0000","last_unstale":"2023-11-27T22:29:41.137222+0000","last_undegraded":"2023-11-27T22:29:41.137222+0000","last_fullsized":"2023-11-27T22:29:41.137222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637683+0000","last_change":"2023-11-27T22:29:38.663887+0000","last_active":"2023-11-27T22:29:40.637683+0000","last_peered":"2023-11-27T22:29:40.637683+0000","last_clean":"2023-11-27T22:29:40.637683+0000","last_became_active":"2023-11-27T22:29:38.662995+0000","last_became_peered":"2023-11-27T22:29:38.662995+0000","last_unstale":"2023-11-27T22:29:40.637683+0000","last_undegraded":"2023-11-27T22:29:40.637683+0000","last_fullsized":"2023-11-27T22:29:40.637683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136764+0000","last_change":"2023-11-27T22:29:39.644876+0000","last_active":"2023-11-27T22:29:41.136764+0000","last_peered":"2023-11-27T22:29:41.136764+0000","last_clean":"2023-11-27T22:29:41.136764+0000","last_became_active":"2023-11-27T22:29:39.644470+0000","last_became_peered":"2023-11-27T22:29:39.644470+0000","last_unstale":"2023-11-27T22:29:41.136764+0000","last_undegraded":"2023-11-27T22:29:41.136764+0000","last_fullsized":"2023-11-27T22:29:41.136764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636788+0000","last_change":"2023-11-27T22:29:38.659425+0000","last_active":"2023-11-27T22:29:40.636788+0000","last_peered":"2023-11-27T22:29:40.636788+0000","last_clean":"2023-11-27T22:29:40.636788+0000","last_became_active":"2023-11-27T22:29:38.659091+0000","last_became_peered":"2023-11-27T22:29:38.659091+0000","last_unstale":"2023-11-27T22:29:40.636788+0000","last_undegraded":"2023-11-27T22:29:40.636788+0000","last_fullsized":"2023-11-27T22:29:40.636788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637460+0000","last_change":"2023-11-27T22:29:38.658068+0000","last_active":"2023-11-27T22:29:40.637460+0000","last_peered":"2023-11-27T22:29:40.637460+0000","last_clean":"2023-11-27T22:29:40.637460+0000","last_became_active":"2023-11-27T22:29:38.657688+0000","last_became_peered":"2023-11-27T22:29:38.657688+0000","last_unstale":"2023-11-27T22:29:40.637460+0000","last_undegraded":"2023-11-27T22:29:40.637460+0000","last_fullsized":"2023-11-27T22:29:40.637460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637464+0000","last_change":"2023-11-27T22:29:39.651687+0000","last_active":"2023-11-27T22:29:40.637464+0000","last_peered":"2023-11-27T22:29:40.637464+0000","last_clean":"2023-11-27T22:29:40.637464+0000","last_became_active":"2023-11-27T22:29:39.651383+0000","last_became_peered":"2023-11-27T22:29:39.651383+0000","last_unstale":"2023-11-27T22:29:40.637464+0000","last_undegraded":"2023-11-27T22:29:40.637464+0000","last_fullsized":"2023-11-27T22:29:40.637464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977074+0000","last_change":"2023-11-27T22:29:38.656782+0000","last_active":"2023-11-27T22:29:40.977074+0000","last_peered":"2023-11-27T22:29:40.977074+0000","last_clean":"2023-11-27T22:29:40.977074+0000","last_became_active":"2023-11-27T22:29:38.656527+0000","last_became_peered":"2023-11-27T22:29:38.656527+0000","last_unstale":"2023-11-27T22:29:40.977074+0000","last_undegraded":"2023-11-27T22:29:40.977074+0000","last_fullsized":"2023-11-27T22:29:40.977074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638394+0000","last_change":"2023-11-27T22:29:39.646862+0000","last_active":"2023-11-27T22:29:40.638394+0000","last_peered":"2023-11-27T22:29:40.638394+0000","last_clean":"2023-11-27T22:29:40.638394+0000","last_became_active":"2023-11-27T22:29:39.644502+0000","last_became_peered":"2023-11-27T22:29:39.644502+0000","last_unstale":"2023-11-27T22:29:40.638394+0000","last_undegraded":"2023-11-27T22:29:40.638394+0000","last_fullsized":"2023-11-27T22:29:40.638394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636966+0000","last_change":"2023-11-27T22:29:38.656824+0000","last_active":"2023-11-27T22:29:40.636966+0000","last_peered":"2023-11-27T22:29:40.636966+0000","last_clean":"2023-11-27T22:29:40.636966+0000","last_became_active":"2023-11-27T22:29:38.656542+0000","last_became_peered":"2023-11-27T22:29:38.656542+0000","last_unstale":"2023-11-27T22:29:40.636966+0000","last_undegraded":"2023-11-27T22:29:40.636966+0000","last_fullsized":"2023-11-27T22:29:40.636966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137958+0000","last_change":"2023-11-27T22:29:39.656332+0000","last_active":"2023-11-27T22:29:41.137958+0000","last_peered":"2023-11-27T22:29:41.137958+0000","last_clean":"2023-11-27T22:29:41.137958+0000","last_became_active":"2023-11-27T22:29:39.654860+0000","last_became_peered":"2023-11-27T22:29:39.654860+0000","last_unstale":"2023-11-27T22:29:41.137958+0000","last_undegraded":"2023-11-27T22:29:41.137958+0000","last_fullsized":"2023-11-27T22:29:41.137958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:18:12.958698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977350+0000","last_change":"2023-11-27T22:29:38.661962+0000","last_active":"2023-11-27T22:29:40.977350+0000","last_peered":"2023-11-27T22:29:40.977350+0000","last_clean":"2023-11-27T22:29:40.977350+0000","last_became_active":"2023-11-27T22:29:38.661221+0000","last_became_peered":"2023-11-27T22:29:38.661221+0000","last_unstale":"2023-11-27T22:29:40.977350+0000","last_undegraded":"2023-11-27T22:29:40.977350+0000","last_fullsized":"2023-11-27T22:29:40.977350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:02.332894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136729+0000","last_change":"2023-11-27T22:29:39.644743+0000","last_active":"2023-11-27T22:29:41.136729+0000","last_peered":"2023-11-27T22:29:41.136729+0000","last_clean":"2023-11-27T22:29:41.136729+0000","last_became_active":"2023-11-27T22:29:39.644482+0000","last_became_peered":"2023-11-27T22:29:39.644482+0000","last_unstale":"2023-11-27T22:29:41.136729+0000","last_undegraded":"2023-11-27T22:29:41.136729+0000","last_fullsized":"2023-11-27T22:29:41.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638586+0000","last_change":"2023-11-27T22:29:38.657621+0000","last_active":"2023-11-27T22:29:40.638586+0000","last_peered":"2023-11-27T22:29:40.638586+0000","last_clean":"2023-11-27T22:29:40.638586+0000","last_became_active":"2023-11-27T22:29:38.657362+0000","last_became_peered":"2023-11-27T22:29:38.657362+0000","last_unstale":"2023-11-27T22:29:40.638586+0000","last_undegraded":"2023-11-27T22:29:40.638586+0000","last_fullsized":"2023-11-27T22:29:40.638586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138066+0000","last_change":"2023-11-27T22:29:39.654893+0000","last_active":"2023-11-27T22:29:41.138066+0000","last_peered":"2023-11-27T22:29:41.138066+0000","last_clean":"2023-11-27T22:29:41.138066+0000","last_became_active":"2023-11-27T22:29:39.654615+0000","last_became_peered":"2023-11-27T22:29:39.654615+0000","last_unstale":"2023-11-27T22:29:41.138066+0000","last_undegraded":"2023-11-27T22:29:41.138066+0000","last_fullsized":"2023-11-27T22:29:41.138066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:48.631646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637012+0000","last_change":"2023-11-27T22:29:38.659143+0000","last_active":"2023-11-27T22:29:40.637012+0000","last_peered":"2023-11-27T22:29:40.637012+0000","last_clean":"2023-11-27T22:29:40.637012+0000","last_became_active":"2023-11-27T22:29:38.658790+0000","last_became_peered":"2023-11-27T22:29:38.658790+0000","last_unstale":"2023-11-27T22:29:40.637012+0000","last_undegraded":"2023-11-27T22:29:40.637012+0000","last_fullsized":"2023-11-27T22:29:40.637012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138090+0000","last_change":"2023-11-27T22:29:39.654060+0000","last_active":"2023-11-27T22:29:41.138090+0000","last_peered":"2023-11-27T22:29:41.138090+0000","last_clean":"2023-11-27T22:29:41.138090+0000","last_became_active":"2023-11-27T22:29:39.653483+0000","last_became_peered":"2023-11-27T22:29:39.653483+0000","last_unstale":"2023-11-27T22:29:41.138090+0000","last_undegraded":"2023-11-27T22:29:41.138090+0000","last_fullsized":"2023-11-27T22:29:41.138090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978456+0000","last_change":"2023-11-27T22:29:38.660084+0000","last_active":"2023-11-27T22:29:40.978456+0000","last_peered":"2023-11-27T22:29:40.978456+0000","last_clean":"2023-11-27T22:29:40.978456+0000","last_became_active":"2023-11-27T22:29:38.659648+0000","last_became_peered":"2023-11-27T22:29:38.659648+0000","last_unstale":"2023-11-27T22:29:40.978456+0000","last_undegraded":"2023-11-27T22:29:40.978456+0000","last_fullsized":"2023-11-27T22:29:40.978456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136488+0000","last_change":"2023-11-27T22:29:39.654365+0000","last_active":"2023-11-27T22:29:41.136488+0000","last_peered":"2023-11-27T22:29:41.136488+0000","last_clean":"2023-11-27T22:29:41.136488+0000","last_became_active":"2023-11-27T22:29:39.654080+0000","last_became_peered":"2023-11-27T22:29:39.654080+0000","last_unstale":"2023-11-27T22:29:41.136488+0000","last_undegraded":"2023-11-27T22:29:41.136488+0000","last_fullsized":"2023-11-27T22:29:41.136488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977168+0000","last_change":"2023-11-27T22:29:38.661785+0000","last_active":"2023-11-27T22:29:40.977168+0000","last_peered":"2023-11-27T22:29:40.977168+0000","last_clean":"2023-11-27T22:29:40.977168+0000","last_became_active":"2023-11-27T22:29:38.661129+0000","last_became_peered":"2023-11-27T22:29:38.661129+0000","last_unstale":"2023-11-27T22:29:40.977168+0000","last_undegraded":"2023-11-27T22:29:40.977168+0000","last_fullsized":"2023-11-27T22:29:40.977168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138435+0000","last_change":"2023-11-27T22:29:39.654846+0000","last_active":"2023-11-27T22:29:41.138435+0000","last_peered":"2023-11-27T22:29:41.138435+0000","last_clean":"2023-11-27T22:29:41.138435+0000","last_became_active":"2023-11-27T22:29:39.654042+0000","last_became_peered":"2023-11-27T22:29:39.654042+0000","last_unstale":"2023-11-27T22:29:41.138435+0000","last_undegraded":"2023-11-27T22:29:41.138435+0000","last_fullsized":"2023-11-27T22:29:41.138435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:16:15.899536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636721+0000","last_change":"2023-11-27T22:29:38.658756+0000","last_active":"2023-11-27T22:29:40.636721+0000","last_peered":"2023-11-27T22:29:40.636721+0000","last_clean":"2023-11-27T22:29:40.636721+0000","last_became_active":"2023-11-27T22:29:38.658475+0000","last_became_peered":"2023-11-27T22:29:38.658475+0000","last_unstale":"2023-11-27T22:29:40.636721+0000","last_undegraded":"2023-11-27T22:29:40.636721+0000","last_fullsized":"2023-11-27T22:29:40.636721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636767+0000","last_change":"2023-11-27T22:29:39.649309+0000","last_active":"2023-11-27T22:29:40.636767+0000","last_peered":"2023-11-27T22:29:40.636767+0000","last_clean":"2023-11-27T22:29:40.636767+0000","last_became_active":"2023-11-27T22:29:39.648695+0000","last_became_peered":"2023-11-27T22:29:39.648695+0000","last_unstale":"2023-11-27T22:29:40.636767+0000","last_undegraded":"2023-11-27T22:29:40.636767+0000","last_fullsized":"2023-11-27T22:29:40.636767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.764988+0000","last_change":"2023-11-27T22:29:38.654789+0000","last_active":"2023-11-27T22:29:40.764988+0000","last_peered":"2023-11-27T22:29:40.764988+0000","last_clean":"2023-11-27T22:29:40.764988+0000","last_became_active":"2023-11-27T22:29:38.654453+0000","last_became_peered":"2023-11-27T22:29:38.654453+0000","last_unstale":"2023-11-27T22:29:40.764988+0000","last_undegraded":"2023-11-27T22:29:40.764988+0000","last_fullsized":"2023-11-27T22:29:40.764988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:58.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137369+0000","last_change":"2023-11-27T22:29:39.654661+0000","last_active":"2023-11-27T22:29:41.137369+0000","last_peered":"2023-11-27T22:29:41.137369+0000","last_clean":"2023-11-27T22:29:41.137369+0000","last_became_active":"2023-11-27T22:29:39.654269+0000","last_became_peered":"2023-11-27T22:29:39.654269+0000","last_unstale":"2023-11-27T22:29:41.137369+0000","last_undegraded":"2023-11-27T22:29:41.137369+0000","last_fullsized":"2023-11-27T22:29:41.137369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978729+0000","last_change":"2023-11-27T22:29:38.658036+0000","last_active":"2023-11-27T22:29:40.978729+0000","last_peered":"2023-11-27T22:29:40.978729+0000","last_clean":"2023-11-27T22:29:40.978729+0000","last_became_active":"2023-11-27T22:29:38.657748+0000","last_became_peered":"2023-11-27T22:29:38.657748+0000","last_unstale":"2023-11-27T22:29:40.978729+0000","last_undegraded":"2023-11-27T22:29:40.978729+0000","last_fullsized":"2023-11-27T22:29:40.978729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:26.492362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137888+0000","last_change":"2023-11-27T22:29:39.659240+0000","last_active":"2023-11-27T22:29:41.137888+0000","last_peered":"2023-11-27T22:29:41.137888+0000","last_clean":"2023-11-27T22:29:41.137888+0000","last_became_active":"2023-11-27T22:29:39.658986+0000","last_became_peered":"2023-11-27T22:29:39.658986+0000","last_unstale":"2023-11-27T22:29:41.137888+0000","last_undegraded":"2023-11-27T22:29:41.137888+0000","last_fullsized":"2023-11-27T22:29:41.137888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:18:12.958698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765118+0000","last_change":"2023-11-27T22:29:38.660926+0000","last_active":"2023-11-27T22:29:40.765118+0000","last_peered":"2023-11-27T22:29:40.765118+0000","last_clean":"2023-11-27T22:29:40.765118+0000","last_became_active":"2023-11-27T22:29:38.660662+0000","last_became_peered":"2023-11-27T22:29:38.660662+0000","last_unstale":"2023-11-27T22:29:40.765118+0000","last_undegraded":"2023-11-27T22:29:40.765118+0000","last_fullsized":"2023-11-27T22:29:40.765118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:41.693347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138504+0000","last_change":"2023-11-27T22:29:39.659397+0000","last_active":"2023-11-27T22:29:41.138504+0000","last_peered":"2023-11-27T22:29:41.138504+0000","last_clean":"2023-11-27T22:29:41.138504+0000","last_became_active":"2023-11-27T22:29:39.658970+0000","last_became_peered":"2023-11-27T22:29:39.658970+0000","last_unstale":"2023-11-27T22:29:41.138504+0000","last_undegraded":"2023-11-27T22:29:41.138504+0000","last_fullsized":"2023-11-27T22:29:41.138504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:08.383015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638663+0000","last_change":"2023-11-27T22:29:38.654389+0000","last_active":"2023-11-27T22:29:40.638663+0000","last_peered":"2023-11-27T22:29:40.638663+0000","last_clean":"2023-11-27T22:29:40.638663+0000","last_became_active":"2023-11-27T22:29:38.654116+0000","last_became_peered":"2023-11-27T22:29:38.654116+0000","last_unstale":"2023-11-27T22:29:40.638663+0000","last_undegraded":"2023-11-27T22:29:40.638663+0000","last_fullsized":"2023-11-27T22:29:40.638663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138396+0000","last_change":"2023-11-27T22:29:39.649308+0000","last_active":"2023-11-27T22:29:41.138396+0000","last_peered":"2023-11-27T22:29:41.138396+0000","last_clean":"2023-11-27T22:29:41.138396+0000","last_became_active":"2023-11-27T22:29:39.648915+0000","last_became_peered":"2023-11-27T22:29:39.648915+0000","last_unstale":"2023-11-27T22:29:41.138396+0000","last_undegraded":"2023-11-27T22:29:41.138396+0000","last_fullsized":"2023-11-27T22:29:41.138396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:50.558601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765138+0000","last_change":"2023-11-27T22:29:38.661956+0000","last_active":"2023-11-27T22:29:40.765138+0000","last_peered":"2023-11-27T22:29:40.765138+0000","last_clean":"2023-11-27T22:29:40.765138+0000","last_became_active":"2023-11-27T22:29:38.661660+0000","last_became_peered":"2023-11-27T22:29:38.661660+0000","last_unstale":"2023-11-27T22:29:40.765138+0000","last_undegraded":"2023-11-27T22:29:40.765138+0000","last_fullsized":"2023-11-27T22:29:40.765138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:51.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138343+0000","last_change":"2023-11-27T22:29:39.655710+0000","last_active":"2023-11-27T22:29:41.138343+0000","last_peered":"2023-11-27T22:29:41.138343+0000","last_clean":"2023-11-27T22:29:41.138343+0000","last_became_active":"2023-11-27T22:29:39.654385+0000","last_became_peered":"2023-11-27T22:29:39.654385+0000","last_unstale":"2023-11-27T22:29:41.138343+0000","last_undegraded":"2023-11-27T22:29:41.138343+0000","last_fullsized":"2023-11-27T22:29:41.138343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:27.041102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.642415+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:39.642415+0000","last_peered":"2023-11-27T22:29:39.642415+0000","last_clean":"2023-11-27T22:29:39.642415+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:39.642415+0000","last_undegraded":"2023-11-27T22:29:39.642415+0000","last_fullsized":"2023-11-27T22:29:39.642415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977220+0000","last_change":"2023-11-27T22:29:38.656156+0000","last_active":"2023-11-27T22:29:40.977220+0000","last_peered":"2023-11-27T22:29:40.977220+0000","last_clean":"2023-11-27T22:29:40.977220+0000","last_became_active":"2023-11-27T22:29:38.655859+0000","last_became_peered":"2023-11-27T22:29:38.655859+0000","last_unstale":"2023-11-27T22:29:40.977220+0000","last_undegraded":"2023-11-27T22:29:40.977220+0000","last_fullsized":"2023-11-27T22:29:40.977220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637872+0000","last_change":"2023-11-27T22:29:39.653299+0000","last_active":"2023-11-27T22:29:40.637872+0000","last_peered":"2023-11-27T22:29:40.637872+0000","last_clean":"2023-11-27T22:29:40.637872+0000","last_became_active":"2023-11-27T22:29:39.653033+0000","last_became_peered":"2023-11-27T22:29:39.653033+0000","last_unstale":"2023-11-27T22:29:40.637872+0000","last_undegraded":"2023-11-27T22:29:40.637872+0000","last_fullsized":"2023-11-27T22:29:40.637872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977854+0000","last_change":"2023-11-27T22:29:38.664007+0000","last_active":"2023-11-27T22:29:40.977854+0000","last_peered":"2023-11-27T22:29:40.977854+0000","last_clean":"2023-11-27T22:29:40.977854+0000","last_became_active":"2023-11-27T22:29:38.663462+0000","last_became_peered":"2023-11-27T22:29:38.663462+0000","last_unstale":"2023-11-27T22:29:40.977854+0000","last_undegraded":"2023-11-27T22:29:40.977854+0000","last_fullsized":"2023-11-27T22:29:40.977854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136397+0000","last_change":"2023-11-27T22:29:39.646086+0000","last_active":"2023-11-27T22:29:41.136397+0000","last_peered":"2023-11-27T22:29:41.136397+0000","last_clean":"2023-11-27T22:29:41.136397+0000","last_became_active":"2023-11-27T22:29:39.645812+0000","last_became_peered":"2023-11-27T22:29:39.645812+0000","last_unstale":"2023-11-27T22:29:41.136397+0000","last_undegraded":"2023-11-27T22:29:41.136397+0000","last_fullsized":"2023-11-27T22:29:41.136397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765072+0000","last_change":"2023-11-27T22:29:38.660283+0000","last_active":"2023-11-27T22:29:40.765072+0000","last_peered":"2023-11-27T22:29:40.765072+0000","last_clean":"2023-11-27T22:29:40.765072+0000","last_became_active":"2023-11-27T22:29:38.658807+0000","last_became_peered":"2023-11-27T22:29:38.658807+0000","last_unstale":"2023-11-27T22:29:40.765072+0000","last_undegraded":"2023-11-27T22:29:40.765072+0000","last_fullsized":"2023-11-27T22:29:40.765072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638421+0000","last_change":"2023-11-27T22:29:39.644925+0000","last_active":"2023-11-27T22:29:40.638421+0000","last_peered":"2023-11-27T22:29:40.638421+0000","last_clean":"2023-11-27T22:29:40.638421+0000","last_became_active":"2023-11-27T22:29:39.644678+0000","last_became_peered":"2023-11-27T22:29:39.644678+0000","last_unstale":"2023-11-27T22:29:40.638421+0000","last_undegraded":"2023-11-27T22:29:40.638421+0000","last_fullsized":"2023-11-27T22:29:40.638421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977189+0000","last_change":"2023-11-27T22:29:38.662139+0000","last_active":"2023-11-27T22:29:40.977189+0000","last_peered":"2023-11-27T22:29:40.977189+0000","last_clean":"2023-11-27T22:29:40.977189+0000","last_became_active":"2023-11-27T22:29:38.661432+0000","last_became_peered":"2023-11-27T22:29:38.661432+0000","last_unstale":"2023-11-27T22:29:40.977189+0000","last_undegraded":"2023-11-27T22:29:40.977189+0000","last_fullsized":"2023-11-27T22:29:40.977189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137794+0000","last_change":"2023-11-27T22:29:39.651435+0000","last_active":"2023-11-27T22:29:41.137794+0000","last_peered":"2023-11-27T22:29:41.137794+0000","last_clean":"2023-11-27T22:29:41.137794+0000","last_became_active":"2023-11-27T22:29:39.651172+0000","last_became_peered":"2023-11-27T22:29:39.651172+0000","last_unstale":"2023-11-27T22:29:41.137794+0000","last_undegraded":"2023-11-27T22:29:41.137794+0000","last_fullsized":"2023-11-27T22:29:41.137794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638530+0000","last_change":"2023-11-27T22:29:38.653717+0000","last_active":"2023-11-27T22:29:40.638530+0000","last_peered":"2023-11-27T22:29:40.638530+0000","last_clean":"2023-11-27T22:29:40.638530+0000","last_became_active":"2023-11-27T22:29:38.653432+0000","last_became_peered":"2023-11-27T22:29:38.653432+0000","last_unstale":"2023-11-27T22:29:40.638530+0000","last_undegraded":"2023-11-27T22:29:40.638530+0000","last_fullsized":"2023-11-27T22:29:40.638530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:07.717011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137515+0000","last_change":"2023-11-27T22:29:39.650521+0000","last_active":"2023-11-27T22:29:41.137515+0000","last_peered":"2023-11-27T22:29:41.137515+0000","last_clean":"2023-11-27T22:29:41.137515+0000","last_became_active":"2023-11-27T22:29:39.650292+0000","last_became_peered":"2023-11-27T22:29:39.650292+0000","last_unstale":"2023-11-27T22:29:41.137515+0000","last_undegraded":"2023-11-27T22:29:41.137515+0000","last_fullsized":"2023-11-27T22:29:41.137515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978023+0000","last_change":"2023-11-27T22:29:38.664144+0000","last_active":"2023-11-27T22:29:40.978023+0000","last_peered":"2023-11-27T22:29:40.978023+0000","last_clean":"2023-11-27T22:29:40.978023+0000","last_became_active":"2023-11-27T22:29:38.663854+0000","last_became_peered":"2023-11-27T22:29:38.663854+0000","last_unstale":"2023-11-27T22:29:40.978023+0000","last_undegraded":"2023-11-27T22:29:40.978023+0000","last_fullsized":"2023-11-27T22:29:40.978023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638533+0000","last_change":"2023-11-27T22:29:39.645029+0000","last_active":"2023-11-27T22:29:40.638533+0000","last_peered":"2023-11-27T22:29:40.638533+0000","last_clean":"2023-11-27T22:29:40.638533+0000","last_became_active":"2023-11-27T22:29:39.644767+0000","last_became_peered":"2023-11-27T22:29:39.644767+0000","last_unstale":"2023-11-27T22:29:40.638533+0000","last_undegraded":"2023-11-27T22:29:40.638533+0000","last_fullsized":"2023-11-27T22:29:40.638533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977545+0000","last_change":"2023-11-27T22:29:38.655124+0000","last_active":"2023-11-27T22:29:40.977545+0000","last_peered":"2023-11-27T22:29:40.977545+0000","last_clean":"2023-11-27T22:29:40.977545+0000","last_became_active":"2023-11-27T22:29:38.654557+0000","last_became_peered":"2023-11-27T22:29:38.654557+0000","last_unstale":"2023-11-27T22:29:40.977545+0000","last_undegraded":"2023-11-27T22:29:40.977545+0000","last_fullsized":"2023-11-27T22:29:40.977545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637851+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:40.637851+0000","last_peered":"2023-11-27T22:29:40.637851+0000","last_clean":"2023-11-27T22:29:40.637851+0000","last_became_active":"2023-11-27T22:29:39.654060+0000","last_became_peered":"2023-11-27T22:29:39.654060+0000","last_unstale":"2023-11-27T22:29:40.637851+0000","last_undegraded":"2023-11-27T22:29:40.637851+0000","last_fullsized":"2023-11-27T22:29:40.637851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637133+0000","last_change":"2023-11-27T22:29:38.662202+0000","last_active":"2023-11-27T22:29:40.637133+0000","last_peered":"2023-11-27T22:29:40.637133+0000","last_clean":"2023-11-27T22:29:40.637133+0000","last_became_active":"2023-11-27T22:29:38.661712+0000","last_became_peered":"2023-11-27T22:29:38.661712+0000","last_unstale":"2023-11-27T22:29:40.637133+0000","last_undegraded":"2023-11-27T22:29:40.637133+0000","last_fullsized":"2023-11-27T22:29:40.637133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136678+0000","last_change":"2023-11-27T22:29:39.643007+0000","last_active":"2023-11-27T22:29:41.136678+0000","last_peered":"2023-11-27T22:29:41.136678+0000","last_clean":"2023-11-27T22:29:41.136678+0000","last_became_active":"2023-11-27T22:29:39.642647+0000","last_became_peered":"2023-11-27T22:29:39.642647+0000","last_unstale":"2023-11-27T22:29:41.136678+0000","last_undegraded":"2023-11-27T22:29:41.136678+0000","last_fullsized":"2023-11-27T22:29:41.136678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977837+0000","last_change":"2023-11-27T22:29:38.664234+0000","last_active":"2023-11-27T22:29:40.977837+0000","last_peered":"2023-11-27T22:29:40.977837+0000","last_clean":"2023-11-27T22:29:40.977837+0000","last_became_active":"2023-11-27T22:29:38.663863+0000","last_became_peered":"2023-11-27T22:29:38.663863+0000","last_unstale":"2023-11-27T22:29:40.977837+0000","last_undegraded":"2023-11-27T22:29:40.977837+0000","last_fullsized":"2023-11-27T22:29:40.977837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137919+0000","last_change":"2023-11-27T22:29:39.644164+0000","last_active":"2023-11-27T22:29:41.137919+0000","last_peered":"2023-11-27T22:29:41.137919+0000","last_clean":"2023-11-27T22:29:41.137919+0000","last_became_active":"2023-11-27T22:29:39.643326+0000","last_became_peered":"2023-11-27T22:29:39.643326+0000","last_unstale":"2023-11-27T22:29:41.137919+0000","last_undegraded":"2023-11-27T22:29:41.137919+0000","last_fullsized":"2023-11-27T22:29:41.137919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638480+0000","last_change":"2023-11-27T22:29:38.659399+0000","last_active":"2023-11-27T22:29:40.638480+0000","last_peered":"2023-11-27T22:29:40.638480+0000","last_clean":"2023-11-27T22:29:40.638480+0000","last_became_active":"2023-11-27T22:29:38.659105+0000","last_became_peered":"2023-11-27T22:29:38.659105+0000","last_unstale":"2023-11-27T22:29:40.638480+0000","last_undegraded":"2023-11-27T22:29:40.638480+0000","last_fullsized":"2023-11-27T22:29:40.638480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637606+0000","last_change":"2023-11-27T22:29:39.646130+0000","last_active":"2023-11-27T22:29:40.637606+0000","last_peered":"2023-11-27T22:29:40.637606+0000","last_clean":"2023-11-27T22:29:40.637606+0000","last_became_active":"2023-11-27T22:29:39.645883+0000","last_became_peered":"2023-11-27T22:29:39.645883+0000","last_unstale":"2023-11-27T22:29:40.637606+0000","last_undegraded":"2023-11-27T22:29:40.637606+0000","last_fullsized":"2023-11-27T22:29:40.637606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638459+0000","last_change":"2023-11-27T22:29:38.660518+0000","last_active":"2023-11-27T22:29:40.638459+0000","last_peered":"2023-11-27T22:29:40.638459+0000","last_clean":"2023-11-27T22:29:40.638459+0000","last_became_active":"2023-11-27T22:29:38.660266+0000","last_became_peered":"2023-11-27T22:29:38.660266+0000","last_unstale":"2023-11-27T22:29:40.638459+0000","last_undegraded":"2023-11-27T22:29:40.638459+0000","last_fullsized":"2023-11-27T22:29:40.638459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637857+0000","last_change":"2023-11-27T22:29:39.651820+0000","last_active":"2023-11-27T22:29:40.637857+0000","last_peered":"2023-11-27T22:29:40.637857+0000","last_clean":"2023-11-27T22:29:40.637857+0000","last_became_active":"2023-11-27T22:29:39.651526+0000","last_became_peered":"2023-11-27T22:29:39.651526+0000","last_unstale":"2023-11-27T22:29:40.637857+0000","last_undegraded":"2023-11-27T22:29:40.637857+0000","last_fullsized":"2023-11-27T22:29:40.637857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977936+0000","last_change":"2023-11-27T22:29:38.665243+0000","last_active":"2023-11-27T22:29:40.977936+0000","last_peered":"2023-11-27T22:29:40.977936+0000","last_clean":"2023-11-27T22:29:40.977936+0000","last_became_active":"2023-11-27T22:29:38.664972+0000","last_became_peered":"2023-11-27T22:29:38.664972+0000","last_unstale":"2023-11-27T22:29:40.977936+0000","last_undegraded":"2023-11-27T22:29:40.977936+0000","last_fullsized":"2023-11-27T22:29:40.977936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636882+0000","last_change":"2023-11-27T22:29:39.645449+0000","last_active":"2023-11-27T22:29:40.636882+0000","last_peered":"2023-11-27T22:29:40.636882+0000","last_clean":"2023-11-27T22:29:40.636882+0000","last_became_active":"2023-11-27T22:29:39.645168+0000","last_became_peered":"2023-11-27T22:29:39.645168+0000","last_unstale":"2023-11-27T22:29:40.636882+0000","last_undegraded":"2023-11-27T22:29:40.636882+0000","last_fullsized":"2023-11-27T22:29:40.636882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137381+0000","last_change":"2023-11-27T22:29:39.646245+0000","last_active":"2023-11-27T22:29:41.137381+0000","last_peered":"2023-11-27T22:29:41.137381+0000","last_clean":"2023-11-27T22:29:41.137381+0000","last_became_active":"2023-11-27T22:29:39.645965+0000","last_became_peered":"2023-11-27T22:29:39.645965+0000","last_unstale":"2023-11-27T22:29:41.137381+0000","last_undegraded":"2023-11-27T22:29:41.137381+0000","last_fullsized":"2023-11-27T22:29:41.137381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977950+0000","last_change":"2023-11-27T22:29:38.663026+0000","last_active":"2023-11-27T22:29:40.977950+0000","last_peered":"2023-11-27T22:29:40.977950+0000","last_clean":"2023-11-27T22:29:40.977950+0000","last_became_active":"2023-11-27T22:29:38.662621+0000","last_became_peered":"2023-11-27T22:29:38.662621+0000","last_unstale":"2023-11-27T22:29:40.977950+0000","last_undegraded":"2023-11-27T22:29:40.977950+0000","last_fullsized":"2023-11-27T22:29:40.977950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138386+0000","last_change":"2023-11-27T22:29:39.646947+0000","last_active":"2023-11-27T22:29:41.138386+0000","last_peered":"2023-11-27T22:29:41.138386+0000","last_clean":"2023-11-27T22:29:41.138386+0000","last_became_active":"2023-11-27T22:29:39.646670+0000","last_became_peered":"2023-11-27T22:29:39.646670+0000","last_unstale":"2023-11-27T22:29:41.138386+0000","last_undegraded":"2023-11-27T22:29:41.138386+0000","last_fullsized":"2023-11-27T22:29:41.138386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:27.041102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977999+0000","last_change":"2023-11-27T22:29:38.667974+0000","last_active":"2023-11-27T22:29:40.977999+0000","last_peered":"2023-11-27T22:29:40.977999+0000","last_clean":"2023-11-27T22:29:40.977999+0000","last_became_active":"2023-11-27T22:29:38.667716+0000","last_became_peered":"2023-11-27T22:29:38.667716+0000","last_unstale":"2023-11-27T22:29:40.977999+0000","last_undegraded":"2023-11-27T22:29:40.977999+0000","last_fullsized":"2023-11-27T22:29:40.977999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136640+0000","last_change":"2023-11-27T22:29:39.648535+0000","last_active":"2023-11-27T22:29:41.136640+0000","last_peered":"2023-11-27T22:29:41.136640+0000","last_clean":"2023-11-27T22:29:41.136640+0000","last_became_active":"2023-11-27T22:29:39.648270+0000","last_became_peered":"2023-11-27T22:29:39.648270+0000","last_unstale":"2023-11-27T22:29:41.136640+0000","last_undegraded":"2023-11-27T22:29:41.136640+0000","last_fullsized":"2023-11-27T22:29:41.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637713+0000","last_change":"2023-11-27T22:29:38.663189+0000","last_active":"2023-11-27T22:29:40.637713+0000","last_peered":"2023-11-27T22:29:40.637713+0000","last_clean":"2023-11-27T22:29:40.637713+0000","last_became_active":"2023-11-27T22:29:38.662886+0000","last_became_peered":"2023-11-27T22:29:38.662886+0000","last_unstale":"2023-11-27T22:29:40.637713+0000","last_undegraded":"2023-11-27T22:29:40.637713+0000","last_fullsized":"2023-11-27T22:29:40.637713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637686+0000","last_change":"2023-11-27T22:29:39.656710+0000","last_active":"2023-11-27T22:29:40.637686+0000","last_peered":"2023-11-27T22:29:40.637686+0000","last_clean":"2023-11-27T22:29:40.637686+0000","last_became_active":"2023-11-27T22:29:39.656469+0000","last_became_peered":"2023-11-27T22:29:39.656469+0000","last_unstale":"2023-11-27T22:29:40.637686+0000","last_undegraded":"2023-11-27T22:29:40.637686+0000","last_fullsized":"2023-11-27T22:29:40.637686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978528+0000","last_change":"2023-11-27T22:29:38.661665+0000","last_active":"2023-11-27T22:29:40.978528+0000","last_peered":"2023-11-27T22:29:40.978528+0000","last_clean":"2023-11-27T22:29:40.978528+0000","last_became_active":"2023-11-27T22:29:38.661369+0000","last_became_peered":"2023-11-27T22:29:38.661369+0000","last_unstale":"2023-11-27T22:29:40.978528+0000","last_undegraded":"2023-11-27T22:29:40.978528+0000","last_fullsized":"2023-11-27T22:29:40.978528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:55.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:29:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.281+0000 7fe35a496640 1 Processor -- start 2023-11-27T22:29:55.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.281+0000 7fe35a496640 1 -- start start 2023-11-27T22:29:55.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe35a496640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe354143490 0x7fe3540b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe35a496640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415e730 0x7fe3540b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe35a496640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe35415a4e0 0x7fe35415a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe35a496640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35415b520 con 0x7fe354143490 2023-11-27T22:29:55.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe35a496640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe354143870 con 0x7fe35415a4e0 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe35a496640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35415e2a0 con 0x7fe35415e730 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe354143490 0x7fe3540b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe354143490 0x7fe3540b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53502/0 (socket says 172.21.15.154:53502) 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 -- 172.21.15.154:0/2300843730 learned_addr learned my addr 172.21.15.154:0/2300843730 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe3537fe640 1 --2- 172.21.15.154:0/2300843730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415e730 0x7fe3540b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe358a33640 1 --2- 172.21.15.154:0/2300843730 >> v2:172.21.15.194:3300/0 conn(0x7fe35415a4e0 0x7fe35415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 -- 172.21.15.154:0/2300843730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415e730 msgr2=0x7fe3540b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 --2- 172.21.15.154:0/2300843730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415e730 0x7fe3540b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 -- 172.21.15.154:0/2300843730 >> v2:172.21.15.194:3300/0 conn(0x7fe35415a4e0 msgr2=0x7fe35415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 --2- 172.21.15.154:0/2300843730 >> v2:172.21.15.194:3300/0 conn(0x7fe35415a4e0 0x7fe35415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe353fff640 1 -- 172.21.15.154:0/2300843730 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35415b240 con 0x7fe354143490 2023-11-27T22:29:55.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.282+0000 7fe358a33640 1 --2- 172.21.15.154:0/2300843730 >> v2:172.21.15.194:3300/0 conn(0x7fe35415a4e0 0x7fe35415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.283+0000 7fe353fff640 1 --2- 172.21.15.154:0/2300843730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b0cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe35415eb90 tx=0x7fe34402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99887c4d39117cb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.283+0000 7fe352ffd640 1 -- 172.21.15.154:0/2300843730 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344031870 con 0x7fe354143490 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.283+0000 7fe352ffd640 1 -- 172.21.15.154:0/2300843730 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440319d0 con 0x7fe354143490 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.283+0000 7fe352ffd640 1 -- 172.21.15.154:0/2300843730 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344031d60 con 0x7fe354143490 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 -- 172.21.15.154:0/2300843730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 msgr2=0x7fe3540b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 --2- 172.21.15.154:0/2300843730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b0cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe35415eb90 tx=0x7fe34402b910 comp rx=0 tx=0).stop 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 -- 172.21.15.154:0/2300843730 shutdown_connections 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 --2- 172.21.15.154:0/2300843730 >> v2:172.21.15.194:3300/0 conn(0x7fe35415a4e0 0x7fe35415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 --2- 172.21.15.154:0/2300843730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415e730 0x7fe3540b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 --2- 172.21.15.154:0/2300843730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b0cf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 -- 172.21.15.154:0/2300843730 >> 172.21.15.154:0/2300843730 conn(0x7fe35406a4d0 msgr2=0x7fe35406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:55.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 -- 172.21.15.154:0/2300843730 shutdown_connections 2023-11-27T22:29:55.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.284+0000 7fe35a496640 1 -- 172.21.15.154:0/2300843730 wait complete. 2023-11-27T22:29:55.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.285+0000 7fe35a496640 1 Processor -- start 2023-11-27T22:29:55.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.285+0000 7fe35a496640 1 -- start start 2023-11-27T22:29:55.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe35a496640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe35a496640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415a4e0 0x7fe35412eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.290 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe35a496640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe35415e730 0x7fe3540cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe35a496640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354131990 con 0x7fe354143490 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe35a496640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35412f890 con 0x7fe35415e730 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe35a496640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35412fb70 con 0x7fe35415a4e0 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe353fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe353fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53508/0 (socket says 172.21.15.154:53508) 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe353fff640 1 -- 172.21.15.154:0/2992389853 learned_addr learned my addr 172.21.15.154:0/2992389853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe358a33640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe35415e730 0x7fe3540cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.286+0000 7fe3537fe640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415a4e0 0x7fe35412eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe353fff640 1 -- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415a4e0 msgr2=0x7fe35412eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe353fff640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415a4e0 0x7fe35412eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe353fff640 1 -- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe35415e730 msgr2=0x7fe3540cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.291 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe353fff640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe35415e730 0x7fe3540cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe353fff640 1 -- 172.21.15.154:0/2992389853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3440094d0 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe353fff640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b1110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe344000c00 tx=0x7fe344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344031840 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3440453f0 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440457a0 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35412fe50 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.287+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35413e730 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.288+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35413e8c0 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.288+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe3440303c0 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.289+0000 7fe350ff9640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe34006b1c0 0x7fe34006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.289+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe34402d040 con 0x7fe354143490 2023-11-27T22:29:55.292 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.289+0000 7fe3537fe640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe34006b1c0 0x7fe34006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.293 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.289+0000 7fe3537fe640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe34006b1c0 0x7fe34006d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe35413e520 tx=0x7fe348008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.293+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe344078b40 con 0x7fe354143490 2023-11-27T22:29:55.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.457+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe35415aeb0 con 0x7fe34006b1c0 2023-11-27T22:29:55.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.463+0000 7fe350ff9640 1 -- 172.21.15.154:0/2992389853 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264596 (secure 0 0 0) 0x7fe34800c040 con 0x7fe34006b1c0 2023-11-27T22:29:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:55.472 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:29:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe34006b1c0 msgr2=0x7fe34006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe34006b1c0 0x7fe34006d680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe35413e520 tx=0x7fe348008040 comp rx=0 tx=0).stop 2023-11-27T22:29:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 msgr2=0x7fe3540b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b1110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe344000c00 tx=0x7fe344004730 comp rx=0 tx=0).stop 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 shutdown_connections 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe35415e730 0x7fe3540cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe34006b1c0 0x7fe34006d680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe35415a4e0 0x7fe35412eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 --2- 172.21.15.154:0/2992389853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe354143490 0x7fe3540b1110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 >> 172.21.15.154:0/2992389853 conn(0x7fe35406a4d0 msgr2=0x7fe3540b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 shutdown_connections 2023-11-27T22:29:55.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.467+0000 7fe35a496640 1 -- 172.21.15.154:0/2992389853 wait complete. 2023-11-27T22:29:55.480 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-11-27T22:29:54.965170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003061"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138285+0000","last_change":"2023-11-27T22:29:39.657258+0000","last_active":"2023-11-27T22:29:41.138285+0000","last_peered":"2023-11-27T22:29:41.138285+0000","last_clean":"2023-11-27T22:29:41.138285+0000","last_became_active":"2023-11-27T22:29:39.656994+0000","last_became_peered":"2023-11-27T22:29:39.656994+0000","last_unstale":"2023-11-27T22:29:41.138285+0000","last_undegraded":"2023-11-27T22:29:41.138285+0000","last_fullsized":"2023-11-27T22:29:41.138285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:23:47.348952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638662+0000","last_change":"2023-11-27T22:29:39.646837+0000","last_active":"2023-11-27T22:29:40.638662+0000","last_peered":"2023-11-27T22:29:40.638662+0000","last_clean":"2023-11-27T22:29:40.638662+0000","last_became_active":"2023-11-27T22:29:39.645981+0000","last_became_peered":"2023-11-27T22:29:39.645981+0000","last_unstale":"2023-11-27T22:29:40.638662+0000","last_undegraded":"2023-11-27T22:29:40.638662+0000","last_fullsized":"2023-11-27T22:29:40.638662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136530+0000","last_change":"2023-11-27T22:29:39.643286+0000","last_active":"2023-11-27T22:29:41.136530+0000","last_peered":"2023-11-27T22:29:41.136530+0000","last_clean":"2023-11-27T22:29:41.136530+0000","last_became_active":"2023-11-27T22:29:39.642812+0000","last_became_peered":"2023-11-27T22:29:39.642812+0000","last_unstale":"2023-11-27T22:29:41.136530+0000","last_undegraded":"2023-11-27T22:29:41.136530+0000","last_fullsized":"2023-11-27T22:29:41.136530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138267+0000","last_change":"2023-11-27T22:29:39.649850+0000","last_active":"2023-11-27T22:29:41.138267+0000","last_peered":"2023-11-27T22:29:41.138267+0000","last_clean":"2023-11-27T22:29:41.138267+0000","last_became_active":"2023-11-27T22:29:39.649553+0000","last_became_peered":"2023-11-27T22:29:39.649553+0000","last_unstale":"2023-11-27T22:29:41.138267+0000","last_undegraded":"2023-11-27T22:29:41.138267+0000","last_fullsized":"2023-11-27T22:29:41.138267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:23:47.348952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138169+0000","last_change":"2023-11-27T22:29:39.653809+0000","last_active":"2023-11-27T22:29:41.138169+0000","last_peered":"2023-11-27T22:29:41.138169+0000","last_clean":"2023-11-27T22:29:41.138169+0000","last_became_active":"2023-11-27T22:29:39.653442+0000","last_became_peered":"2023-11-27T22:29:39.653442+0000","last_unstale":"2023-11-27T22:29:41.138169+0000","last_undegraded":"2023-11-27T22:29:41.138169+0000","last_fullsized":"2023-11-27T22:29:41.138169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137163+0000","last_change":"2023-11-27T22:29:39.650707+0000","last_active":"2023-11-27T22:29:41.137163+0000","last_peered":"2023-11-27T22:29:41.137163+0000","last_clean":"2023-11-27T22:29:41.137163+0000","last_became_active":"2023-11-27T22:29:39.649995+0000","last_became_peered":"2023-11-27T22:29:39.649995+0000","last_unstale":"2023-11-27T22:29:41.137163+0000","last_undegraded":"2023-11-27T22:29:41.137163+0000","last_fullsized":"2023-11-27T22:29:41.137163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137235+0000","last_change":"2023-11-27T22:29:39.654105+0000","last_active":"2023-11-27T22:29:41.137235+0000","last_peered":"2023-11-27T22:29:41.137235+0000","last_clean":"2023-11-27T22:29:41.137235+0000","last_became_active":"2023-11-27T22:29:39.653603+0000","last_became_peered":"2023-11-27T22:29:39.653603+0000","last_unstale":"2023-11-27T22:29:41.137235+0000","last_undegraded":"2023-11-27T22:29:41.137235+0000","last_fullsized":"2023-11-27T22:29:41.137235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637398+0000","last_change":"2023-11-27T22:29:39.654077+0000","last_active":"2023-11-27T22:29:40.637398+0000","last_peered":"2023-11-27T22:29:40.637398+0000","last_clean":"2023-11-27T22:29:40.637398+0000","last_became_active":"2023-11-27T22:29:39.653518+0000","last_became_peered":"2023-11-27T22:29:39.653518+0000","last_unstale":"2023-11-27T22:29:40.637398+0000","last_undegraded":"2023-11-27T22:29:40.637398+0000","last_fullsized":"2023-11-27T22:29:40.637398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138343+0000","last_change":"2023-11-27T22:29:39.657910+0000","last_active":"2023-11-27T22:29:41.138343+0000","last_peered":"2023-11-27T22:29:41.138343+0000","last_clean":"2023-11-27T22:29:41.138343+0000","last_became_active":"2023-11-27T22:29:39.657639+0000","last_became_peered":"2023-11-27T22:29:39.657639+0000","last_unstale":"2023-11-27T22:29:41.138343+0000","last_undegraded":"2023-11-27T22:29:41.138343+0000","last_fullsized":"2023-11-27T22:29:41.138343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:50.558601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637203+0000","last_change":"2023-11-27T22:29:39.645292+0000","last_active":"2023-11-27T22:29:40.637203+0000","last_peered":"2023-11-27T22:29:40.637203+0000","last_clean":"2023-11-27T22:29:40.637203+0000","last_became_active":"2023-11-27T22:29:39.645012+0000","last_became_peered":"2023-11-27T22:29:39.645012+0000","last_unstale":"2023-11-27T22:29:40.637203+0000","last_undegraded":"2023-11-27T22:29:40.637203+0000","last_fullsized":"2023-11-27T22:29:40.637203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637000+0000","last_change":"2023-11-27T22:29:39.645072+0000","last_active":"2023-11-27T22:29:40.637000+0000","last_peered":"2023-11-27T22:29:40.637000+0000","last_clean":"2023-11-27T22:29:40.637000+0000","last_became_active":"2023-11-27T22:29:39.644771+0000","last_became_peered":"2023-11-27T22:29:39.644771+0000","last_unstale":"2023-11-27T22:29:40.637000+0000","last_undegraded":"2023-11-27T22:29:40.637000+0000","last_fullsized":"2023-11-27T22:29:40.637000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137914+0000","last_change":"2023-11-27T22:29:39.644172+0000","last_active":"2023-11-27T22:29:41.137914+0000","last_peered":"2023-11-27T22:29:41.137914+0000","last_clean":"2023-11-27T22:29:41.137914+0000","last_became_active":"2023-11-27T22:29:39.643298+0000","last_became_peered":"2023-11-27T22:29:39.643298+0000","last_unstale":"2023-11-27T22:29:41.137914+0000","last_undegraded":"2023-11-27T22:29:41.137914+0000","last_fullsized":"2023-11-27T22:29:41.137914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637594+0000","last_change":"2023-11-27T22:29:39.657540+0000","last_active":"2023-11-27T22:29:40.637594+0000","last_peered":"2023-11-27T22:29:40.637594+0000","last_clean":"2023-11-27T22:29:40.637594+0000","last_became_active":"2023-11-27T22:29:39.657283+0000","last_became_peered":"2023-11-27T22:29:39.657283+0000","last_unstale":"2023-11-27T22:29:40.637594+0000","last_undegraded":"2023-11-27T22:29:40.637594+0000","last_fullsized":"2023-11-27T22:29:40.637594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136428+0000","last_change":"2023-11-27T22:29:39.646882+0000","last_active":"2023-11-27T22:29:41.136428+0000","last_peered":"2023-11-27T22:29:41.136428+0000","last_clean":"2023-11-27T22:29:41.136428+0000","last_became_active":"2023-11-27T22:29:39.646580+0000","last_became_peered":"2023-11-27T22:29:39.646580+0000","last_unstale":"2023-11-27T22:29:41.136428+0000","last_undegraded":"2023-11-27T22:29:41.136428+0000","last_fullsized":"2023-11-27T22:29:41.136428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:37.746015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638442+0000","last_change":"2023-11-27T22:29:39.645413+0000","last_active":"2023-11-27T22:29:40.638442+0000","last_peered":"2023-11-27T22:29:40.638442+0000","last_clean":"2023-11-27T22:29:40.638442+0000","last_became_active":"2023-11-27T22:29:39.645150+0000","last_became_peered":"2023-11-27T22:29:39.645150+0000","last_unstale":"2023-11-27T22:29:40.638442+0000","last_undegraded":"2023-11-27T22:29:40.638442+0000","last_fullsized":"2023-11-27T22:29:40.638442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137158+0000","last_change":"2023-11-27T22:29:39.650165+0000","last_active":"2023-11-27T22:29:41.137158+0000","last_peered":"2023-11-27T22:29:41.137158+0000","last_clean":"2023-11-27T22:29:41.137158+0000","last_became_active":"2023-11-27T22:29:39.649783+0000","last_became_peered":"2023-11-27T22:29:39.649783+0000","last_unstale":"2023-11-27T22:29:41.137158+0000","last_undegraded":"2023-11-27T22:29:41.137158+0000","last_fullsized":"2023-11-27T22:29:41.137158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137800+0000","last_change":"2023-11-27T22:29:39.654571+0000","last_active":"2023-11-27T22:29:41.137800+0000","last_peered":"2023-11-27T22:29:41.137800+0000","last_clean":"2023-11-27T22:29:41.137800+0000","last_became_active":"2023-11-27T22:29:39.654278+0000","last_became_peered":"2023-11-27T22:29:39.654278+0000","last_unstale":"2023-11-27T22:29:41.137800+0000","last_undegraded":"2023-11-27T22:29:41.137800+0000","last_fullsized":"2023-11-27T22:29:41.137800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765150+0000","last_change":"2023-11-27T22:29:39.648168+0000","last_active":"2023-11-27T22:29:40.765150+0000","last_peered":"2023-11-27T22:29:40.765150+0000","last_clean":"2023-11-27T22:29:40.765150+0000","last_became_active":"2023-11-27T22:29:39.647900+0000","last_became_peered":"2023-11-27T22:29:39.647900+0000","last_unstale":"2023-11-27T22:29:40.765150+0000","last_undegraded":"2023-11-27T22:29:40.765150+0000","last_fullsized":"2023-11-27T22:29:40.765150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138592+0000","last_change":"2023-11-27T22:29:39.655501+0000","last_active":"2023-11-27T22:29:41.138592+0000","last_peered":"2023-11-27T22:29:41.138592+0000","last_clean":"2023-11-27T22:29:41.138592+0000","last_became_active":"2023-11-27T22:29:39.655220+0000","last_became_peered":"2023-11-27T22:29:39.655220+0000","last_unstale":"2023-11-27T22:29:41.138592+0000","last_undegraded":"2023-11-27T22:29:41.138592+0000","last_fullsized":"2023-11-27T22:29:41.138592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:53:34.262936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636971+0000","last_change":"2023-11-27T22:29:39.645941+0000","last_active":"2023-11-27T22:29:40.636971+0000","last_peered":"2023-11-27T22:29:40.636971+0000","last_clean":"2023-11-27T22:29:40.636971+0000","last_became_active":"2023-11-27T22:29:39.645663+0000","last_became_peered":"2023-11-27T22:29:39.645663+0000","last_unstale":"2023-11-27T22:29:40.636971+0000","last_undegraded":"2023-11-27T22:29:40.636971+0000","last_fullsized":"2023-11-27T22:29:40.636971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136618+0000","last_change":"2023-11-27T22:29:39.655808+0000","last_active":"2023-11-27T22:29:41.136618+0000","last_peered":"2023-11-27T22:29:41.136618+0000","last_clean":"2023-11-27T22:29:41.136618+0000","last_became_active":"2023-11-27T22:29:39.655505+0000","last_became_peered":"2023-11-27T22:29:39.655505+0000","last_unstale":"2023-11-27T22:29:41.136618+0000","last_undegraded":"2023-11-27T22:29:41.136618+0000","last_fullsized":"2023-11-27T22:29:41.136618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137325+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:41.137325+0000","last_peered":"2023-11-27T22:29:41.137325+0000","last_clean":"2023-11-27T22:29:41.137325+0000","last_became_active":"2023-11-27T22:29:39.654007+0000","last_became_peered":"2023-11-27T22:29:39.654007+0000","last_unstale":"2023-11-27T22:29:41.137325+0000","last_undegraded":"2023-11-27T22:29:41.137325+0000","last_fullsized":"2023-11-27T22:29:41.137325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637799+0000","last_change":"2023-11-27T22:29:39.648110+0000","last_active":"2023-11-27T22:29:40.637799+0000","last_peered":"2023-11-27T22:29:40.637799+0000","last_clean":"2023-11-27T22:29:40.637799+0000","last_became_active":"2023-11-27T22:29:39.647846+0000","last_became_peered":"2023-11-27T22:29:39.647846+0000","last_unstale":"2023-11-27T22:29:40.637799+0000","last_undegraded":"2023-11-27T22:29:40.637799+0000","last_fullsized":"2023-11-27T22:29:40.637799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137328+0000","last_change":"2023-11-27T22:29:39.649954+0000","last_active":"2023-11-27T22:29:41.137328+0000","last_peered":"2023-11-27T22:29:41.137328+0000","last_clean":"2023-11-27T22:29:41.137328+0000","last_became_active":"2023-11-27T22:29:39.649652+0000","last_became_peered":"2023-11-27T22:29:39.649652+0000","last_unstale":"2023-11-27T22:29:41.137328+0000","last_undegraded":"2023-11-27T22:29:41.137328+0000","last_fullsized":"2023-11-27T22:29:41.137328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:27:09.452161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637719+0000","last_change":"2023-11-27T22:29:39.649200+0000","last_active":"2023-11-27T22:29:40.637719+0000","last_peered":"2023-11-27T22:29:40.637719+0000","last_clean":"2023-11-27T22:29:40.637719+0000","last_became_active":"2023-11-27T22:29:39.648825+0000","last_became_peered":"2023-11-27T22:29:39.648825+0000","last_unstale":"2023-11-27T22:29:40.637719+0000","last_undegraded":"2023-11-27T22:29:40.637719+0000","last_fullsized":"2023-11-27T22:29:40.637719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:10.314486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637255+0000","last_change":"2023-11-27T22:29:39.654267+0000","last_active":"2023-11-27T22:29:40.637255+0000","last_peered":"2023-11-27T22:29:40.637255+0000","last_clean":"2023-11-27T22:29:40.637255+0000","last_became_active":"2023-11-27T22:29:39.654008+0000","last_became_peered":"2023-11-27T22:29:39.654008+0000","last_unstale":"2023-11-27T22:29:40.637255+0000","last_undegraded":"2023-11-27T22:29:40.637255+0000","last_fullsized":"2023-11-27T22:29:40.637255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638583+0000","last_change":"2023-11-27T22:29:39.647097+0000","last_active":"2023-11-27T22:29:40.638583+0000","last_peered":"2023-11-27T22:29:40.638583+0000","last_clean":"2023-11-27T22:29:40.638583+0000","last_became_active":"2023-11-27T22:29:39.646828+0000","last_became_peered":"2023-11-27T22:29:39.646828+0000","last_unstale":"2023-11-27T22:29:40.638583+0000","last_undegraded":"2023-11-27T22:29:40.638583+0000","last_fullsized":"2023-11-27T22:29:40.638583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637906+0000","last_change":"2023-11-27T22:29:39.653574+0000","last_active":"2023-11-27T22:29:40.637906+0000","last_peered":"2023-11-27T22:29:40.637906+0000","last_clean":"2023-11-27T22:29:40.637906+0000","last_became_active":"2023-11-27T22:29:39.653270+0000","last_became_peered":"2023-11-27T22:29:39.653270+0000","last_unstale":"2023-11-27T22:29:40.637906+0000","last_undegraded":"2023-11-27T22:29:40.637906+0000","last_fullsized":"2023-11-27T22:29:40.637906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:34:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136725+0000","last_change":"2023-11-27T22:29:39.648704+0000","last_active":"2023-11-27T22:29:41.136725+0000","last_peered":"2023-11-27T22:29:41.136725+0000","last_clean":"2023-11-27T22:29:41.136725+0000","last_became_active":"2023-11-27T22:29:39.648254+0000","last_became_peered":"2023-11-27T22:29:39.648254+0000","last_unstale":"2023-11-27T22:29:41.136725+0000","last_undegraded":"2023-11-27T22:29:41.136725+0000","last_fullsized":"2023-11-27T22:29:41.136725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:03.337741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137535+0000","last_change":"2023-11-27T22:29:39.648662+0000","last_active":"2023-11-27T22:29:41.137535+0000","last_peered":"2023-11-27T22:29:41.137535+0000","last_clean":"2023-11-27T22:29:41.137535+0000","last_became_active":"2023-11-27T22:29:39.647607+0000","last_became_peered":"2023-11-27T22:29:39.647607+0000","last_unstale":"2023-11-27T22:29:41.137535+0000","last_undegraded":"2023-11-27T22:29:41.137535+0000","last_fullsized":"2023-11-27T22:29:41.137535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765029+0000","last_change":"2023-11-27T22:29:39.646354+0000","last_active":"2023-11-27T22:29:40.765029+0000","last_peered":"2023-11-27T22:29:40.765029+0000","last_clean":"2023-11-27T22:29:40.765029+0000","last_became_active":"2023-11-27T22:29:39.646090+0000","last_became_peered":"2023-11-27T22:29:39.646090+0000","last_unstale":"2023-11-27T22:29:40.765029+0000","last_undegraded":"2023-11-27T22:29:40.765029+0000","last_fullsized":"2023-11-27T22:29:40.765029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:08.721858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636897+0000","last_change":"2023-11-27T22:29:39.649555+0000","last_active":"2023-11-27T22:29:40.636897+0000","last_peered":"2023-11-27T22:29:40.636897+0000","last_clean":"2023-11-27T22:29:40.636897+0000","last_became_active":"2023-11-27T22:29:39.649055+0000","last_became_peered":"2023-11-27T22:29:39.649055+0000","last_unstale":"2023-11-27T22:29:40.636897+0000","last_undegraded":"2023-11-27T22:29:40.636897+0000","last_fullsized":"2023-11-27T22:29:40.636897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137222+0000","last_change":"2023-11-27T22:29:39.651646+0000","last_active":"2023-11-27T22:29:41.137222+0000","last_peered":"2023-11-27T22:29:41.137222+0000","last_clean":"2023-11-27T22:29:41.137222+0000","last_became_active":"2023-11-27T22:29:39.651358+0000","last_became_peered":"2023-11-27T22:29:39.651358+0000","last_unstale":"2023-11-27T22:29:41.137222+0000","last_undegraded":"2023-11-27T22:29:41.137222+0000","last_fullsized":"2023-11-27T22:29:41.137222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:42.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637683+0000","last_change":"2023-11-27T22:29:38.663887+0000","last_active":"2023-11-27T22:29:40.637683+0000","last_peered":"2023-11-27T22:29:40.637683+0000","last_clean":"2023-11-27T22:29:40.637683+0000","last_became_active":"2023-11-27T22:29:38.662995+0000","last_became_peered":"2023-11-27T22:29:38.662995+0000","last_unstale":"2023-11-27T22:29:40.637683+0000","last_undegraded":"2023-11-27T22:29:40.637683+0000","last_fullsized":"2023-11-27T22:29:40.637683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136764+0000","last_change":"2023-11-27T22:29:39.644876+0000","last_active":"2023-11-27T22:29:41.136764+0000","last_peered":"2023-11-27T22:29:41.136764+0000","last_clean":"2023-11-27T22:29:41.136764+0000","last_became_active":"2023-11-27T22:29:39.644470+0000","last_became_peered":"2023-11-27T22:29:39.644470+0000","last_unstale":"2023-11-27T22:29:41.136764+0000","last_undegraded":"2023-11-27T22:29:41.136764+0000","last_fullsized":"2023-11-27T22:29:41.136764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636788+0000","last_change":"2023-11-27T22:29:38.659425+0000","last_active":"2023-11-27T22:29:40.636788+0000","last_peered":"2023-11-27T22:29:40.636788+0000","last_clean":"2023-11-27T22:29:40.636788+0000","last_became_active":"2023-11-27T22:29:38.659091+0000","last_became_peered":"2023-11-27T22:29:38.659091+0000","last_unstale":"2023-11-27T22:29:40.636788+0000","last_undegraded":"2023-11-27T22:29:40.636788+0000","last_fullsized":"2023-11-27T22:29:40.636788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637460+0000","last_change":"2023-11-27T22:29:38.658068+0000","last_active":"2023-11-27T22:29:40.637460+0000","last_peered":"2023-11-27T22:29:40.637460+0000","last_clean":"2023-11-27T22:29:40.637460+0000","last_became_active":"2023-11-27T22:29:38.657688+0000","last_became_peered":"2023-11-27T22:29:38.657688+0000","last_unstale":"2023-11-27T22:29:40.637460+0000","last_undegraded":"2023-11-27T22:29:40.637460+0000","last_fullsized":"2023-11-27T22:29:40.637460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637464+0000","last_change":"2023-11-27T22:29:39.651687+0000","last_active":"2023-11-27T22:29:40.637464+0000","last_peered":"2023-11-27T22:29:40.637464+0000","last_clean":"2023-11-27T22:29:40.637464+0000","last_became_active":"2023-11-27T22:29:39.651383+0000","last_became_peered":"2023-11-27T22:29:39.651383+0000","last_unstale":"2023-11-27T22:29:40.637464+0000","last_undegraded":"2023-11-27T22:29:40.637464+0000","last_fullsized":"2023-11-27T22:29:40.637464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977074+0000","last_change":"2023-11-27T22:29:38.656782+0000","last_active":"2023-11-27T22:29:40.977074+0000","last_peered":"2023-11-27T22:29:40.977074+0000","last_clean":"2023-11-27T22:29:40.977074+0000","last_became_active":"2023-11-27T22:29:38.656527+0000","last_became_peered":"2023-11-27T22:29:38.656527+0000","last_unstale":"2023-11-27T22:29:40.977074+0000","last_undegraded":"2023-11-27T22:29:40.977074+0000","last_fullsized":"2023-11-27T22:29:40.977074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638394+0000","last_change":"2023-11-27T22:29:39.646862+0000","last_active":"2023-11-27T22:29:40.638394+0000","last_peered":"2023-11-27T22:29:40.638394+0000","last_clean":"2023-11-27T22:29:40.638394+0000","last_became_active":"2023-11-27T22:29:39.644502+0000","last_became_peered":"2023-11-27T22:29:39.644502+0000","last_unstale":"2023-11-27T22:29:40.638394+0000","last_undegraded":"2023-11-27T22:29:40.638394+0000","last_fullsized":"2023-11-27T22:29:40.638394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636966+0000","last_change":"2023-11-27T22:29:38.656824+0000","last_active":"2023-11-27T22:29:40.636966+0000","last_peered":"2023-11-27T22:29:40.636966+0000","last_clean":"2023-11-27T22:29:40.636966+0000","last_became_active":"2023-11-27T22:29:38.656542+0000","last_became_peered":"2023-11-27T22:29:38.656542+0000","last_unstale":"2023-11-27T22:29:40.636966+0000","last_undegraded":"2023-11-27T22:29:40.636966+0000","last_fullsized":"2023-11-27T22:29:40.636966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137958+0000","last_change":"2023-11-27T22:29:39.656332+0000","last_active":"2023-11-27T22:29:41.137958+0000","last_peered":"2023-11-27T22:29:41.137958+0000","last_clean":"2023-11-27T22:29:41.137958+0000","last_became_active":"2023-11-27T22:29:39.654860+0000","last_became_peered":"2023-11-27T22:29:39.654860+0000","last_unstale":"2023-11-27T22:29:41.137958+0000","last_undegraded":"2023-11-27T22:29:41.137958+0000","last_fullsized":"2023-11-27T22:29:41.137958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:18:12.958698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977350+0000","last_change":"2023-11-27T22:29:38.661962+0000","last_active":"2023-11-27T22:29:40.977350+0000","last_peered":"2023-11-27T22:29:40.977350+0000","last_clean":"2023-11-27T22:29:40.977350+0000","last_became_active":"2023-11-27T22:29:38.661221+0000","last_became_peered":"2023-11-27T22:29:38.661221+0000","last_unstale":"2023-11-27T22:29:40.977350+0000","last_undegraded":"2023-11-27T22:29:40.977350+0000","last_fullsized":"2023-11-27T22:29:40.977350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:13:02.332894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136729+0000","last_change":"2023-11-27T22:29:39.644743+0000","last_active":"2023-11-27T22:29:41.136729+0000","last_peered":"2023-11-27T22:29:41.136729+0000","last_clean":"2023-11-27T22:29:41.136729+0000","last_became_active":"2023-11-27T22:29:39.644482+0000","last_became_peered":"2023-11-27T22:29:39.644482+0000","last_unstale":"2023-11-27T22:29:41.136729+0000","last_undegraded":"2023-11-27T22:29:41.136729+0000","last_fullsized":"2023-11-27T22:29:41.136729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638586+0000","last_change":"2023-11-27T22:29:38.657621+0000","last_active":"2023-11-27T22:29:40.638586+0000","last_peered":"2023-11-27T22:29:40.638586+0000","last_clean":"2023-11-27T22:29:40.638586+0000","last_became_active":"2023-11-27T22:29:38.657362+0000","last_became_peered":"2023-11-27T22:29:38.657362+0000","last_unstale":"2023-11-27T22:29:40.638586+0000","last_undegraded":"2023-11-27T22:29:40.638586+0000","last_fullsized":"2023-11-27T22:29:40.638586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138066+0000","last_change":"2023-11-27T22:29:39.654893+0000","last_active":"2023-11-27T22:29:41.138066+0000","last_peered":"2023-11-27T22:29:41.138066+0000","last_clean":"2023-11-27T22:29:41.138066+0000","last_became_active":"2023-11-27T22:29:39.654615+0000","last_became_peered":"2023-11-27T22:29:39.654615+0000","last_unstale":"2023-11-27T22:29:41.138066+0000","last_undegraded":"2023-11-27T22:29:41.138066+0000","last_fullsized":"2023-11-27T22:29:41.138066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:48.631646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637012+0000","last_change":"2023-11-27T22:29:38.659143+0000","last_active":"2023-11-27T22:29:40.637012+0000","last_peered":"2023-11-27T22:29:40.637012+0000","last_clean":"2023-11-27T22:29:40.637012+0000","last_became_active":"2023-11-27T22:29:38.658790+0000","last_became_peered":"2023-11-27T22:29:38.658790+0000","last_unstale":"2023-11-27T22:29:40.637012+0000","last_undegraded":"2023-11-27T22:29:40.637012+0000","last_fullsized":"2023-11-27T22:29:40.637012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138090+0000","last_change":"2023-11-27T22:29:39.654060+0000","last_active":"2023-11-27T22:29:41.138090+0000","last_peered":"2023-11-27T22:29:41.138090+0000","last_clean":"2023-11-27T22:29:41.138090+0000","last_became_active":"2023-11-27T22:29:39.653483+0000","last_became_peered":"2023-11-27T22:29:39.653483+0000","last_unstale":"2023-11-27T22:29:41.138090+0000","last_undegraded":"2023-11-27T22:29:41.138090+0000","last_fullsized":"2023-11-27T22:29:41.138090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978456+0000","last_change":"2023-11-27T22:29:38.660084+0000","last_active":"2023-11-27T22:29:40.978456+0000","last_peered":"2023-11-27T22:29:40.978456+0000","last_clean":"2023-11-27T22:29:40.978456+0000","last_became_active":"2023-11-27T22:29:38.659648+0000","last_became_peered":"2023-11-27T22:29:38.659648+0000","last_unstale":"2023-11-27T22:29:40.978456+0000","last_undegraded":"2023-11-27T22:29:40.978456+0000","last_fullsized":"2023-11-27T22:29:40.978456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:58:18.636550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136488+0000","last_change":"2023-11-27T22:29:39.654365+0000","last_active":"2023-11-27T22:29:41.136488+0000","last_peered":"2023-11-27T22:29:41.136488+0000","last_clean":"2023-11-27T22:29:41.136488+0000","last_became_active":"2023-11-27T22:29:39.654080+0000","last_became_peered":"2023-11-27T22:29:39.654080+0000","last_unstale":"2023-11-27T22:29:41.136488+0000","last_undegraded":"2023-11-27T22:29:41.136488+0000","last_fullsized":"2023-11-27T22:29:41.136488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:19.450249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977168+0000","last_change":"2023-11-27T22:29:38.661785+0000","last_active":"2023-11-27T22:29:40.977168+0000","last_peered":"2023-11-27T22:29:40.977168+0000","last_clean":"2023-11-27T22:29:40.977168+0000","last_became_active":"2023-11-27T22:29:38.661129+0000","last_became_peered":"2023-11-27T22:29:38.661129+0000","last_unstale":"2023-11-27T22:29:40.977168+0000","last_undegraded":"2023-11-27T22:29:40.977168+0000","last_fullsized":"2023-11-27T22:29:40.977168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:20.640296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138435+0000","last_change":"2023-11-27T22:29:39.654846+0000","last_active":"2023-11-27T22:29:41.138435+0000","last_peered":"2023-11-27T22:29:41.138435+0000","last_clean":"2023-11-27T22:29:41.138435+0000","last_became_active":"2023-11-27T22:29:39.654042+0000","last_became_peered":"2023-11-27T22:29:39.654042+0000","last_unstale":"2023-11-27T22:29:41.138435+0000","last_undegraded":"2023-11-27T22:29:41.138435+0000","last_fullsized":"2023-11-27T22:29:41.138435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:16:15.899536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636721+0000","last_change":"2023-11-27T22:29:38.658756+0000","last_active":"2023-11-27T22:29:40.636721+0000","last_peered":"2023-11-27T22:29:40.636721+0000","last_clean":"2023-11-27T22:29:40.636721+0000","last_became_active":"2023-11-27T22:29:38.658475+0000","last_became_peered":"2023-11-27T22:29:38.658475+0000","last_unstale":"2023-11-27T22:29:40.636721+0000","last_undegraded":"2023-11-27T22:29:40.636721+0000","last_fullsized":"2023-11-27T22:29:40.636721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636767+0000","last_change":"2023-11-27T22:29:39.649309+0000","last_active":"2023-11-27T22:29:40.636767+0000","last_peered":"2023-11-27T22:29:40.636767+0000","last_clean":"2023-11-27T22:29:40.636767+0000","last_became_active":"2023-11-27T22:29:39.648695+0000","last_became_peered":"2023-11-27T22:29:39.648695+0000","last_unstale":"2023-11-27T22:29:40.636767+0000","last_undegraded":"2023-11-27T22:29:40.636767+0000","last_fullsized":"2023-11-27T22:29:40.636767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:10:21.645143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.764988+0000","last_change":"2023-11-27T22:29:38.654789+0000","last_active":"2023-11-27T22:29:40.764988+0000","last_peered":"2023-11-27T22:29:40.764988+0000","last_clean":"2023-11-27T22:29:40.764988+0000","last_became_active":"2023-11-27T22:29:38.654453+0000","last_became_peered":"2023-11-27T22:29:38.654453+0000","last_unstale":"2023-11-27T22:29:40.764988+0000","last_undegraded":"2023-11-27T22:29:40.764988+0000","last_fullsized":"2023-11-27T22:29:40.764988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:16:58.667992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137369+0000","last_change":"2023-11-27T22:29:39.654661+0000","last_active":"2023-11-27T22:29:41.137369+0000","last_peered":"2023-11-27T22:29:41.137369+0000","last_clean":"2023-11-27T22:29:41.137369+0000","last_became_active":"2023-11-27T22:29:39.654269+0000","last_became_peered":"2023-11-27T22:29:39.654269+0000","last_unstale":"2023-11-27T22:29:41.137369+0000","last_undegraded":"2023-11-27T22:29:41.137369+0000","last_fullsized":"2023-11-27T22:29:41.137369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978729+0000","last_change":"2023-11-27T22:29:38.658036+0000","last_active":"2023-11-27T22:29:40.978729+0000","last_peered":"2023-11-27T22:29:40.978729+0000","last_clean":"2023-11-27T22:29:40.978729+0000","last_became_active":"2023-11-27T22:29:38.657748+0000","last_became_peered":"2023-11-27T22:29:38.657748+0000","last_unstale":"2023-11-27T22:29:40.978729+0000","last_undegraded":"2023-11-27T22:29:40.978729+0000","last_fullsized":"2023-11-27T22:29:40.978729+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:12:26.492362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137888+0000","last_change":"2023-11-27T22:29:39.659240+0000","last_active":"2023-11-27T22:29:41.137888+0000","last_peered":"2023-11-27T22:29:41.137888+0000","last_clean":"2023-11-27T22:29:41.137888+0000","last_became_active":"2023-11-27T22:29:39.658986+0000","last_became_peered":"2023-11-27T22:29:39.658986+0000","last_unstale":"2023-11-27T22:29:41.137888+0000","last_undegraded":"2023-11-27T22:29:41.137888+0000","last_fullsized":"2023-11-27T22:29:41.137888+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:18:12.958698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765118+0000","last_change":"2023-11-27T22:29:38.660926+0000","last_active":"2023-11-27T22:29:40.765118+0000","last_peered":"2023-11-27T22:29:40.765118+0000","last_clean":"2023-11-27T22:29:40.765118+0000","last_became_active":"2023-11-27T22:29:38.660662+0000","last_became_peered":"2023-11-27T22:29:38.660662+0000","last_unstale":"2023-11-27T22:29:40.765118+0000","last_undegraded":"2023-11-27T22:29:40.765118+0000","last_fullsized":"2023-11-27T22:29:40.765118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:57:41.693347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138504+0000","last_change":"2023-11-27T22:29:39.659397+0000","last_active":"2023-11-27T22:29:41.138504+0000","last_peered":"2023-11-27T22:29:41.138504+0000","last_clean":"2023-11-27T22:29:41.138504+0000","last_became_active":"2023-11-27T22:29:39.658970+0000","last_became_peered":"2023-11-27T22:29:39.658970+0000","last_unstale":"2023-11-27T22:29:41.138504+0000","last_undegraded":"2023-11-27T22:29:41.138504+0000","last_fullsized":"2023-11-27T22:29:41.138504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:11:08.383015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638663+0000","last_change":"2023-11-27T22:29:38.654389+0000","last_active":"2023-11-27T22:29:40.638663+0000","last_peered":"2023-11-27T22:29:40.638663+0000","last_clean":"2023-11-27T22:29:40.638663+0000","last_became_active":"2023-11-27T22:29:38.654116+0000","last_became_peered":"2023-11-27T22:29:38.654116+0000","last_unstale":"2023-11-27T22:29:40.638663+0000","last_undegraded":"2023-11-27T22:29:40.638663+0000","last_fullsized":"2023-11-27T22:29:40.638663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138396+0000","last_change":"2023-11-27T22:29:39.649308+0000","last_active":"2023-11-27T22:29:41.138396+0000","last_peered":"2023-11-27T22:29:41.138396+0000","last_clean":"2023-11-27T22:29:41.138396+0000","last_became_active":"2023-11-27T22:29:39.648915+0000","last_became_peered":"2023-11-27T22:29:39.648915+0000","last_unstale":"2023-11-27T22:29:41.138396+0000","last_undegraded":"2023-11-27T22:29:41.138396+0000","last_fullsized":"2023-11-27T22:29:41.138396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:38:50.558601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765138+0000","last_change":"2023-11-27T22:29:38.661956+0000","last_active":"2023-11-27T22:29:40.765138+0000","last_peered":"2023-11-27T22:29:40.765138+0000","last_clean":"2023-11-27T22:29:40.765138+0000","last_became_active":"2023-11-27T22:29:38.661660+0000","last_became_peered":"2023-11-27T22:29:38.661660+0000","last_unstale":"2023-11-27T22:29:40.765138+0000","last_undegraded":"2023-11-27T22:29:40.765138+0000","last_fullsized":"2023-11-27T22:29:40.765138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:51.854143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138343+0000","last_change":"2023-11-27T22:29:39.655710+0000","last_active":"2023-11-27T22:29:41.138343+0000","last_peered":"2023-11-27T22:29:41.138343+0000","last_clean":"2023-11-27T22:29:41.138343+0000","last_became_active":"2023-11-27T22:29:39.654385+0000","last_became_peered":"2023-11-27T22:29:39.654385+0000","last_unstale":"2023-11-27T22:29:41.138343+0000","last_undegraded":"2023-11-27T22:29:41.138343+0000","last_fullsized":"2023-11-27T22:29:41.138343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:27.041102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:39.642415+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:29:39.642415+0000","last_peered":"2023-11-27T22:29:39.642415+0000","last_clean":"2023-11-27T22:29:39.642415+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:29:39.642415+0000","last_undegraded":"2023-11-27T22:29:39.642415+0000","last_fullsized":"2023-11-27T22:29:39.642415+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977220+0000","last_change":"2023-11-27T22:29:38.656156+0000","last_active":"2023-11-27T22:29:40.977220+0000","last_peered":"2023-11-27T22:29:40.977220+0000","last_clean":"2023-11-27T22:29:40.977220+0000","last_became_active":"2023-11-27T22:29:38.655859+0000","last_became_peered":"2023-11-27T22:29:38.655859+0000","last_unstale":"2023-11-27T22:29:40.977220+0000","last_undegraded":"2023-11-27T22:29:40.977220+0000","last_fullsized":"2023-11-27T22:29:40.977220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637872+0000","last_change":"2023-11-27T22:29:39.653299+0000","last_active":"2023-11-27T22:29:40.637872+0000","last_peered":"2023-11-27T22:29:40.637872+0000","last_clean":"2023-11-27T22:29:40.637872+0000","last_became_active":"2023-11-27T22:29:39.653033+0000","last_became_peered":"2023-11-27T22:29:39.653033+0000","last_unstale":"2023-11-27T22:29:40.637872+0000","last_undegraded":"2023-11-27T22:29:40.637872+0000","last_fullsized":"2023-11-27T22:29:40.637872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:16:09.956509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977854+0000","last_change":"2023-11-27T22:29:38.664007+0000","last_active":"2023-11-27T22:29:40.977854+0000","last_peered":"2023-11-27T22:29:40.977854+0000","last_clean":"2023-11-27T22:29:40.977854+0000","last_became_active":"2023-11-27T22:29:38.663462+0000","last_became_peered":"2023-11-27T22:29:38.663462+0000","last_unstale":"2023-11-27T22:29:40.977854+0000","last_undegraded":"2023-11-27T22:29:40.977854+0000","last_fullsized":"2023-11-27T22:29:40.977854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136397+0000","last_change":"2023-11-27T22:29:39.646086+0000","last_active":"2023-11-27T22:29:41.136397+0000","last_peered":"2023-11-27T22:29:41.136397+0000","last_clean":"2023-11-27T22:29:41.136397+0000","last_became_active":"2023-11-27T22:29:39.645812+0000","last_became_peered":"2023-11-27T22:29:39.645812+0000","last_unstale":"2023-11-27T22:29:41.136397+0000","last_undegraded":"2023-11-27T22:29:41.136397+0000","last_fullsized":"2023-11-27T22:29:41.136397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:39.856018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.765072+0000","last_change":"2023-11-27T22:29:38.660283+0000","last_active":"2023-11-27T22:29:40.765072+0000","last_peered":"2023-11-27T22:29:40.765072+0000","last_clean":"2023-11-27T22:29:40.765072+0000","last_became_active":"2023-11-27T22:29:38.658807+0000","last_became_peered":"2023-11-27T22:29:38.658807+0000","last_unstale":"2023-11-27T22:29:40.765072+0000","last_undegraded":"2023-11-27T22:29:40.765072+0000","last_fullsized":"2023-11-27T22:29:40.765072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:44:21.338284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638421+0000","last_change":"2023-11-27T22:29:39.644925+0000","last_active":"2023-11-27T22:29:40.638421+0000","last_peered":"2023-11-27T22:29:40.638421+0000","last_clean":"2023-11-27T22:29:40.638421+0000","last_became_active":"2023-11-27T22:29:39.644678+0000","last_became_peered":"2023-11-27T22:29:39.644678+0000","last_unstale":"2023-11-27T22:29:40.638421+0000","last_undegraded":"2023-11-27T22:29:40.638421+0000","last_fullsized":"2023-11-27T22:29:40.638421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977189+0000","last_change":"2023-11-27T22:29:38.662139+0000","last_active":"2023-11-27T22:29:40.977189+0000","last_peered":"2023-11-27T22:29:40.977189+0000","last_clean":"2023-11-27T22:29:40.977189+0000","last_became_active":"2023-11-27T22:29:38.661432+0000","last_became_peered":"2023-11-27T22:29:38.661432+0000","last_unstale":"2023-11-27T22:29:40.977189+0000","last_undegraded":"2023-11-27T22:29:40.977189+0000","last_fullsized":"2023-11-27T22:29:40.977189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137794+0000","last_change":"2023-11-27T22:29:39.651435+0000","last_active":"2023-11-27T22:29:41.137794+0000","last_peered":"2023-11-27T22:29:41.137794+0000","last_clean":"2023-11-27T22:29:41.137794+0000","last_became_active":"2023-11-27T22:29:39.651172+0000","last_became_peered":"2023-11-27T22:29:39.651172+0000","last_unstale":"2023-11-27T22:29:41.137794+0000","last_undegraded":"2023-11-27T22:29:41.137794+0000","last_fullsized":"2023-11-27T22:29:41.137794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:51.632566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638530+0000","last_change":"2023-11-27T22:29:38.653717+0000","last_active":"2023-11-27T22:29:40.638530+0000","last_peered":"2023-11-27T22:29:40.638530+0000","last_clean":"2023-11-27T22:29:40.638530+0000","last_became_active":"2023-11-27T22:29:38.653432+0000","last_became_peered":"2023-11-27T22:29:38.653432+0000","last_unstale":"2023-11-27T22:29:40.638530+0000","last_undegraded":"2023-11-27T22:29:40.638530+0000","last_fullsized":"2023-11-27T22:29:40.638530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:34:07.717011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137515+0000","last_change":"2023-11-27T22:29:39.650521+0000","last_active":"2023-11-27T22:29:41.137515+0000","last_peered":"2023-11-27T22:29:41.137515+0000","last_clean":"2023-11-27T22:29:41.137515+0000","last_became_active":"2023-11-27T22:29:39.650292+0000","last_became_peered":"2023-11-27T22:29:39.650292+0000","last_unstale":"2023-11-27T22:29:41.137515+0000","last_undegraded":"2023-11-27T22:29:41.137515+0000","last_fullsized":"2023-11-27T22:29:41.137515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978023+0000","last_change":"2023-11-27T22:29:38.664144+0000","last_active":"2023-11-27T22:29:40.978023+0000","last_peered":"2023-11-27T22:29:40.978023+0000","last_clean":"2023-11-27T22:29:40.978023+0000","last_became_active":"2023-11-27T22:29:38.663854+0000","last_became_peered":"2023-11-27T22:29:38.663854+0000","last_unstale":"2023-11-27T22:29:40.978023+0000","last_undegraded":"2023-11-27T22:29:40.978023+0000","last_fullsized":"2023-11-27T22:29:40.978023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:54.043640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638533+0000","last_change":"2023-11-27T22:29:39.645029+0000","last_active":"2023-11-27T22:29:40.638533+0000","last_peered":"2023-11-27T22:29:40.638533+0000","last_clean":"2023-11-27T22:29:40.638533+0000","last_became_active":"2023-11-27T22:29:39.644767+0000","last_became_peered":"2023-11-27T22:29:39.644767+0000","last_unstale":"2023-11-27T22:29:40.638533+0000","last_undegraded":"2023-11-27T22:29:40.638533+0000","last_fullsized":"2023-11-27T22:29:40.638533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977545+0000","last_change":"2023-11-27T22:29:38.655124+0000","last_active":"2023-11-27T22:29:40.977545+0000","last_peered":"2023-11-27T22:29:40.977545+0000","last_clean":"2023-11-27T22:29:40.977545+0000","last_became_active":"2023-11-27T22:29:38.654557+0000","last_became_peered":"2023-11-27T22:29:38.654557+0000","last_unstale":"2023-11-27T22:29:40.977545+0000","last_undegraded":"2023-11-27T22:29:40.977545+0000","last_fullsized":"2023-11-27T22:29:40.977545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637851+0000","last_change":"2023-11-27T22:29:39.654319+0000","last_active":"2023-11-27T22:29:40.637851+0000","last_peered":"2023-11-27T22:29:40.637851+0000","last_clean":"2023-11-27T22:29:40.637851+0000","last_became_active":"2023-11-27T22:29:39.654060+0000","last_became_peered":"2023-11-27T22:29:39.654060+0000","last_unstale":"2023-11-27T22:29:40.637851+0000","last_undegraded":"2023-11-27T22:29:40.637851+0000","last_fullsized":"2023-11-27T22:29:40.637851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637133+0000","last_change":"2023-11-27T22:29:38.662202+0000","last_active":"2023-11-27T22:29:40.637133+0000","last_peered":"2023-11-27T22:29:40.637133+0000","last_clean":"2023-11-27T22:29:40.637133+0000","last_became_active":"2023-11-27T22:29:38.661712+0000","last_became_peered":"2023-11-27T22:29:38.661712+0000","last_unstale":"2023-11-27T22:29:40.637133+0000","last_undegraded":"2023-11-27T22:29:40.637133+0000","last_fullsized":"2023-11-27T22:29:40.637133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136678+0000","last_change":"2023-11-27T22:29:39.643007+0000","last_active":"2023-11-27T22:29:41.136678+0000","last_peered":"2023-11-27T22:29:41.136678+0000","last_clean":"2023-11-27T22:29:41.136678+0000","last_became_active":"2023-11-27T22:29:39.642647+0000","last_became_peered":"2023-11-27T22:29:39.642647+0000","last_unstale":"2023-11-27T22:29:41.136678+0000","last_undegraded":"2023-11-27T22:29:41.136678+0000","last_fullsized":"2023-11-27T22:29:41.136678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:17.415595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977837+0000","last_change":"2023-11-27T22:29:38.664234+0000","last_active":"2023-11-27T22:29:40.977837+0000","last_peered":"2023-11-27T22:29:40.977837+0000","last_clean":"2023-11-27T22:29:40.977837+0000","last_became_active":"2023-11-27T22:29:38.663863+0000","last_became_peered":"2023-11-27T22:29:38.663863+0000","last_unstale":"2023-11-27T22:29:40.977837+0000","last_undegraded":"2023-11-27T22:29:40.977837+0000","last_fullsized":"2023-11-27T22:29:40.977837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:41:16.410748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137919+0000","last_change":"2023-11-27T22:29:39.644164+0000","last_active":"2023-11-27T22:29:41.137919+0000","last_peered":"2023-11-27T22:29:41.137919+0000","last_clean":"2023-11-27T22:29:41.137919+0000","last_became_active":"2023-11-27T22:29:39.643326+0000","last_became_peered":"2023-11-27T22:29:39.643326+0000","last_unstale":"2023-11-27T22:29:41.137919+0000","last_undegraded":"2023-11-27T22:29:41.137919+0000","last_fullsized":"2023-11-27T22:29:41.137919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:14:32.905399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638480+0000","last_change":"2023-11-27T22:29:38.659399+0000","last_active":"2023-11-27T22:29:40.638480+0000","last_peered":"2023-11-27T22:29:40.638480+0000","last_clean":"2023-11-27T22:29:40.638480+0000","last_became_active":"2023-11-27T22:29:38.659105+0000","last_became_peered":"2023-11-27T22:29:38.659105+0000","last_unstale":"2023-11-27T22:29:40.638480+0000","last_undegraded":"2023-11-27T22:29:40.638480+0000","last_fullsized":"2023-11-27T22:29:40.638480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:38.851171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637606+0000","last_change":"2023-11-27T22:29:39.646130+0000","last_active":"2023-11-27T22:29:40.637606+0000","last_peered":"2023-11-27T22:29:40.637606+0000","last_clean":"2023-11-27T22:29:40.637606+0000","last_became_active":"2023-11-27T22:29:39.645883+0000","last_became_peered":"2023-11-27T22:29:39.645883+0000","last_unstale":"2023-11-27T22:29:40.637606+0000","last_undegraded":"2023-11-27T22:29:40.637606+0000","last_fullsized":"2023-11-27T22:29:40.637606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:06:19.551755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.638459+0000","last_change":"2023-11-27T22:29:38.660518+0000","last_active":"2023-11-27T22:29:40.638459+0000","last_peered":"2023-11-27T22:29:40.638459+0000","last_clean":"2023-11-27T22:29:40.638459+0000","last_became_active":"2023-11-27T22:29:38.660266+0000","last_became_peered":"2023-11-27T22:29:38.660266+0000","last_unstale":"2023-11-27T22:29:40.638459+0000","last_undegraded":"2023-11-27T22:29:40.638459+0000","last_fullsized":"2023-11-27T22:29:40.638459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637857+0000","last_change":"2023-11-27T22:29:39.651820+0000","last_active":"2023-11-27T22:29:40.637857+0000","last_peered":"2023-11-27T22:29:40.637857+0000","last_clean":"2023-11-27T22:29:40.637857+0000","last_became_active":"2023-11-27T22:29:39.651526+0000","last_became_peered":"2023-11-27T22:29:39.651526+0000","last_unstale":"2023-11-27T22:29:40.637857+0000","last_undegraded":"2023-11-27T22:29:40.637857+0000","last_fullsized":"2023-11-27T22:29:40.637857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:29:29.857639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977936+0000","last_change":"2023-11-27T22:29:38.665243+0000","last_active":"2023-11-27T22:29:40.977936+0000","last_peered":"2023-11-27T22:29:40.977936+0000","last_clean":"2023-11-27T22:29:40.977936+0000","last_became_active":"2023-11-27T22:29:38.664972+0000","last_became_peered":"2023-11-27T22:29:38.664972+0000","last_unstale":"2023-11-27T22:29:40.977936+0000","last_undegraded":"2023-11-27T22:29:40.977936+0000","last_fullsized":"2023-11-27T22:29:40.977936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:25.227744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.636882+0000","last_change":"2023-11-27T22:29:39.645449+0000","last_active":"2023-11-27T22:29:40.636882+0000","last_peered":"2023-11-27T22:29:40.636882+0000","last_clean":"2023-11-27T22:29:40.636882+0000","last_became_active":"2023-11-27T22:29:39.645168+0000","last_became_peered":"2023-11-27T22:29:39.645168+0000","last_unstale":"2023-11-27T22:29:40.636882+0000","last_undegraded":"2023-11-27T22:29:40.636882+0000","last_fullsized":"2023-11-27T22:29:40.636882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:55:26.232591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.137381+0000","last_change":"2023-11-27T22:29:39.646245+0000","last_active":"2023-11-27T22:29:41.137381+0000","last_peered":"2023-11-27T22:29:41.137381+0000","last_clean":"2023-11-27T22:29:41.137381+0000","last_became_active":"2023-11-27T22:29:39.645965+0000","last_became_peered":"2023-11-27T22:29:39.645965+0000","last_unstale":"2023-11-27T22:29:41.137381+0000","last_undegraded":"2023-11-27T22:29:41.137381+0000","last_fullsized":"2023-11-27T22:29:41.137381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:53:11.929192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977950+0000","last_change":"2023-11-27T22:29:38.663026+0000","last_active":"2023-11-27T22:29:40.977950+0000","last_peered":"2023-11-27T22:29:40.977950+0000","last_clean":"2023-11-27T22:29:40.977950+0000","last_became_active":"2023-11-27T22:29:38.662621+0000","last_became_peered":"2023-11-27T22:29:38.662621+0000","last_unstale":"2023-11-27T22:29:40.977950+0000","last_undegraded":"2023-11-27T22:29:40.977950+0000","last_fullsized":"2023-11-27T22:29:40.977950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:44:50.627719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.138386+0000","last_change":"2023-11-27T22:29:39.646947+0000","last_active":"2023-11-27T22:29:41.138386+0000","last_peered":"2023-11-27T22:29:41.138386+0000","last_clean":"2023-11-27T22:29:41.138386+0000","last_became_active":"2023-11-27T22:29:39.646670+0000","last_became_peered":"2023-11-27T22:29:39.646670+0000","last_unstale":"2023-11-27T22:29:41.138386+0000","last_undegraded":"2023-11-27T22:29:41.138386+0000","last_fullsized":"2023-11-27T22:29:41.138386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:33:27.041102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.977999+0000","last_change":"2023-11-27T22:29:38.667974+0000","last_active":"2023-11-27T22:29:40.977999+0000","last_peered":"2023-11-27T22:29:40.977999+0000","last_clean":"2023-11-27T22:29:40.977999+0000","last_became_active":"2023-11-27T22:29:38.667716+0000","last_became_peered":"2023-11-27T22:29:38.667716+0000","last_unstale":"2023-11-27T22:29:40.977999+0000","last_undegraded":"2023-11-27T22:29:40.977999+0000","last_fullsized":"2023-11-27T22:29:40.977999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:34:36.741167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:41.136640+0000","last_change":"2023-11-27T22:29:39.648535+0000","last_active":"2023-11-27T22:29:41.136640+0000","last_peered":"2023-11-27T22:29:41.136640+0000","last_clean":"2023-11-27T22:29:41.136640+0000","last_became_active":"2023-11-27T22:29:39.648270+0000","last_became_peered":"2023-11-27T22:29:39.648270+0000","last_unstale":"2023-11-27T22:29:41.136640+0000","last_undegraded":"2023-11-27T22:29:41.136640+0000","last_fullsized":"2023-11-27T22:29:41.136640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:08:55.048487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637713+0000","last_change":"2023-11-27T22:29:38.663189+0000","last_active":"2023-11-27T22:29:40.637713+0000","last_peered":"2023-11-27T22:29:40.637713+0000","last_clean":"2023-11-27T22:29:40.637713+0000","last_became_active":"2023-11-27T22:29:38.662886+0000","last_became_peered":"2023-11-27T22:29:38.662886+0000","last_unstale":"2023-11-27T22:29:40.637713+0000","last_undegraded":"2023-11-27T22:29:40.637713+0000","last_fullsized":"2023-11-27T22:29:40.637713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:30:18.445401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.637686+0000","last_change":"2023-11-27T22:29:39.656710+0000","last_active":"2023-11-27T22:29:40.637686+0000","last_peered":"2023-11-27T22:29:40.637686+0000","last_clean":"2023-11-27T22:29:40.637686+0000","last_became_active":"2023-11-27T22:29:39.656469+0000","last_became_peered":"2023-11-27T22:29:39.656469+0000","last_unstale":"2023-11-27T22:29:40.637686+0000","last_undegraded":"2023-11-27T22:29:40.637686+0000","last_fullsized":"2023-11-27T22:29:40.637686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:38.638775+0000","last_clean_scrub_stamp":"2023-11-27T22:29:38.638775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:44:24.748432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T22:29:40.978528+0000","last_change":"2023-11-27T22:29:38.661665+0000","last_active":"2023-11-27T22:29:40.978528+0000","last_peered":"2023-11-27T22:29:40.978528+0000","last_clean":"2023-11-27T22:29:40.978528+0000","last_became_active":"2023-11-27T22:29:38.661369+0000","last_became_peered":"2023-11-27T22:29:38.661369+0000","last_unstale":"2023-11-27T22:29:40.978528+0000","last_undegraded":"2023-11-27T22:29:40.978528+0000","last_fullsized":"2023-11-27T22:29:40.978528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:37.633928+0000","last_clean_scrub_stamp":"2023-11-27T22:29:37.633928+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:47.626799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:29:55.487 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T22:29:55.488 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-27T22:29:55.488 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-27T22:29:55.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-27T22:29:55.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.618+0000 7f43bcc09640 1 Processor -- start 2023-11-27T22:29:55.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.618+0000 7f43bcc09640 1 -- start start 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43bcc09640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43b8143490 0x7f43b80b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43bcc09640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f43b815abf0 0x7f43b80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43bcc09640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b815e2a0 con 0x7f43b815e730 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43bcc09640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b815b520 con 0x7f43b8143490 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43bcc09640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b8143870 con 0x7f43b815abf0 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43b8143490 0x7f43b80b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f43b8143490 0x7f43b80b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53524/0 (socket says 172.21.15.154:53524) 2023-11-27T22:29:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 -- 172.21.15.154:0/1510331079 learned_addr learned my addr 172.21.15.154:0/1510331079 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b6d9d640 1 --2- 172.21.15.154:0/1510331079 >> v2:172.21.15.194:3300/0 conn(0x7f43b815abf0 0x7f43b80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 -- 172.21.15.154:0/1510331079 >> v2:172.21.15.194:3300/0 conn(0x7f43b815abf0 msgr2=0x7f43b80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 --2- 172.21.15.154:0/1510331079 >> v2:172.21.15.194:3300/0 conn(0x7f43b815abf0 0x7f43b80b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 -- 172.21.15.154:0/1510331079 >> v1:172.21.15.194:6789/0 conn(0x7f43b815e730 legacy=0x7f43b815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:55.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.619+0000 7f43b659c640 1 -- 172.21.15.154:0/1510331079 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b815b240 con 0x7f43b8143490 2023-11-27T22:29:55.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.620+0000 7f43b659c640 1 --2- 172.21.15.154:0/1510331079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8143490 0x7f43b80b0cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43b80b4ca0 tx=0x7f43a802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1460b453603b3131 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.620+0000 7f43b559a640 1 -- 172.21.15.154:0/1510331079 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a802ee90 con 0x7f43b8143490 2023-11-27T22:29:55.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.620+0000 7f43b559a640 1 -- 172.21.15.154:0/1510331079 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8036440 con 0x7f43b8143490 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.620+0000 7f43b559a640 1 -- 172.21.15.154:0/1510331079 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80367d0 con 0x7f43b8143490 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.620+0000 7f43bcc09640 1 -- 172.21.15.154:0/1510331079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8143490 msgr2=0x7f43b80b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.620+0000 7f43bcc09640 1 --2- 172.21.15.154:0/1510331079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8143490 0x7f43b80b0cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43b80b4ca0 tx=0x7f43a802e0e0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.621+0000 7f43bcc09640 1 -- 172.21.15.154:0/1510331079 shutdown_connections 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.621+0000 7f43bcc09640 1 --2- 172.21.15.154:0/1510331079 >> v2:172.21.15.194:3300/0 conn(0x7f43b815abf0 0x7f43b80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.621+0000 7f43bcc09640 1 --2- 172.21.15.154:0/1510331079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b8143490 0x7f43b80b0cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.621+0000 7f43bcc09640 1 -- 172.21.15.154:0/1510331079 >> 172.21.15.154:0/1510331079 conn(0x7f43b806a4d0 msgr2=0x7f43b806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.621+0000 7f43bcc09640 1 -- 172.21.15.154:0/1510331079 shutdown_connections 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.621+0000 7f43bcc09640 1 -- 172.21.15.154:0/1510331079 wait complete. 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.622+0000 7f43bcc09640 1 Processor -- start 2023-11-27T22:29:55.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.622+0000 7f43bcc09640 1 -- start start 2023-11-27T22:29:55.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b8143490 0x7f43b8140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b815abf0 0x7f43b813baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 0x7f43b813f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b813db60 con 0x7f43b815e730 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b80afd60 con 0x7f43b815abf0 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b813c030 con 0x7f43b8143490 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 0x7f43b813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 0x7f43b813f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53538/0 (socket says 172.21.15.154:53538) 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 -- 172.21.15.154:0/2748199102 learned_addr learned my addr 172.21.15.154:0/2748199102 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b5d9b640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b815abf0 0x7f43b813baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b659c640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b8143490 0x7f43b8140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 -- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b8143490 msgr2=0x7f43b8140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b8143490 0x7f43b8140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 -- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b815abf0 msgr2=0x7f43b813baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b815abf0 0x7f43b813baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 -- 172.21.15.154:0/2748199102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a800b770 con 0x7f43b815e730 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43b6d9d640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 0x7f43b813f170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f43b000cd70 tx=0x7f43b000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0003b90 con 0x7f43b815e730 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b0003cf0 con 0x7f43b815e730 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b813f6b0 con 0x7f43b815e730 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b0004240 con 0x7f43b815e730 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.623+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b8141020 con 0x7f43b815e730 2023-11-27T22:29:55.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.624+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80b4380 con 0x7f43b815e730 2023-11-27T22:29:55.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.625+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f43b00043a0 con 0x7f43b815e730 2023-11-27T22:29:55.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.625+0000 7f43a6ffd640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f439806b1c0 0x7f439806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.625+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43b0012070 con 0x7f43b815e730 2023-11-27T22:29:55.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.625+0000 7f43b659c640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f439806b1c0 0x7f439806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.625+0000 7f43b659c640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f439806b1c0 0x7f439806d680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43a8038000 tx=0x7f43a8032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.629+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f43b00550f0 con 0x7f43b815e730 2023-11-27T22:29:55.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.836+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f43b80afed0 con 0x7f43b815e730 2023-11-27T22:29:55.838 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.836+0000 7f43a6ffd640 1 -- 172.21.15.154:0/2748199102 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f43b0058710 con 0x7f43b815e730 2023-11-27T22:29:55.838 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:55.838 INFO:teuthology.orchestra.run.smithi154.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-27T22:29:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f439806b1c0 msgr2=0x7f439806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f439806b1c0 0x7f439806d680 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43a8038000 tx=0x7f43a8032000 comp rx=0 tx=0).stop 2023-11-27T22:29:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 msgr2=0x7f43b813f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 0x7f43b813f170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f43b000cd70 tx=0x7f43b000a660 comp rx=0 tx=0).stop 2023-11-27T22:29:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 shutdown_connections 2023-11-27T22:29:55.840 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b815abf0 0x7f43b813baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f439806b1c0 0x7f439806d680 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43b815e730 0x7f43b813f170 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 --2- 172.21.15.154:0/2748199102 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b8143490 0x7f43b8140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 >> 172.21.15.154:0/2748199102 conn(0x7f43b806a4d0 msgr2=0x7f43b80cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 shutdown_connections 2023-11-27T22:29:55.841 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.838+0000 7f43bcc09640 1 -- 172.21.15.154:0/2748199102 wait complete. 2023-11-27T22:29:55.851 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-27T22:29:55.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:55.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.950+0000 7fe204d53640 1 Processor -- start 2023-11-27T22:29:55.952 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.950+0000 7fe204d53640 1 -- start start 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe204d53640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe2000b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe204d53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2000b3390 0x7fe20015d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe204d53640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe200150940 0x7fe20015d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe204d53640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000b49f0 con 0x7fe2000b3390 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe204d53640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000b3de0 con 0x7fe200150940 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe204d53640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000b40c0 con 0x7fe200150560 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2000b3390 0x7fe20015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2000b3390 0x7fe20015d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53546/0 (socket says 172.21.15.154:53546) 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 -- 172.21.15.154:0/3547308482 learned_addr learned my addr 172.21.15.154:0/3547308482 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1fe59c640 1 --2- 172.21.15.154:0/3547308482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe2000b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1fed9d640 1 --2- 172.21.15.154:0/3547308482 >> v2:172.21.15.194:3300/0 conn(0x7fe200150940 0x7fe20015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 -- 172.21.15.154:0/3547308482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 msgr2=0x7fe2000b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 --2- 172.21.15.154:0/3547308482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe2000b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 -- 172.21.15.154:0/3547308482 >> v2:172.21.15.194:3300/0 conn(0x7fe200150940 msgr2=0x7fe20015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 --2- 172.21.15.154:0/3547308482 >> v2:172.21.15.194:3300/0 conn(0x7fe200150940 0x7fe20015d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.951+0000 7fe1f7fff640 1 -- 172.21.15.154:0/3547308482 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000b43a0 con 0x7fe2000b3390 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.952+0000 7fe1f7fff640 1 --2- 172.21.15.154:0/3547308482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe20015d200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2000aec00 tx=0x7fe1e802cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2538f480e7cab0b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.952+0000 7fe1fdd9b640 1 -- 172.21.15.154:0/3547308482 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e802dba0 con 0x7fe2000b3390 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.952+0000 7fe1fdd9b640 1 -- 172.21.15.154:0/3547308482 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e802dd00 con 0x7fe2000b3390 2023-11-27T22:29:55.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.952+0000 7fe1fdd9b640 1 -- 172.21.15.154:0/3547308482 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8035660 con 0x7fe2000b3390 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 -- 172.21.15.154:0/3547308482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 msgr2=0x7fe20015d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 --2- 172.21.15.154:0/3547308482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe20015d200 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2000aec00 tx=0x7fe1e802cdf0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 -- 172.21.15.154:0/3547308482 shutdown_connections 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 --2- 172.21.15.154:0/3547308482 >> v2:172.21.15.194:3300/0 conn(0x7fe200150940 0x7fe20015d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 --2- 172.21.15.154:0/3547308482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe20015d200 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 --2- 172.21.15.154:0/3547308482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe2000b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 -- 172.21.15.154:0/3547308482 >> 172.21.15.154:0/3547308482 conn(0x7fe20006a4d0 msgr2=0x7fe20006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:55.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 -- 172.21.15.154:0/3547308482 shutdown_connections 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.953+0000 7fe204d53640 1 -- 172.21.15.154:0/3547308482 wait complete. 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.954+0000 7fe204d53640 1 Processor -- start 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.954+0000 7fe204d53640 1 -- start start 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe204d53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe200145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe204d53640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe200070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe204d53640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe200071070 0x7fe2001561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe204d53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe200071500 con 0x7fe2000b3390 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe204d53640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe200151e20 con 0x7fe200071070 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe204d53640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe200152100 con 0x7fe200150560 2023-11-27T22:29:55.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe200145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe200145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53560/0 (socket says 172.21.15.154:53560) 2023-11-27T22:29:55.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 -- 172.21.15.154:0/429428574 learned_addr learned my addr 172.21.15.154:0/429428574 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:55.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fed9d640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe200071070 0x7fe2001561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1f7fff640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe200070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 -- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 msgr2=0x7fe200070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe200070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 -- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe200071070 msgr2=0x7fe2001561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe200071070 0x7fe2001561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 -- 172.21.15.154:0/429428574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e800a670 con 0x7fe2000b3390 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.955+0000 7fe1fe59c640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe200145900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000d800 tx=0x7fe1f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.956+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000b6c0 con 0x7fe2000b3390 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.956+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000b820 con 0x7fe2000b3390 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.956+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2001523e0 con 0x7fe2000b3390 2023-11-27T22:29:55.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.956+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000bbb0 con 0x7fe2000b3390 2023-11-27T22:29:55.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.956+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2001566f0 con 0x7fe2000b3390 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.957+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200069400 con 0x7fe2000b3390 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.957+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe1f000bd10 con 0x7fe2000b3390 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.957+0000 7fe1f6ffd640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e006b1c0 0x7fe1e006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.957+0000 7fe1f7fff640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e006b1c0 0x7fe1e006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.958+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1f0089f50 con 0x7fe2000b3390 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.958+0000 7fe1f7fff640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e006b1c0 0x7fe1e006d680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8037000 tx=0x7fe1e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:55.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:55.962+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe1f0054d10 con 0x7fe2000b3390 2023-11-27T22:29:56.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.130+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2000ce9a0 con 0x7fe2000b3390 2023-11-27T22:29:56.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.131+0000 7fe1f6ffd640 1 -- 172.21.15.154:0/429428574 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fe1f0058330 con 0x7fe2000b3390 2023-11-27T22:29:56.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:56.133 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:56.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e006b1c0 msgr2=0x7fe1e006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e006b1c0 0x7fe1e006d680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8037000 tx=0x7fe1e8008040 comp rx=0 tx=0).stop 2023-11-27T22:29:56.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 msgr2=0x7fe200145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe200145900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000d800 tx=0x7fe1f000dcc0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 shutdown_connections 2023-11-27T22:29:56.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe200071070 0x7fe2001561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e006b1c0 0x7fe1e006d680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe200150560 0x7fe200070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 --2- 172.21.15.154:0/429428574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2000b3390 0x7fe200145900 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 >> 172.21.15.154:0/429428574 conn(0x7fe20006a4d0 msgr2=0x7fe2000b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:56.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 shutdown_connections 2023-11-27T22:29:56.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.133+0000 7fe204d53640 1 -- 172.21.15.154:0/429428574 wait complete. 2023-11-27T22:29:56.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:29:56.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:29:56.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.249+0000 7f09585ce640 1 Processor -- start 2023-11-27T22:29:56.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.249+0000 7f09585ce640 1 -- start start 2023-11-27T22:29:56.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f09585ce640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0950140310 0x7f09501618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f09585ce640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f095006abe0 0x7f095006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f09585ce640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09501406f0 con 0x7f09501409d0 2023-11-27T22:29:56.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f09585ce640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0950161e20 con 0x7f095006abe0 2023-11-27T22:29:56.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f09585ce640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0950143960 con 0x7f0950140310 2023-11-27T22:29:56.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f095006abe0 0x7f095006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f095006abe0 0x7f095006efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53574/0 (socket says 172.21.15.154:53574) 2023-11-27T22:29:56.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 -- 172.21.15.154:0/4025315486 learned_addr learned my addr 172.21.15.154:0/4025315486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:56.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f095636a640 1 --2- 172.21.15.154:0/4025315486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0950140310 0x7f09501618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 -- 172.21.15.154:0/4025315486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0950140310 msgr2=0x7f09501618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 --2- 172.21.15.154:0/4025315486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0950140310 0x7f09501618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 -- 172.21.15.154:0/4025315486 >> v1:172.21.15.194:6789/0 conn(0x7f09501409d0 legacy=0x7f095006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.250+0000 7f0956b6b640 1 -- 172.21.15.154:0/4025315486 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950142de0 con 0x7f095006abe0 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.251+0000 7f0956b6b640 1 --2- 172.21.15.154:0/4025315486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095006abe0 0x7f095006efb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0950161f60 tx=0x7f094802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a726c6aa28e123c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.251+0000 7f0955368640 1 -- 172.21.15.154:0/4025315486 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480317c0 con 0x7f095006abe0 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.251+0000 7f0955368640 1 -- 172.21.15.154:0/4025315486 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0948031920 con 0x7f095006abe0 2023-11-27T22:29:56.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.251+0000 7f0955368640 1 -- 172.21.15.154:0/4025315486 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948031cb0 con 0x7f095006abe0 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 -- 172.21.15.154:0/4025315486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095006abe0 msgr2=0x7f095006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 --2- 172.21.15.154:0/4025315486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095006abe0 0x7f095006efb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0950161f60 tx=0x7f094802b860 comp rx=0 tx=0).stop 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 -- 172.21.15.154:0/4025315486 shutdown_connections 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 --2- 172.21.15.154:0/4025315486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095006abe0 0x7f095006efb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 --2- 172.21.15.154:0/4025315486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0950140310 0x7f09501618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 -- 172.21.15.154:0/4025315486 >> 172.21.15.154:0/4025315486 conn(0x7f09500b1e50 msgr2=0x7f09500b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 -- 172.21.15.154:0/4025315486 shutdown_connections 2023-11-27T22:29:56.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.252+0000 7f09585ce640 1 -- 172.21.15.154:0/4025315486 wait complete. 2023-11-27T22:29:56.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.253+0000 7f09585ce640 1 Processor -- start 2023-11-27T22:29:56.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.253+0000 7f09585ce640 1 -- start start 2023-11-27T22:29:56.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f095006abe0 0x7f095013fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0950140310 0x7f09501580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 0x7f0950158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501551e0 con 0x7f09501409d0 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950155d20 con 0x7f0950140310 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0950153dc0 con 0x7f095006abe0 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 0x7f0950158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 0x7f0950158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53582/0 (socket says 172.21.15.154:53582) 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 -- 172.21.15.154:0/910593677 learned_addr learned my addr 172.21.15.154:0/910593677 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f095636a640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f095006abe0 0x7f095013fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0955b69640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0950140310 0x7f09501580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.261 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 -- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f095006abe0 msgr2=0x7f095013fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f095006abe0 0x7f095013fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 -- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0950140310 msgr2=0x7f09501580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0950140310 0x7f09501580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 -- 172.21.15.154:0/910593677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480094d0 con 0x7f09501409d0 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0956b6b640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 0x7f0950158600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f09480090b0 tx=0x7f09480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480329a0 con 0x7f09501409d0 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0948032b20 con 0x7f09501409d0 2023-11-27T22:29:56.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09500adae0 con 0x7f09501409d0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.254+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480453f0 con 0x7f09501409d0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.255+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09501556d0 con 0x7f09501409d0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.255+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09500ad1e0 con 0x7f09501409d0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.256+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f094804d3f0 con 0x7f09501409d0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.256+0000 7f0946ffd640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f093406b1c0 0x7f093406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.256+0000 7f095636a640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f093406b1c0 0x7f093406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.256+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09480ab990 con 0x7f09501409d0 2023-11-27T22:29:56.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.257+0000 7f095636a640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f093406b1c0 0x7f093406d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f094c0070b0 tx=0x7f094c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.261+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0948076750 con 0x7f09501409d0 2023-11-27T22:29:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.426+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f095004ed60 con 0x7f09501409d0 2023-11-27T22:29:56.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.427+0000 7f0946ffd640 1 -- 172.21.15.154:0/910593677 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0948079d70 con 0x7f09501409d0 2023-11-27T22:29:56.429 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:29:56.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.428+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f093406b1c0 msgr2=0x7f093406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.428+0000 7f09585ce640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f093406b1c0 0x7f093406d680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f094c0070b0 tx=0x7f094c007040 comp rx=0 tx=0).stop 2023-11-27T22:29:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.428+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 msgr2=0x7f0950158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.428+0000 7f09585ce640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 0x7f0950158600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f09480090b0 tx=0x7f09480046c0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 shutdown_connections 2023-11-27T22:29:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0950140310 0x7f09501580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f093406b1c0 0x7f093406d680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f09501409d0 0x7f0950158600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 --2- 172.21.15.154:0/910593677 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f095006abe0 0x7f095013fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 >> 172.21.15.154:0/910593677 conn(0x7f09500b1e50 msgr2=0x7f095015e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 shutdown_connections 2023-11-27T22:29:56.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.429+0000 7f09585ce640 1 -- 172.21.15.154:0/910593677 wait complete. 2023-11-27T22:29:56.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:29:56.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.542+0000 7f3f8ad6e640 1 Processor -- start 2023-11-27T22:29:56.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.542+0000 7f3f8ad6e640 1 -- start start 2023-11-27T22:29:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.543+0000 7f3f8ad6e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f840d2910 0x7f3f840d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.543+0000 7f3f8ad6e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840b2b10 con 0x7f3f8415d330 2023-11-27T22:29:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.543+0000 7f3f8ad6e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f840d1590 con 0x7f3f840d3730 2023-11-27T22:29:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.543+0000 7f3f8ad6e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f840d3bc0 con 0x7f3f840d2910 2023-11-27T22:29:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.543+0000 7f3f88b0a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3f8415d330 0x7f3f840b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41382/0 (socket says 172.21.15.154:41382) 2023-11-27T22:29:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.543+0000 7f3f88b0a640 1 -- 172.21.15.154:0/254018637 learned_addr learned my addr 172.21.15.154:0/254018637 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f83fff640 1 --2- 172.21.15.154:0/254018637 >> v2:172.21.15.194:3300/0 conn(0x7f3f840d2910 0x7f3f840d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966323637 0 0) 0x7f3f840b2b10 con 0x7f3f8415d330 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f6c003520 con 0x7f3f8415d330 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3646179518 0 0) 0x7f3f6c003520 con 0x7f3f8415d330 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 >> v2:172.21.15.194:3300/0 conn(0x7f3f840d2910 msgr2=0x7f3f840d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 --2- 172.21.15.154:0/254018637 >> v2:172.21.15.194:3300/0 conn(0x7f3f840d2910 0x7f3f840d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 >> v1:172.21.15.194:6789/0 conn(0x7f3f840d3730 legacy=0x7f3f840b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f840d1870 con 0x7f3f8415d330 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f3f74001670 con 0x7f3f8415d330 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 >> v1:172.21.15.154:6789/0 conn(0x7f3f8415d330 legacy=0x7f3f840b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c0052a0 0x7f3f6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840d3bc0 con 0x7f3f6c003970 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00c170 con 0x7f3f6c0052a0 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00c330 con 0x7f3f6c0047c0 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f83fff640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f8930b640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c0052a0 0x7f3f6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f88b0a640 1 -- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f6c0047c0 msgr2=0x7f3f6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f88b0a640 1 -- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c0052a0 msgr2=0x7f3f6c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c0052a0 0x7f3f6c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f8930b640 1 -- 172.21.15.154:0/254018637 reap_dead start 2023-11-27T22:29:56.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.544+0000 7f3f88b0a640 1 -- 172.21.15.154:0/254018637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c003520 con 0x7f3f6c003970 2023-11-27T22:29:56.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.545+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f6c003d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400c210 tx=0x7f3f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6457e319fac868d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.545+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74005ad0 con 0x7f3f6c003970 2023-11-27T22:29:56.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.545+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74005c30 con 0x7f3f6c003970 2023-11-27T22:29:56.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.545+0000 7f3f837fe640 1 -- 172.21.15.154:0/254018637 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7402cad0 con 0x7f3f6c003970 2023-11-27T22:29:56.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/254018637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 msgr2=0x7f3f6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f6c003d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3f7400c210 tx=0x7f3f6c0057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/254018637 shutdown_connections 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/254018637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f6c003d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/254018637 >> 172.21.15.154:0/254018637 conn(0x7f3f84072020 msgr2=0x7f3f84072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/254018637 shutdown_connections 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.546+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/254018637 wait complete. 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.547+0000 7f3f8ad6e640 1 Processor -- start 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.547+0000 7f3f8ad6e640 1 -- start start 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f84156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8415e760 0x7f3f8415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f840ccae0 0x7f3f840ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f841568a0 con 0x7f3f6c003970 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f840cd4a0 con 0x7f3f8415e760 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8415fee0 con 0x7f3f840ccae0 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f84156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f84156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53594/0 (socket says 172.21.15.154:53594) 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 -- 172.21.15.154:0/1545862575 learned_addr learned my addr 172.21.15.154:0/1545862575 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 -- 172.21.15.154:0/1545862575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f840ccae0 msgr2=0x7f3f840ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f840ccae0 0x7f3f840ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 -- 172.21.15.154:0/1545862575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8415e760 msgr2=0x7f3f8415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8415e760 0x7f3f8415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 -- 172.21.15.154:0/1545862575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8415f2d0 con 0x7f3f6c003970 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f88b0a640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f84156360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402c430 tx=0x7f3f7402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7403c040 con 0x7f3f6c003970 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7402cca0 con 0x7f3f6c003970 2023-11-27T22:29:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8415f5b0 con 0x7f3f6c003970 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740072b0 con 0x7f3f6c003970 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.548+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8415fb70 con 0x7f3f6c003970 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.549+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f84069400 con 0x7f3f6c003970 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.550+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3f74032070 con 0x7f3f6c003970 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.550+0000 7f3f817fa640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3f7006b1c0 0x7f3f7006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.550+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f740aab20 con 0x7f3f6c003970 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.550+0000 7f3f83fff640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3f7006b1c0 0x7f3f7006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.551+0000 7f3f83fff640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3f7006b1c0 0x7f3f7006d680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f78006a90 tx=0x7f3f78006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.554+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3f74075850 con 0x7f3f6c003970 2023-11-27T22:29:56.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.724+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f840b2210 con 0x7f3f6c003970 2023-11-27T22:29:56.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.724+0000 7f3f817fa640 1 -- 172.21.15.154:0/1545862575 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f740450a0 con 0x7f3f6c003970 2023-11-27T22:29:56.726 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:29:56.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3f7006b1c0 msgr2=0x7f3f7006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3f7006b1c0 0x7f3f7006d680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f78006a90 tx=0x7f3f78006a20 comp rx=0 tx=0).stop 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 msgr2=0x7f3f84156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f84156360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f7402c430 tx=0x7f3f7402e070 comp rx=0 tx=0).stop 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 shutdown_connections 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f8415e760 0x7f3f8415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3f7006b1c0 0x7f3f7006d680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f840ccae0 0x7f3f840ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 --2- 172.21.15.154:0/1545862575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3f6c003970 0x7f3f84156360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.726+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 >> 172.21.15.154:0/1545862575 conn(0x7f3f84072020 msgr2=0x7f3f840c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.727+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 shutdown_connections 2023-11-27T22:29:56.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.727+0000 7f3f8ad6e640 1 -- 172.21.15.154:0/1545862575 wait complete. 2023-11-27T22:29:56.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:29:56.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.841+0000 7fafaebe5640 1 Processor -- start 2023-11-27T22:29:56.843 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.841+0000 7fafaebe5640 1 -- start start 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafaebe5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fafa806abe0 0x7fafa81618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafaebe5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa81406f0 con 0x7fafa81409d0 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafaebe5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa8143960 con 0x7fafa8140310 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafaebe5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa8161e20 con 0x7fafa806abe0 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafa7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fafa806abe0 0x7fafa81618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafad182640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fafa81409d0 0x7fafa806efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41398/0 (socket says 172.21.15.154:41398) 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafad182640 1 -- 172.21.15.154:0/2836296587 learned_addr learned my addr 172.21.15.154:0/2836296587 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafa7fff640 1 -- 172.21.15.154:0/2836296587 >> v1:172.21.15.194:6789/0 conn(0x7fafa8140310 legacy=0x7fafa806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:56.844 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafa7fff640 1 -- 172.21.15.154:0/2836296587 >> v1:172.21.15.154:6789/0 conn(0x7fafa81409d0 legacy=0x7fafa806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafa7fff640 1 -- 172.21.15.154:0/2836296587 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa8142de0 con 0x7fafa806abe0 2023-11-27T22:29:56.845 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.842+0000 7fafa77fe640 1 -- 172.21.15.154:0/2836296587 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078347643 0 0) 0x7fafa81406f0 con 0x7fafa81409d0 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafa7fff640 1 --2- 172.21.15.154:0/2836296587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81618e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf940097a0 tx=0x7faf9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da344e85d750b50c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafa77fe640 1 -- 172.21.15.154:0/2836296587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9402e070 con 0x7fafa806abe0 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafa77fe640 1 -- 172.21.15.154:0/2836296587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940315a0 con 0x7fafa806abe0 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafa77fe640 1 -- 172.21.15.154:0/2836296587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94031930 con 0x7fafa806abe0 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafaebe5640 1 -- 172.21.15.154:0/2836296587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 msgr2=0x7fafa81618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafaebe5640 1 --2- 172.21.15.154:0/2836296587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81618e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf940097a0 tx=0x7faf9402b840 comp rx=0 tx=0).stop 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.843+0000 7fafaebe5640 1 -- 172.21.15.154:0/2836296587 shutdown_connections 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.844+0000 7fafaebe5640 1 --2- 172.21.15.154:0/2836296587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81618e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.844+0000 7fafaebe5640 1 -- 172.21.15.154:0/2836296587 >> 172.21.15.154:0/2836296587 conn(0x7fafa80b1e50 msgr2=0x7fafa80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:56.846 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.844+0000 7fafaebe5640 1 -- 172.21.15.154:0/2836296587 shutdown_connections 2023-11-27T22:29:56.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.844+0000 7fafaebe5640 1 -- 172.21.15.154:0/2836296587 wait complete. 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.845+0000 7fafaebe5640 1 Processor -- start 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.845+0000 7fafaebe5640 1 -- start start 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa8140310 0x7fafa80b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa81409d0 0x7fafa81f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa81f67b0 con 0x7fafa806abe0 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa80b3e90 con 0x7fafa81409d0 2023-11-27T22:29:56.849 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa81f61a0 con 0x7fafa8140310 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53624/0 (socket says 172.21.15.154:53624) 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 -- 172.21.15.154:0/3001883160 learned_addr learned my addr 172.21.15.154:0/3001883160 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafa7fff640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa8140310 0x7fafa80b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafad182640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa81409d0 0x7fafa81f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 -- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa8140310 msgr2=0x7fafa80b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa8140310 0x7fafa80b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 -- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa81409d0 msgr2=0x7fafa81f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:56.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa81409d0 0x7fafa81f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 -- 172.21.15.154:0/3001883160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009400 con 0x7fafa806abe0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafac981640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81f6c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c430 tx=0x7faf9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c011790 con 0x7fafa806abe0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0118f0 con 0x7fafa806abe0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa80b4990 con 0x7fafa806abe0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c011ce0 con 0x7fafa806abe0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.846+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa81f6440 con 0x7fafa806abe0 2023-11-27T22:29:56.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.847+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa8161030 con 0x7fafa806abe0 2023-11-27T22:29:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.848+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7faf9c01c460 con 0x7fafa806abe0 2023-11-27T22:29:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.848+0000 7fafa57fa640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7faf8c06b1f0 0x7faf8c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.848+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf9c0897c0 con 0x7fafa806abe0 2023-11-27T22:29:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.848+0000 7fafa7fff640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7faf8c06b1f0 0x7faf8c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:56.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.849+0000 7fafa7fff640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7faf8c06b1f0 0x7faf8c06d6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faf94036000 tx=0x7faf9403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:56.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:56.852+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7faf9c0545a0 con 0x7fafa806abe0 2023-11-27T22:29:57.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.019+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafa8069400 con 0x7fafa806abe0 2023-11-27T22:29:57.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.019+0000 7fafa57fa640 1 -- 172.21.15.154:0/3001883160 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf9c057bc0 con 0x7fafa806abe0 2023-11-27T22:29:57.021 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:29:57.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7faf8c06b1f0 msgr2=0x7faf8c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7faf8c06b1f0 0x7faf8c06d6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faf94036000 tx=0x7faf9403d040 comp rx=0 tx=0).stop 2023-11-27T22:29:57.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 msgr2=0x7fafa81f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81f6c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c430 tx=0x7faf9c00c8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 shutdown_connections 2023-11-27T22:29:57.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa81409d0 0x7fafa81f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7faf8c06b1f0 0x7faf8c06d6b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fafa8140310 0x7fafa80b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 --2- 172.21.15.154:0/3001883160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafa806abe0 0x7fafa81f6c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 >> 172.21.15.154:0/3001883160 conn(0x7fafa80b1e50 msgr2=0x7fafa806f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 shutdown_connections 2023-11-27T22:29:57.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.021+0000 7fafaebe5640 1 -- 172.21.15.154:0/3001883160 wait complete. 2023-11-27T22:29:57.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:29:57.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.133+0000 7fce14d33640 1 Processor -- start 2023-11-27T22:29:57.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.133+0000 7fce14d33640 1 -- start start 2023-11-27T22:29:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce14d33640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 0x7fce100ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce14d33640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce100b49f0 con 0x7fce10150560 2023-11-27T22:29:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce14d33640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce100b3560 con 0x7fce10150940 2023-11-27T22:29:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce14d33640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce100b3de0 con 0x7fce1015d910 2023-11-27T22:29:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0e59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fce10150560 0x7fce100b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41412/0 (socket says 172.21.15.154:41412) 2023-11-27T22:29:57.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0e59c640 1 -- 172.21.15.154:0/2906499534 learned_addr learned my addr 172.21.15.154:0/2906499534 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:57.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0ed9d640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 0x7fce100ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216590664 0 0) 0x7fce100b49f0 con 0x7fce10150560 2023-11-27T22:29:57.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf8003520 con 0x7fce10150560 2023-11-27T22:29:57.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 572264604 0 0) 0x7fcdf8003520 con 0x7fce10150560 2023-11-27T22:29:57.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 msgr2=0x7fce100ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 0x7fce100ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 >> v1:172.21.15.194:6789/0 conn(0x7fce10150940 legacy=0x7fce1015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100b40c0 con 0x7fce10150560 2023-11-27T22:29:57.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fce04001670 con 0x7fce10150560 2023-11-27T22:29:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 >> v1:172.21.15.154:6789/0 conn(0x7fce10150560 legacy=0x7fce100b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 0x7fcdf80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fcdf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf8004d00 0x7fcdf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100b3de0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800b9e0 con 0x7fcdf8004d00 2023-11-27T22:29:57.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf800bba0 con 0x7fce1015d910 2023-11-27T22:29:57.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fcdf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.134+0000 7fce0e59c640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 0x7fcdf80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0ed9d640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf8004d00 0x7fcdf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0dd9b640 1 -- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 msgr2=0x7fcdf80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1015d910 0x7fcdf80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0dd9b640 1 -- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf8004d00 msgr2=0x7fcdf8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf8004d00 0x7fcdf8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0dd9b640 1 -- 172.21.15.154:0/2906499534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf8003520 con 0x7fcdf8003ee0 2023-11-27T22:29:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.135+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fcdf80047c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce00001730 tx=0x7fcdf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4877700f90dfa3e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00030640 con 0x7fcdf8003ee0 2023-11-27T22:29:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce000307c0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce0d59a640 1 -- 172.21.15.154:0/2906499534 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00030b70 con 0x7fcdf8003ee0 2023-11-27T22:29:57.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce14d33640 1 -- 172.21.15.154:0/2906499534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 msgr2=0x7fcdf80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce14d33640 1 --2- 172.21.15.154:0/2906499534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fcdf80047c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce00001730 tx=0x7fcdf80057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce0ed9d640 1 -- 172.21.15.154:0/2906499534 reap_dead start 2023-11-27T22:29:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce14d33640 1 -- 172.21.15.154:0/2906499534 shutdown_connections 2023-11-27T22:29:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce14d33640 1 -- 172.21.15.154:0/2906499534 >> 172.21.15.154:0/2906499534 conn(0x7fce1006a4d0 msgr2=0x7fce1006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce14d33640 1 -- 172.21.15.154:0/2906499534 shutdown_connections 2023-11-27T22:29:57.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.136+0000 7fce14d33640 1 -- 172.21.15.154:0/2906499534 wait complete. 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.137+0000 7fce14d33640 1 Processor -- start 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 -- start start 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fce10148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce1014a130 0x7fce1014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1014a590 0x7fce1014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1014b2c0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1014ce60 con 0x7fce1014a130 2023-11-27T22:29:57.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce14d33640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce101e47c0 con 0x7fce1014a590 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce0e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fce10148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce0e59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fce10148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53642/0 (socket says 172.21.15.154:53642) 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce0e59c640 1 -- 172.21.15.154:0/722785634 learned_addr learned my addr 172.21.15.154:0/722785634 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce1014a130 0x7fce1014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce0ed9d640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1014a590 0x7fce1014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.138+0000 7fce0e59c640 1 -- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1014a590 msgr2=0x7fce1014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0e59c640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1014a590 0x7fce1014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0e59c640 1 -- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce1014a130 msgr2=0x7fce1014efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0e59c640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce1014a130 0x7fce1014efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0e59c640 1 -- 172.21.15.154:0/722785634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1014d0b0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0ed9d640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1014a590 0x7fce1014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce1014a130 0x7fce1014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce0e59c640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fce10148490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce04007290 tx=0x7fce04007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400f960 con 0x7fcdf8003ee0 2023-11-27T22:29:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0400fac0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0400fe70 con 0x7fcdf8003ee0 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1014d390 con 0x7fcdf8003ee0 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.139+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce101e3be0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.140+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce10069400 con 0x7fcdf8003ee0 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.140+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fce0401d460 con 0x7fcdf8003ee0 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.141+0000 7fcdfeffd640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcdf006b1c0 0x7fcdf006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.141+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce04089c00 con 0x7fcdf8003ee0 2023-11-27T22:29:57.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.141+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcdf006b1c0 0x7fcdf006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.141+0000 7fce0dd9b640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcdf006b1c0 0x7fcdf006d680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce00037000 tx=0x7fce00033000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.145+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fce04090080 con 0x7fcdf8003ee0 2023-11-27T22:29:57.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.345+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce100675c0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.345+0000 7fcdfeffd640 1 -- 172.21.15.154:0/722785634 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fce040548a0 con 0x7fcdf8003ee0 2023-11-27T22:29:57.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:57.348 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:29:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:29:57.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcdf006b1c0 msgr2=0x7fcdf006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcdf006b1c0 0x7fcdf006d680 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fce00037000 tx=0x7fce00033000 comp rx=0 tx=0).stop 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 msgr2=0x7fce10148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fce10148490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce04007290 tx=0x7fce04007750 comp rx=0 tx=0).stop 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 shutdown_connections 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce1014a130 0x7fce1014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcdf006b1c0 0x7fcdf006d680 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce1014a590 0x7fce1014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 --2- 172.21.15.154:0/722785634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdf8003ee0 0x7fce10148490 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 >> 172.21.15.154:0/722785634 conn(0x7fce1006a4d0 msgr2=0x7fce10070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 shutdown_connections 2023-11-27T22:29:57.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.347+0000 7fce14d33640 1 -- 172.21.15.154:0/722785634 wait complete. 2023-11-27T22:29:57.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.458+0000 7f5eaef2c640 1 Processor -- start 2023-11-27T22:29:57.460 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.458+0000 7f5eaef2c640 1 -- start start 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaef2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 0x7f5ea815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaef2c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5ea806a4d0 0x7f5ea806a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaef2c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea8155b70 con 0x7f5ea8155790 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaef2c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea806ee30 con 0x7f5ea806a4d0 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaef2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea806ae60 con 0x7f5ea815b5e0 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaccc8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5ea8155790 0x7f5ea806f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41422/0 (socket says 172.21.15.154:41422) 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.459+0000 7f5eaccc8640 1 -- 172.21.15.154:0/3067037466 learned_addr learned my addr 172.21.15.154:0/3067037466 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea7fff640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 0x7f5ea815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ead4c9640 1 --2- 172.21.15.154:0/3067037466 >> v2:172.21.15.194:3300/0 conn(0x7f5ea806a4d0 0x7f5ea806a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.463 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346836633 0 0) 0x7f5ea8155b70 con 0x7f5ea8155790 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e90003520 con 0x7f5ea8155790 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722268577 0 0) 0x7f5e90003520 con 0x7f5ea8155790 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 msgr2=0x7f5ea815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 0x7f5ea815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 >> v2:172.21.15.194:3300/0 conn(0x7f5ea806a4d0 msgr2=0x7f5ea806a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 --2- 172.21.15.154:0/3067037466 >> v2:172.21.15.194:3300/0 conn(0x7f5ea806a4d0 0x7f5ea806a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea806f3b0 con 0x7f5ea8155790 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f5e98001670 con 0x7f5ea8155790 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 >> v1:172.21.15.154:6789/0 conn(0x7f5ea8155790 legacy=0x7f5ea806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90003970 0x7f5e90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 0x7f5e900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e90004d00 0x7f5e90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea806ee30 con 0x7f5e90003970 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea806ae60 con 0x7f5e90004d00 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9000b980 con 0x7f5ea815b5e0 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5eaccc8640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90003970 0x7f5e90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ea7fff640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 0x7f5e900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5ead4c9640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e90004d00 0x7f5e90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5eaccc8640 1 -- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 msgr2=0x7f5e900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5eaccc8640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ea815b5e0 0x7f5e900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5eaccc8640 1 -- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e90004d00 msgr2=0x7f5e90005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5eaccc8640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e90004d00 0x7f5e90005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.460+0000 7f5eaccc8640 1 -- 172.21.15.154:0/3067037466 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90003520 con 0x7f5e90003970 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.461+0000 7f5eaccc8640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90003970 0x7f5e90003d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c2c0 tx=0x7f5e900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d489b261e61ec52 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.461+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e98005ad0 con 0x7f5e90003970 2023-11-27T22:29:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.461+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e98005c30 con 0x7f5e90003970 2023-11-27T22:29:57.466 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.461+0000 7f5ea77fe640 1 -- 172.21.15.154:0/3067037466 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9802c8b0 con 0x7f5e90003970 2023-11-27T22:29:57.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3067037466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90003970 msgr2=0x7f5e90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3067037466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e90003970 0x7f5e90003d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c2c0 tx=0x7f5e900057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5ead4c9640 1 -- 172.21.15.154:0/3067037466 reap_dead start 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3067037466 shutdown_connections 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3067037466 >> 172.21.15.154:0/3067037466 conn(0x7f5ea80b1e50 msgr2=0x7f5ea80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3067037466 shutdown_connections 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.462+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3067037466 wait complete. 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.463+0000 7f5eaef2c640 1 Processor -- start 2023-11-27T22:29:57.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.463+0000 7f5eaef2c640 1 -- start start 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e90003970 0x7f5ea81f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ea814f870 0x7f5ea814fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 0x7f5ea815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea815e430 con 0x7f5ea815da70 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81f1080 con 0x7f5ea814f870 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81503e0 con 0x7f5e90003970 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 0x7f5ea815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 0x7f5ea815def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53660/0 (socket says 172.21.15.154:53660) 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 -- 172.21.15.154:0/3513982665 learned_addr learned my addr 172.21.15.154:0/3513982665 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 -- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e90003970 msgr2=0x7f5ea81f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e90003970 0x7f5ea81f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 -- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ea814f870 msgr2=0x7f5ea814fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ea7fff640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ea814f870 0x7f5ea814fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ea814f870 0x7f5ea814fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 -- 172.21.15.154:0/3513982665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea81506c0 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ead4c9640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 0x7f5ea815def0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ea806e720 tx=0x7f5ea000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000e040 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000f040 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0015430 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.464+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea81509a0 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.465+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea81f1c60 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.465+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea80afc30 con 0x7f5ea815da70 2023-11-27T22:29:57.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.466+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5ea0015590 con 0x7f5ea815da70 2023-11-27T22:29:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.466+0000 7f5ea57fa640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e9406b1c0 0x7f5e9406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.466+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ea0089fc0 con 0x7f5ea815da70 2023-11-27T22:29:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.466+0000 7f5eaccc8640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e9406b1c0 0x7f5e9406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.467+0000 7f5eaccc8640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e9406b1c0 0x7f5e9406d680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5e98034000 tx=0x7f5e9802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.470+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5ea0054d80 con 0x7f5ea815da70 2023-11-27T22:29:57.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.638+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ea8069400 con 0x7f5ea815da70 2023-11-27T22:29:57.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.639+0000 7f5ea57fa640 1 -- 172.21.15.154:0/3513982665 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f5ea00583a0 con 0x7f5ea815da70 2023-11-27T22:29:57.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:57.641 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e9406b1c0 msgr2=0x7f5e9406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e9406b1c0 0x7f5e9406d680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5e98034000 tx=0x7f5e9802e000 comp rx=0 tx=0).stop 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 msgr2=0x7f5ea815def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 0x7f5ea815def0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ea806e720 tx=0x7f5ea000f580 comp rx=0 tx=0).stop 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 shutdown_connections 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ea814f870 0x7f5ea814fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e9406b1c0 0x7f5e9406d680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ea815da70 0x7f5ea815def0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 --2- 172.21.15.154:0/3513982665 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e90003970 0x7f5ea81f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 >> 172.21.15.154:0/3513982665 conn(0x7f5ea80b1e50 msgr2=0x7f5ea80cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 shutdown_connections 2023-11-27T22:29:57.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.641+0000 7f5eaef2c640 1 -- 172.21.15.154:0/3513982665 wait complete. 2023-11-27T22:29:57.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:29:57.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:29:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.757+0000 7f1d9d410640 1 Processor -- start 2023-11-27T22:29:57.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.757+0000 7f1d9d410640 1 -- start start 2023-11-27T22:29:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d9d410640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d9815d2d0 0x7f1d980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d9d410640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d98160f70 0x7f1d980cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d9d410640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d981614e0 con 0x7f1d980ce480 2023-11-27T22:29:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d9d410640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d981617c0 con 0x7f1d9815d2d0 2023-11-27T22:29:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d9d410640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d98161aa0 con 0x7f1d98160f70 2023-11-27T22:29:57.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d96ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d9815d2d0 0x7f1d980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d96ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1d9815d2d0 0x7f1d980b8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53662/0 (socket says 172.21.15.154:53662) 2023-11-27T22:29:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.758+0000 7f1d96ffd640 1 -- 172.21.15.154:0/1298731023 learned_addr learned my addr 172.21.15.154:0/1298731023 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d8ffff640 1 --2- 172.21.15.154:0/1298731023 >> v2:172.21.15.194:3300/0 conn(0x7f1d98160f70 0x7f1d980cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d96ffd640 1 -- 172.21.15.154:0/1298731023 >> v2:172.21.15.194:3300/0 conn(0x7f1d98160f70 msgr2=0x7f1d980cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d96ffd640 1 --2- 172.21.15.154:0/1298731023 >> v2:172.21.15.194:3300/0 conn(0x7f1d98160f70 0x7f1d980cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d96ffd640 1 -- 172.21.15.154:0/1298731023 >> v1:172.21.15.194:6789/0 conn(0x7f1d980ce480 legacy=0x7f1d9806b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d96ffd640 1 -- 172.21.15.154:0/1298731023 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98161d80 con 0x7f1d9815d2d0 2023-11-27T22:29:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d96ffd640 1 --2- 172.21.15.154:0/1298731023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b8b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d980cdb80 tx=0x7f1d8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc1ff67b5c98f68 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.759+0000 7f1d967fc640 1 -- 172.21.15.154:0/1298731023 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88031870 con 0x7f1d9815d2d0 2023-11-27T22:29:57.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d967fc640 1 -- 172.21.15.154:0/1298731023 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d880319d0 con 0x7f1d9815d2d0 2023-11-27T22:29:57.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d967fc640 1 -- 172.21.15.154:0/1298731023 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88031d60 con 0x7f1d9815d2d0 2023-11-27T22:29:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 -- 172.21.15.154:0/1298731023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 msgr2=0x7f1d980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 --2- 172.21.15.154:0/1298731023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b8b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d980cdb80 tx=0x7f1d8802b910 comp rx=0 tx=0).stop 2023-11-27T22:29:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 -- 172.21.15.154:0/1298731023 shutdown_connections 2023-11-27T22:29:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 --2- 172.21.15.154:0/1298731023 >> v2:172.21.15.194:3300/0 conn(0x7f1d98160f70 0x7f1d980cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 --2- 172.21.15.154:0/1298731023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b8b90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 -- 172.21.15.154:0/1298731023 >> 172.21.15.154:0/1298731023 conn(0x7f1d98072230 msgr2=0x7f1d980cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 -- 172.21.15.154:0/1298731023 shutdown_connections 2023-11-27T22:29:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.760+0000 7f1d9d410640 1 -- 172.21.15.154:0/1298731023 wait complete. 2023-11-27T22:29:57.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.761+0000 7f1d9d410640 1 Processor -- start 2023-11-27T22:29:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.761+0000 7f1d9d410640 1 -- start start 2023-11-27T22:29:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d9d410640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d980ce480 0x7f1d98157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d9d410640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d9d410640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d98160f70 0x7f1d980cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d9d410640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9815b3b0 con 0x7f1d9815d2d0 2023-11-27T22:29:57.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d9d410640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9815b0d0 con 0x7f1d980ce480 2023-11-27T22:29:57.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d9d410640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980b2d00 con 0x7f1d98160f70 2023-11-27T22:29:57.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53664/0 (socket says 172.21.15.154:53664) 2023-11-27T22:29:57.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 -- 172.21.15.154:0/3794478119 learned_addr learned my addr 172.21.15.154:0/3794478119 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:57.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d96ffd640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d980ce480 0x7f1d98157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d977fe640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d98160f70 0x7f1d980cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 -- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d98160f70 msgr2=0x7f1d980cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d98160f70 0x7f1d980cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 -- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d980ce480 msgr2=0x7f1d98157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d980ce480 0x7f1d98157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.762+0000 7f1d8ffff640 1 -- 172.21.15.154:0/3794478119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880094d0 con 0x7f1d9815d2d0 2023-11-27T22:29:57.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.763+0000 7f1d8ffff640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b37e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c7f0 tx=0x7f1d8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.763+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80004220 con 0x7f1d9815d2d0 2023-11-27T22:29:57.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.763+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80004380 con 0x7f1d9815d2d0 2023-11-27T22:29:57.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.763+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80007840 con 0x7f1d9815d2d0 2023-11-27T22:29:57.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.763+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d980b2fe0 con 0x7f1d9815d2d0 2023-11-27T22:29:57.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.763+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d98158490 con 0x7f1d9815d2d0 2023-11-27T22:29:57.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.764+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d980b3500 con 0x7f1d9815d2d0 2023-11-27T22:29:57.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.764+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1d80007bb0 con 0x7f1d9815d2d0 2023-11-27T22:29:57.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.764+0000 7f1d8f7fe640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1d7806b1f0 0x7f1d7806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:57.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.765+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d80089890 con 0x7f1d9815d2d0 2023-11-27T22:29:57.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.765+0000 7f1d96ffd640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1d7806b1f0 0x7f1d7806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:57.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.765+0000 7f1d96ffd640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1d7806b1f0 0x7f1d7806d6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d88036000 tx=0x7f1d8803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:57.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.769+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1d980b3500 con 0x7f1d9815d2d0 2023-11-27T22:29:57.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.935+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d980b3500 con 0x7f1d9815d2d0 2023-11-27T22:29:57.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.936+0000 7f1d8f7fe640 1 -- 172.21.15.154:0/3794478119 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d980b3500 con 0x7f1d9815d2d0 2023-11-27T22:29:57.938 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:29:57.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1d7806b1f0 msgr2=0x7f1d7806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1d7806b1f0 0x7f1d7806d6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d88036000 tx=0x7f1d8803c040 comp rx=0 tx=0).stop 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 msgr2=0x7f1d980b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b37e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000c7f0 tx=0x7f1d8000ccb0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 shutdown_connections 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1d7806b1f0 0x7f1d7806d6b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d98160f70 0x7f1d980cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d9815d2d0 0x7f1d980b37e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 --2- 172.21.15.154:0/3794478119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d980ce480 0x7f1d98157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.937+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 >> 172.21.15.154:0/3794478119 conn(0x7f1d98072230 msgr2=0x7f1d980d19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.938+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 shutdown_connections 2023-11-27T22:29:57.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:57.938+0000 7f1d9d410640 1 -- 172.21.15.154:0/3794478119 wait complete. 2023-11-27T22:29:57.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:29:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.051+0000 7fbc41f9e640 1 Processor -- start 2023-11-27T22:29:58.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.051+0000 7fbc41f9e640 1 -- start start 2023-11-27T22:29:58.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc41f9e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc3c072390 0x7fbc3c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc41f9e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbc3c15e390 0x7fbc3c0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc41f9e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c15a570 con 0x7fbc3c13cf70 2023-11-27T22:29:58.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc41f9e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c15b570 con 0x7fbc3c072390 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc41f9e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c15a7b0 con 0x7fbc3c15e390 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc3c072390 0x7fbc3c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fbc3c13cf70 0x7fbc3c071c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41428/0 (socket says 172.21.15.154:41428) 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3b7fe640 1 -- 172.21.15.154:0/2923298706 learned_addr learned my addr 172.21.15.154:0/2923298706 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3affd640 1 -- 172.21.15.154:0/2923298706 >> v2:172.21.15.194:3300/0 conn(0x7fbc3c15e390 msgr2=0x7fbc3c0cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3affd640 1 --2- 172.21.15.154:0/2923298706 >> v2:172.21.15.194:3300/0 conn(0x7fbc3c15e390 0x7fbc3c0cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3affd640 1 -- 172.21.15.154:0/2923298706 >> v1:172.21.15.154:6789/0 conn(0x7fbc3c13cf70 legacy=0x7fbc3c071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3a7fc640 1 -- 172.21.15.154:0/2923298706 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898559901 0 0) 0x7fbc2c001110 con 0x7fbc3c13cf70 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.052+0000 7fbc3affd640 1 -- 172.21.15.154:0/2923298706 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c15aa90 con 0x7fbc3c072390 2023-11-27T22:29:58.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.053+0000 7fbc3affd640 1 --2- 172.21.15.154:0/2923298706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c072390 0x7fbc3c15de50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c06bde0 tx=0x7fbc3002e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1e4014f18afb31 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.053+0000 7fbc3a7fc640 1 -- 172.21.15.154:0/2923298706 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3002ee50 con 0x7fbc3c072390 2023-11-27T22:29:58.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.053+0000 7fbc3a7fc640 1 -- 172.21.15.154:0/2923298706 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30036440 con 0x7fbc3c072390 2023-11-27T22:29:58.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.053+0000 7fbc3a7fc640 1 -- 172.21.15.154:0/2923298706 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300367d0 con 0x7fbc3c072390 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2923298706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c072390 msgr2=0x7fbc3c15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2923298706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c072390 0x7fbc3c15de50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c06bde0 tx=0x7fbc3002e0a0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2923298706 shutdown_connections 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2923298706 >> v2:172.21.15.194:3300/0 conn(0x7fbc3c15e390 0x7fbc3c0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2923298706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c072390 0x7fbc3c15de50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2923298706 >> 172.21.15.154:0/2923298706 conn(0x7fbc3c06c520 msgr2=0x7fbc3c06c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2923298706 shutdown_connections 2023-11-27T22:29:58.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.054+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2923298706 wait complete. 2023-11-27T22:29:58.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.055+0000 7fbc41f9e640 1 Processor -- start 2023-11-27T22:29:58.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.055+0000 7fbc41f9e640 1 -- start start 2023-11-27T22:29:58.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc3c072390 0x7fbc3c138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc3c13cf70 0x7fbc3c0aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 0x7fbc3c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c156f90 con 0x7fbc3c15e390 2023-11-27T22:29:58.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c157270 con 0x7fbc3c13cf70 2023-11-27T22:29:58.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c157550 con 0x7fbc3c072390 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 0x7fbc3c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 0x7fbc3c158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53670/0 (socket says 172.21.15.154:53670) 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 -- 172.21.15.154:0/2808468741 learned_addr learned my addr 172.21.15.154:0/2808468741 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3affd640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc3c13cf70 0x7fbc3c0aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3b7fe640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc3c072390 0x7fbc3c138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 -- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc3c072390 msgr2=0x7fbc3c138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc3c072390 0x7fbc3c138b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 -- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc3c13cf70 msgr2=0x7fbc3c0aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc3c13cf70 0x7fbc3c0aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 -- 172.21.15.154:0/2808468741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3000b6a0 con 0x7fbc3c15e390 2023-11-27T22:29:58.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3affd640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc3c13cf70 0x7fbc3c0aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:58.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3b7fe640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc3c072390 0x7fbc3c138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:29:58.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc3bfff640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 0x7fbc3c158030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b9e0 tx=0x7fbc3400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400caa0 con 0x7fbc3c15e390 2023-11-27T22:29:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400cc20 con 0x7fbc3c15e390 2023-11-27T22:29:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c157830 con 0x7fbc3c15e390 2023-11-27T22:29:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34014440 con 0x7fbc3c15e390 2023-11-27T22:29:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.056+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c139070 con 0x7fbc3c15e390 2023-11-27T22:29:58.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.058+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c157d50 con 0x7fbc3c15e390 2023-11-27T22:29:58.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.058+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fbc3401d3b0 con 0x7fbc3c15e390 2023-11-27T22:29:58.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.058+0000 7fbc23fff640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc2806b1c0 0x7fbc2806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.058+0000 7fbc3b7fe640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc2806b1c0 0x7fbc2806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.058+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc34089940 con 0x7fbc3c15e390 2023-11-27T22:29:58.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.059+0000 7fbc3b7fe640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc2806b1c0 0x7fbc2806d680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c000f60 tx=0x7fbc2c007a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.063+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fbc3c157d50 con 0x7fbc3c15e390 2023-11-27T22:29:58.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.229+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc3c157d50 con 0x7fbc3c15e390 2023-11-27T22:29:58.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.230+0000 7fbc23fff640 1 -- 172.21.15.154:0/2808468741 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc3c157d50 con 0x7fbc3c15e390 2023-11-27T22:29:58.232 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:29:58.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc2806b1c0 msgr2=0x7fbc2806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc2806b1c0 0x7fbc2806d680 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c000f60 tx=0x7fbc2c007a50 comp rx=0 tx=0).stop 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 msgr2=0x7fbc3c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 0x7fbc3c158030 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400b9e0 tx=0x7fbc3400bea0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 shutdown_connections 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc3c13cf70 0x7fbc3c0aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fbc2806b1c0 0x7fbc2806d680 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc3c15e390 0x7fbc3c158030 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 --2- 172.21.15.154:0/2808468741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc3c072390 0x7fbc3c138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 >> 172.21.15.154:0/2808468741 conn(0x7fbc3c06c520 msgr2=0x7fbc3c0ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 shutdown_connections 2023-11-27T22:29:58.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.232+0000 7fbc41f9e640 1 -- 172.21.15.154:0/2808468741 wait complete. 2023-11-27T22:29:58.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:29:58.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.346+0000 7fc6fe57c640 1 Processor -- start 2023-11-27T22:29:58.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.346+0000 7fc6fe57c640 1 -- start start 2023-11-27T22:29:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6fe57c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc6f8071bb0 0x7fc6f806ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.349 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6fe57c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f81405c0 con 0x7fc6f813ce30 2023-11-27T22:29:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6fe57c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f80cee50 con 0x7fc6f80cea10 2023-11-27T22:29:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6fe57c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f813f6d0 con 0x7fc6f8071bb0 2023-11-27T22:29:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6f7fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fc6f813ce30 0x7fc6f80ccf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:41432/0 (socket says 172.21.15.154:41432) 2023-11-27T22:29:58.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6f7fff640 1 -- 172.21.15.154:0/1746414350 learned_addr learned my addr 172.21.15.154:0/1746414350 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6fcb19640 1 --2- 172.21.15.154:0/1746414350 >> v2:172.21.15.194:3300/0 conn(0x7fc6f8071bb0 0x7fc6f806ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128342201 0 0) 0x7fc6f81405c0 con 0x7fc6f813ce30 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.347+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e0005730 con 0x7fc6f813ce30 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503558031 0 0) 0x7fc6f80cee50 con 0x7fc6f80cea10 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f81405c0 con 0x7fc6f80cea10 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6fcb19640 1 -- 172.21.15.154:0/1746414350 >> v1:172.21.15.194:6789/0 conn(0x7fc6f80cea10 legacy=0x7fc6f80714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 397305627 0 0) 0x7fc6e0005730 con 0x7fc6f813ce30 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6fcb19640 1 -- 172.21.15.154:0/1746414350 >> v1:172.21.15.154:6789/0 conn(0x7fc6f813ce30 legacy=0x7fc6f80ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6fcb19640 1 -- 172.21.15.154:0/1746414350 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f813f9b0 con 0x7fc6f8071bb0 2023-11-27T22:29:58.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.348+0000 7fc6fcb19640 1 --2- 172.21.15.154:0/1746414350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f8071bb0 0x7fc6f806ec40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80cf040 tx=0x7fc6f002be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7601e1571312020 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8001670 con 0x7fc6f8071bb0 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f002c930 con 0x7fc6f8071bb0 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6f6ffd640 1 -- 172.21.15.154:0/1746414350 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f002cca0 con 0x7fc6f8071bb0 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 -- 172.21.15.154:0/1746414350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f8071bb0 msgr2=0x7fc6f806ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/1746414350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f8071bb0 0x7fc6f806ec40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80cf040 tx=0x7fc6f002be00 comp rx=0 tx=0).stop 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 -- 172.21.15.154:0/1746414350 shutdown_connections 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/1746414350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f8071bb0 0x7fc6f806ec40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 -- 172.21.15.154:0/1746414350 >> 172.21.15.154:0/1746414350 conn(0x7fc6f80b1e50 msgr2=0x7fc6f80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 -- 172.21.15.154:0/1746414350 shutdown_connections 2023-11-27T22:29:58.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.349+0000 7fc6fe57c640 1 -- 172.21.15.154:0/1746414350 wait complete. 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.350+0000 7fc6fe57c640 1 Processor -- start 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.350+0000 7fc6fe57c640 1 -- start start 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fe57c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 0x7fc6f8151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fe57c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f80cea10 0x7fc6f813d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fe57c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6f813ce30 0x7fc6f81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fe57c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8158220 con 0x7fc6f8071bb0 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fe57c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f813e1b0 con 0x7fc6f80cea10 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fe57c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f813bdb0 con 0x7fc6f813ce30 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 0x7fc6f8151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 0x7fc6f8151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53674/0 (socket says 172.21.15.154:53674) 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6f7fff640 1 -- 172.21.15.154:0/2376338594 learned_addr learned my addr 172.21.15.154:0/2376338594 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6fcb19640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6f813ce30 0x7fc6f81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6f77fe640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f80cea10 0x7fc6f813d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.351+0000 7fc6f7fff640 1 -- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6f813ce30 msgr2=0x7fc6f81551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f7fff640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6f813ce30 0x7fc6f81551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f7fff640 1 -- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f80cea10 msgr2=0x7fc6f813d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f7fff640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f80cea10 0x7fc6f813d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f7fff640 1 -- 172.21.15.154:0/2376338594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009a70 con 0x7fc6f8071bb0 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6fcb19640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6f813ce30 0x7fc6f81551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f77fe640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f80cea10 0x7fc6f813d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f7fff640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 0x7fc6f8151db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c750 tx=0x7fc6e800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8005ad0 con 0x7fc6f8071bb0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8005c30 con 0x7fc6f8071bb0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f813d910 con 0x7fc6f8071bb0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8007070 con 0x7fc6f8071bb0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.352+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f813ded0 con 0x7fc6f8071bb0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.353+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f8069400 con 0x7fc6f8071bb0 2023-11-27T22:29:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.353+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc6e80071d0 con 0x7fc6f8071bb0 2023-11-27T22:29:58.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.353+0000 7fc6f4ff9640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc6e406b1f0 0x7fc6e406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.354+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6e8088f20 con 0x7fc6f8071bb0 2023-11-27T22:29:58.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.354+0000 7fc6f77fe640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc6e406b1f0 0x7fc6e406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.354+0000 7fc6f77fe640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc6e406b1f0 0x7fc6e406d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80cd420 tx=0x7fc6ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.358+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc6e8053d90 con 0x7fc6f8071bb0 2023-11-27T22:29:58.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.526+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6f8072480 con 0x7fc6f8071bb0 2023-11-27T22:29:58.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.527+0000 7fc6f4ff9640 1 -- 172.21.15.154:0/2376338594 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6e8017020 con 0x7fc6f8071bb0 2023-11-27T22:29:58.529 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:29:58.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.528+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc6e406b1f0 msgr2=0x7fc6e406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.528+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc6e406b1f0 0x7fc6e406d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc6f80cd420 tx=0x7fc6ec009040 comp rx=0 tx=0).stop 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.528+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 msgr2=0x7fc6f8151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.528+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 0x7fc6f8151db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c750 tx=0x7fc6e800cc10 comp rx=0 tx=0).stop 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 shutdown_connections 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6f80cea10 0x7fc6f813d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc6e406b1f0 0x7fc6e406d6b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6f813ce30 0x7fc6f81551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 --2- 172.21.15.154:0/2376338594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6f8071bb0 0x7fc6f8151db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 >> 172.21.15.154:0/2376338594 conn(0x7fc6f80b1e50 msgr2=0x7fc6f806d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 shutdown_connections 2023-11-27T22:29:58.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.529+0000 7fc6fe57c640 1 -- 172.21.15.154:0/2376338594 wait complete. 2023-11-27T22:29:58.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:29:58.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.641+0000 7f59e33be640 1 Processor -- start 2023-11-27T22:29:58.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.641+0000 7f59e33be640 1 -- start start 2023-11-27T22:29:58.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e33be640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59dc15d910 0x7f59dc0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e33be640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0b49f0 con 0x7f59dc150560 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e33be640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59dc0b3560 con 0x7f59dc150940 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e33be640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59dc0b3de0 con 0x7f59dc15d910 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e195b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59dc15d910 0x7f59dc0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e195b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f59dc15d910 0x7f59dc0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46534/0 (socket says 172.21.15.154:46534) 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e115a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f59dc150560 0x7f59dc0b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40240/0 (socket says 172.21.15.154:40240) 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e195b640 1 -- 172.21.15.154:0/750113563 learned_addr learned my addr 172.21.15.154:0/750113563 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e195b640 1 -- 172.21.15.154:0/750113563 >> v1:172.21.15.194:6789/0 conn(0x7f59dc150940 legacy=0x7f59dc15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e195b640 1 -- 172.21.15.154:0/750113563 >> v1:172.21.15.154:6789/0 conn(0x7f59dc150560 legacy=0x7f59dc0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.642+0000 7f59e195b640 1 -- 172.21.15.154:0/750113563 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0b40c0 con 0x7f59dc15d910 2023-11-27T22:29:58.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e195b640 1 --2- 172.21.15.154:0/750113563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15d910 0x7f59dc0ce0e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f59d400af60 tx=0x7f59d402d090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e74cb9e5231bc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59cffff640 1 -- 172.21.15.154:0/750113563 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d402da30 con 0x7f59dc15d910 2023-11-27T22:29:58.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59cffff640 1 -- 172.21.15.154:0/750113563 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d402db90 con 0x7f59dc15d910 2023-11-27T22:29:58.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59cffff640 1 -- 172.21.15.154:0/750113563 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4008500 con 0x7f59dc15d910 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 -- 172.21.15.154:0/750113563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15d910 msgr2=0x7f59dc0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 --2- 172.21.15.154:0/750113563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15d910 0x7f59dc0ce0e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f59d400af60 tx=0x7f59d402d090 comp rx=0 tx=0).stop 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 -- 172.21.15.154:0/750113563 shutdown_connections 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 --2- 172.21.15.154:0/750113563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15d910 0x7f59dc0ce0e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 -- 172.21.15.154:0/750113563 >> 172.21.15.154:0/750113563 conn(0x7f59dc06a4d0 msgr2=0x7f59dc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 -- 172.21.15.154:0/750113563 shutdown_connections 2023-11-27T22:29:58.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.643+0000 7f59e33be640 1 -- 172.21.15.154:0/750113563 wait complete. 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 Processor -- start 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 -- start start 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59dc150560 0x7f59dc155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59dc15d910 0x7f59dc159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 0x7f59dc152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc0a9480 con 0x7f59dc15a390 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc1f0bd0 con 0x7f59dc150560 2023-11-27T22:29:58.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e33be640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59dc156420 con 0x7f59dc15d910 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e195b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 0x7f59dc152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e195b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 0x7f59dc152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46542/0 (socket says 172.21.15.154:46542) 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.645+0000 7f59e195b640 1 -- 172.21.15.154:0/2500190872 learned_addr learned my addr 172.21.15.154:0/2500190872 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e0959640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59dc15d910 0x7f59dc159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e115a640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59dc150560 0x7f59dc155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e195b640 1 -- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59dc15d910 msgr2=0x7f59dc159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e195b640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59dc15d910 0x7f59dc159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e195b640 1 -- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59dc150560 msgr2=0x7f59dc155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e195b640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59dc150560 0x7f59dc155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e195b640 1 -- 172.21.15.154:0/2500190872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d400ac40 con 0x7f59dc15a390 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e195b640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 0x7f59dc152f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59d4037040 tx=0x7f59d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4040670 con 0x7f59dc15a390 2023-11-27T22:29:58.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d40407f0 con 0x7f59dc15a390 2023-11-27T22:29:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4040ba0 con 0x7f59dc15a390 2023-11-27T22:29:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59dc1566c0 con 0x7f59dc15a390 2023-11-27T22:29:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.646+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59dc156c80 con 0x7f59dc15a390 2023-11-27T22:29:58.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.647+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59dc1f0d80 con 0x7f59dc15a390 2023-11-27T22:29:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.647+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f59d4040d00 con 0x7f59dc15a390 2023-11-27T22:29:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.648+0000 7f59cdffb640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f59c006b1c0 0x7f59c006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.648+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59d40acf10 con 0x7f59dc15a390 2023-11-27T22:29:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.648+0000 7f59e115a640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f59c006b1c0 0x7f59c006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.648+0000 7f59e115a640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f59c006b1c0 0x7f59c006d680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007fd0 tx=0x7f59d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.652+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f59d4077c50 con 0x7f59dc15a390 2023-11-27T22:29:58.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.854+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59dc069400 con 0x7f59dc15a390 2023-11-27T22:29:58.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.854+0000 7f59cdffb640 1 -- 172.21.15.154:0/2500190872 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f59d407b270 con 0x7f59dc15a390 2023-11-27T22:29:58.856 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:58.856 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:29:58.857 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:29:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f59c006b1c0 msgr2=0x7f59c006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f59c006b1c0 0x7f59c006d680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f59d0007fd0 tx=0x7f59d0009040 comp rx=0 tx=0).stop 2023-11-27T22:29:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 msgr2=0x7f59dc152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 0x7f59dc152f00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f59d4037040 tx=0x7f59d4004a40 comp rx=0 tx=0).stop 2023-11-27T22:29:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 shutdown_connections 2023-11-27T22:29:58.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f59c006b1c0 0x7f59c006d680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59dc15a390 0x7f59dc152f00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59dc15d910 0x7f59dc159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 --2- 172.21.15.154:0/2500190872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59dc150560 0x7f59dc155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 >> 172.21.15.154:0/2500190872 conn(0x7f59dc06a4d0 msgr2=0x7f59dc14f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 shutdown_connections 2023-11-27T22:29:58.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.856+0000 7f59e33be640 1 -- 172.21.15.154:0/2500190872 wait complete. 2023-11-27T22:29:58.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:29:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 Processor -- start 2023-11-27T22:29:58.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 -- start start 2023-11-27T22:29:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1060143490 0x7f10600b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f106015abf0 0x7f10600b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106015e2a0 con 0x7f106015e730 2023-11-27T22:29:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106015b520 con 0x7f1060143490 2023-11-27T22:29:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.968+0000 7f10684da640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1060143870 con 0x7f106015abf0 2023-11-27T22:29:58.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1060143490 0x7f10600b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1060143490 0x7f10600b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46558/0 (socket says 172.21.15.154:46558) 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 -- 172.21.15.154:0/1144682124 learned_addr learned my addr 172.21.15.154:0/1144682124 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066a77640 1 --2- 172.21.15.154:0/1144682124 >> v2:172.21.15.194:3300/0 conn(0x7f106015abf0 0x7f10600b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 -- 172.21.15.154:0/1144682124 >> v2:172.21.15.194:3300/0 conn(0x7f106015abf0 msgr2=0x7f10600b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 --2- 172.21.15.154:0/1144682124 >> v2:172.21.15.194:3300/0 conn(0x7f106015abf0 0x7f10600b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 -- 172.21.15.154:0/1144682124 >> v1:172.21.15.194:6789/0 conn(0x7f106015e730 legacy=0x7f106015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.969+0000 7f1066276640 1 -- 172.21.15.154:0/1144682124 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106015b240 con 0x7f1060143490 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f1066276640 1 --2- 172.21.15.154:0/1144682124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1060143490 0x7f10600b0cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10600b4ca0 tx=0x7f105802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c611484e1926965 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f1065274640 1 -- 172.21.15.154:0/1144682124 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105802cb20 con 0x7f1060143490 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f1065274640 1 -- 172.21.15.154:0/1144682124 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105802cc80 con 0x7f1060143490 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f1065274640 1 -- 172.21.15.154:0/1144682124 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580343f0 con 0x7f1060143490 2023-11-27T22:29:58.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 -- 172.21.15.154:0/1144682124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1060143490 msgr2=0x7f10600b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 --2- 172.21.15.154:0/1144682124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1060143490 0x7f10600b0cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10600b4ca0 tx=0x7f105802bf80 comp rx=0 tx=0).stop 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 -- 172.21.15.154:0/1144682124 shutdown_connections 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 --2- 172.21.15.154:0/1144682124 >> v2:172.21.15.194:3300/0 conn(0x7f106015abf0 0x7f10600b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 --2- 172.21.15.154:0/1144682124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1060143490 0x7f10600b0cf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 -- 172.21.15.154:0/1144682124 >> 172.21.15.154:0/1144682124 conn(0x7f106006a4d0 msgr2=0x7f106006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 -- 172.21.15.154:0/1144682124 shutdown_connections 2023-11-27T22:29:58.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.970+0000 7f10684da640 1 -- 172.21.15.154:0/1144682124 wait complete. 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.971+0000 7f10684da640 1 Processor -- start 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.971+0000 7f10684da640 1 -- start start 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f10684da640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1060143490 0x7f10601f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f10684da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 0x7f1060159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f10684da640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f106015e730 0x7f10601e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f10684da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601e40c0 con 0x7f106015abf0 2023-11-27T22:29:58.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f10684da640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601f69c0 con 0x7f106015e730 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f10684da640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106013f0b0 con 0x7f1060143490 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f1065a75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 0x7f1060159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f1065a75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 0x7f1060159b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46570/0 (socket says 172.21.15.154:46570) 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f1065a75640 1 -- 172.21.15.154:0/2921242741 learned_addr learned my addr 172.21.15.154:0/2921242741 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f1066a77640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f106015e730 0x7f10601e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.972+0000 7f1066276640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1060143490 0x7f10601f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1065a75640 1 -- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1060143490 msgr2=0x7f10601f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1065a75640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1060143490 0x7f10601f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1065a75640 1 -- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f106015e730 msgr2=0x7f10601e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1065a75640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f106015e730 0x7f10601e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1065a75640 1 -- 172.21.15.154:0/2921242741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009b30 con 0x7f106015abf0 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1066a77640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f106015e730 0x7f10601e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1065a75640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 0x7f1060159b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f105000c430 tx=0x7f105000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10500052d0 con 0x7f106015abf0 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050005430 con 0x7f106015abf0 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10601f4120 con 0x7f106015abf0 2023-11-27T22:29:58.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050003830 con 0x7f106015abf0 2023-11-27T22:29:58.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.973+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10601f3b60 con 0x7f106015abf0 2023-11-27T22:29:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.974+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1060069400 con 0x7f106015abf0 2023-11-27T22:29:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.974+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1050003990 con 0x7f106015abf0 2023-11-27T22:29:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.975+0000 7f1056ffd640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f104406b1c0 0x7f104406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.975+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1050088ef0 con 0x7f106015abf0 2023-11-27T22:29:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.975+0000 7f1066276640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f104406b1c0 0x7f104406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:58.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.975+0000 7f1066276640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f104406b1c0 0x7f104406d680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1058035000 tx=0x7f1058030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:58.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:58.979+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1050053cb0 con 0x7f106015abf0 2023-11-27T22:29:59.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.146+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10600cb500 con 0x7f106015abf0 2023-11-27T22:29:59.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.148+0000 7f1056ffd640 1 -- 172.21.15.154:0/2921242741 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f1050017090 con 0x7f106015abf0 2023-11-27T22:29:59.149 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:59.150 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:29:59.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f104406b1c0 msgr2=0x7f104406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f104406b1c0 0x7f104406d680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1058035000 tx=0x7f1058030000 comp rx=0 tx=0).stop 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 msgr2=0x7f1060159b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 0x7f1060159b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f105000c430 tx=0x7f105000c8f0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 shutdown_connections 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f106015e730 0x7f10601e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.149+0000 7f10684da640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f104406b1c0 0x7f104406d680 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.150+0000 7f10684da640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f106015abf0 0x7f1060159b10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.150+0000 7f10684da640 1 --2- 172.21.15.154:0/2921242741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1060143490 0x7f10601f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.150+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 >> 172.21.15.154:0/2921242741 conn(0x7f106006a4d0 msgr2=0x7f106015d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.150+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 shutdown_connections 2023-11-27T22:29:59.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.150+0000 7f10684da640 1 -- 172.21.15.154:0/2921242741 wait complete. 2023-11-27T22:29:59.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:29:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.262+0000 7f3a47096640 1 Processor -- start 2023-11-27T22:29:59.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a47096640 1 -- start start 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a47096640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 0x7f3a400b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a47096640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a400d2910 0x7f3a400d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a47096640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a400b2b10 con 0x7f3a400d2d90 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a47096640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a400d1590 con 0x7f3a400d2910 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a47096640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400d1870 con 0x7f3a4015d330 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a45633640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3a400d2d90 0x7f3a400b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40252/0 (socket says 172.21.15.154:40252) 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.263+0000 7f3a45633640 1 -- 172.21.15.154:0/2074581279 learned_addr learned my addr 172.21.15.154:0/2074581279 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587530987 0 0) 0x7f3a400b2b10 con 0x7f3a400d2d90 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a28003520 con 0x7f3a400d2d90 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a44e32640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 0x7f3a400b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a37fff640 1 --2- 172.21.15.154:0/2074581279 >> v2:172.21.15.194:3300/0 conn(0x7f3a400d2910 0x7f3a400d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4265282027 0 0) 0x7f3a28003520 con 0x7f3a400d2d90 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 msgr2=0x7f3a400b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 0x7f3a400b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 >> v2:172.21.15.194:3300/0 conn(0x7f3a400d2910 msgr2=0x7f3a400d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 --2- 172.21.15.154:0/2074581279 >> v2:172.21.15.194:3300/0 conn(0x7f3a400d2910 0x7f3a400d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400d1b50 con 0x7f3a400d2d90 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f3a380019f0 con 0x7f3a400d2d90 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 >> v1:172.21.15.154:6789/0 conn(0x7f3a400d2d90 legacy=0x7f3a400b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a28003970 0x7f3a28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 0x7f3a280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a28004d00 0x7f3a28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400d1590 con 0x7f3a28004d00 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400d1870 con 0x7f3a28003970 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2800bae0 con 0x7f3a4015d330 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a45633640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a28004d00 0x7f3a28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a37fff640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 0x7f3a280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a44e32640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a28003970 0x7f3a28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a45633640 1 -- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 msgr2=0x7f3a280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a45633640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a4015d330 0x7f3a280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.270 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a45633640 1 -- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a28003970 msgr2=0x7f3a28003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a45633640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a28003970 0x7f3a28003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.264+0000 7f3a45633640 1 -- 172.21.15.154:0/2074581279 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a28003520 con 0x7f3a28004d00 2023-11-27T22:29:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.265+0000 7f3a45633640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a28004d00 0x7f3a28005180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ca2e0 tx=0x7f3a280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a92f79403662b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.265+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38034630 con 0x7f3a28004d00 2023-11-27T22:29:59.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.265+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3802f070 con 0x7f3a28004d00 2023-11-27T22:29:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.265+0000 7f3a377fe640 1 -- 172.21.15.154:0/2074581279 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380349d0 con 0x7f3a28004d00 2023-11-27T22:29:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a47096640 1 -- 172.21.15.154:0/2074581279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a28004d00 msgr2=0x7f3a28005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a47096640 1 --2- 172.21.15.154:0/2074581279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a28004d00 0x7f3a28005180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a400ca2e0 tx=0x7f3a280057f0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a45633640 1 -- 172.21.15.154:0/2074581279 reap_dead start 2023-11-27T22:29:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a47096640 1 -- 172.21.15.154:0/2074581279 shutdown_connections 2023-11-27T22:29:59.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a47096640 1 -- 172.21.15.154:0/2074581279 >> 172.21.15.154:0/2074581279 conn(0x7f3a40072020 msgr2=0x7f3a40072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a47096640 1 -- 172.21.15.154:0/2074581279 shutdown_connections 2023-11-27T22:29:59.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.266+0000 7f3a47096640 1 -- 172.21.15.154:0/2074581279 wait complete. 2023-11-27T22:29:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.267+0000 7f3a47096640 1 Processor -- start 2023-11-27T22:29:59.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.267+0000 7f3a47096640 1 -- start start 2023-11-27T22:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a47096640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a401596d0 0x7f3a400aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a47096640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a400cc6b0 0x7f3a400c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a47096640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 0x7f3a400c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a47096640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400c8af0 con 0x7f3a400c8120 2023-11-27T22:29:59.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a47096640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400ca4d0 con 0x7f3a400cc6b0 2023-11-27T22:29:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a47096640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400ca7b0 con 0x7f3a401596d0 2023-11-27T22:29:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 0x7f3a400c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 0x7f3a400c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46588/0 (socket says 172.21.15.154:46588) 2023-11-27T22:29:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 -- 172.21.15.154:0/391971390 learned_addr learned my addr 172.21.15.154:0/391971390 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a44e32640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a401596d0 0x7f3a400aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a37fff640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a400cc6b0 0x7f3a400c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 -- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a401596d0 msgr2=0x7f3a400aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a401596d0 0x7f3a400aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 -- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a400cc6b0 msgr2=0x7f3a400c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a400cc6b0 0x7f3a400c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 -- 172.21.15.154:0/391971390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400caa90 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a45633640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 0x7f3a400c85b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800a9c0 tx=0x7f3a38001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.268+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38034840 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.269+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3802ce90 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.269+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a400cad70 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.269+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38034ba0 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.269+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a400aa7f0 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.270+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a40069400 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.270+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3a38031030 con 0x7f3a400c8120 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.270+0000 7f3a357fa640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3a2c06b1c0 0x7f3a2c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.270+0000 7f3a44e32640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3a2c06b1c0 0x7f3a2c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.270+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a380abc30 con 0x7f3a400c8120 2023-11-27T22:29:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.271+0000 7f3a44e32640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3a2c06b1c0 0x7f3a2c06d680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3a400a9cc0 tx=0x7f3a3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:29:59.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.275+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3a38076b10 con 0x7f3a400c8120 2023-11-27T22:29:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.476+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a40069400 con 0x7f3a400c8120 2023-11-27T22:29:59.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.477+0000 7f3a357fa640 1 -- 172.21.15.154:0/391971390 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f3a38002000 con 0x7f3a400c8120 2023-11-27T22:29:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:29:59.479 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:29:59.479 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:29:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.478+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3a2c06b1c0 msgr2=0x7f3a2c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.478+0000 7f3a47096640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3a2c06b1c0 0x7f3a2c06d680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3a400a9cc0 tx=0x7f3a3c008040 comp rx=0 tx=0).stop 2023-11-27T22:29:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.478+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 msgr2=0x7f3a400c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.478+0000 7f3a47096640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 0x7f3a400c85b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800a9c0 tx=0x7f3a38001360 comp rx=0 tx=0).stop 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 shutdown_connections 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a400cc6b0 0x7f3a400c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3a2c06b1c0 0x7f3a2c06d680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a400c8120 0x7f3a400c85b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 --2- 172.21.15.154:0/391971390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a401596d0 0x7f3a400aa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 >> 172.21.15.154:0/391971390 conn(0x7f3a40072020 msgr2=0x7f3a400b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 shutdown_connections 2023-11-27T22:29:59.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.479+0000 7f3a47096640 1 -- 172.21.15.154:0/391971390 wait complete. 2023-11-27T22:29:59.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T22:29:38.987500+0000', 'modified': '2023-11-27T22:29:41.000321+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6835/4111391598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 4111391598}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 4111391598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T22:29:59.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T22:29:59.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-27T22:29:59.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.995+0000 7fe523c2b640 1 Processor -- start 2023-11-27T22:29:59.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.995+0000 7fe523c2b640 1 -- start start 2023-11-27T22:29:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe523c2b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe51c0ae480 0x7fe51c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe523c2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:29:59.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe523c2b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51c0ae910 con 0x7fe51c15d2b0 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe523c2b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51c0b2200 con 0x7fe51c0ae480 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe523c2b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c0b24e0 con 0x7fe51c072390 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe51c0ae480 0x7fe51c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe51c0ae480 0x7fe51c06d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46598/0 (socket says 172.21.15.154:46598) 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 -- 172.21.15.154:0/507592242 learned_addr learned my addr 172.21.15.154:0/507592242 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5221c8640 1 --2- 172.21.15.154:0/507592242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 -- 172.21.15.154:0/507592242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 msgr2=0x7fe51c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 --2- 172.21.15.154:0/507592242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c06d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 -- 172.21.15.154:0/507592242 >> v1:172.21.15.194:6789/0 conn(0x7fe51c15d2b0 legacy=0x7fe51c071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:29:59.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.996+0000 7fe5211c6640 1 -- 172.21.15.154:0/507592242 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0b40a0 con 0x7fe51c0ae480 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.997+0000 7fe5211c6640 1 --2- 172.21.15.154:0/507592242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c0ae480 0x7fe51c06d340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009870 tx=0x7fe50c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99147e2fbc817271 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.997+0000 7fe5209c5640 1 -- 172.21.15.154:0/507592242 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c031640 con 0x7fe51c0ae480 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.997+0000 7fe5209c5640 1 -- 172.21.15.154:0/507592242 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c0317a0 con 0x7fe51c0ae480 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.997+0000 7fe5209c5640 1 -- 172.21.15.154:0/507592242 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c031b30 con 0x7fe51c0ae480 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 -- 172.21.15.154:0/507592242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c0ae480 msgr2=0x7fe51c06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 --2- 172.21.15.154:0/507592242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c0ae480 0x7fe51c06d340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009870 tx=0x7fe50c02b8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 -- 172.21.15.154:0/507592242 shutdown_connections 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 --2- 172.21.15.154:0/507592242 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 --2- 172.21.15.154:0/507592242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c0ae480 0x7fe51c06d340 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 -- 172.21.15.154:0/507592242 >> 172.21.15.154:0/507592242 conn(0x7fe51c0b4720 msgr2=0x7fe51c0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 -- 172.21.15.154:0/507592242 shutdown_connections 2023-11-27T22:30:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.998+0000 7fe523c2b640 1 -- 172.21.15.154:0/507592242 wait complete. 2023-11-27T22:30:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.999+0000 7fe523c2b640 1 Processor -- start 2023-11-27T22:30:00.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:29:59.999+0000 7fe523c2b640 1 -- start start 2023-11-27T22:30:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe523c2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe523c2b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c15d2b0 0x7fe51c158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe523c2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 0x7fe51c151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe523c2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c1594a0 con 0x7fe51c151310 2023-11-27T22:30:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe523c2b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c15a8c0 con 0x7fe51c15d2b0 2023-11-27T22:30:00.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe523c2b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c15ab40 con 0x7fe51c072390 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 0x7fe51c151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 0x7fe51c151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46604/0 (socket says 172.21.15.154:46604) 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 -- 172.21.15.154:0/2729176898 learned_addr learned my addr 172.21.15.154:0/2729176898 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5211c6640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c15d2b0 0x7fe51c158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 -- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 msgr2=0x7fe51c154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 -- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c15d2b0 msgr2=0x7fe51c158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c15d2b0 0x7fe51c158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 -- 172.21.15.154:0/2729176898 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0094d0 con 0x7fe51c151310 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5211c6640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c15d2b0 0x7fe51c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:00.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.000+0000 7fe5221c8640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 0x7fe51c151f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe51400efc0 tx=0x7fe51400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.001+0000 7fe5127fc640 1 -- 172.21.15.154:0/2729176898 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514009ca0 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.001+0000 7fe5127fc640 1 -- 172.21.15.154:0/2729176898 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51400f040 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.001+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c0b2af0 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.001+0000 7fe5127fc640 1 -- 172.21.15.154:0/2729176898 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140146c0 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.001+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c15b100 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.002+0000 7fe5127fc640 1 -- 172.21.15.154:0/2729176898 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe514014820 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.002+0000 7fe5127fc640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe50006b1c0 0x7fe50006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.002+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe50006b1c0 0x7fe50006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.002+0000 7fe5127fc640 1 -- 172.21.15.154:0/2729176898 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe51408aa20 con 0x7fe51c151310 2023-11-27T22:30:00.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.003+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe50006b1c0 0x7fe50006d680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe518007fd0 tx=0x7fe518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.003+0000 7fe5267bd740 1 Processor -- start 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 -- start start 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f8c50 0x561cd46cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd46fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46cc130 0x561cd46fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd468c980 con 0x561cd46f9030 2023-11-27T22:30:00.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd463eb90 con 0x561cd46cc130 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cd463c280 con 0x561cd46f8c50 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5211c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd46fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5211c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd46fb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46620/0 (socket says 172.21.15.154:46620) 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.004+0000 7fe5211c6640 1 -- 172.21.15.154:0/126834806 learned_addr learned my addr 172.21.15.154:0/126834806 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5219c7640 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f8c50 0x561cd46cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5221c8640 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46cc130 0x561cd46fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5211c6640 1 -- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f8c50 msgr2=0x561cd46cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5211c6640 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f8c50 0x561cd46cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5211c6640 1 -- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46cc130 msgr2=0x561cd46fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5211c6640 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46cc130 0x561cd46fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5211c6640 1 -- 172.21.15.154:0/126834806 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cd45fd500 con 0x561cd46f9030 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5221c8640 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46cc130 0x561cd46fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe5211c6640 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd46fb9e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009990 tx=0x7fe50c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4342173642fca34 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe4ff7fe640 1 -- 172.21.15.154:0/126834806 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c031b10 con 0x561cd46f9030 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe4ff7fe640 1 -- 172.21.15.154:0/126834806 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c031c70 con 0x561cd46f9030 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.005+0000 7fe4ff7fe640 1 -- 172.21.15.154:0/126834806 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c044420 con 0x561cd46f9030 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 -- 172.21.15.154:0/126834806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 msgr2=0x561cd46fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd46fb9e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009990 tx=0x7fe50c008030 comp rx=0 tx=0).stop 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 -- 172.21.15.154:0/126834806 shutdown_connections 2023-11-27T22:30:00.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46cc130 0x561cd46fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd46fb9e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 --2- 172.21.15.154:0/126834806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f8c50 0x561cd46cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 -- 172.21.15.154:0/126834806 >> 172.21.15.154:0/126834806 conn(0x561cd46cde60 msgr2=0x561cd47169e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 -- 172.21.15.154:0/126834806 shutdown_connections 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 -- 172.21.15.154:0/126834806 wait complete. 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 -- start start 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.006+0000 7fe5267bd740 1 Processor -- start 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd472aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4710dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4711310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd4637b70 con 0x561cd46f9030 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd45f1e00 con 0x561cd46f8c50 2023-11-27T22:30:00.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cd45f1aa0 con 0x561cd46ff3a0 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5267bd740 10 client.0 _ll_register_callbacks cb 0x561cd4349ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5211c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4710dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5211c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4710dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46634/0 (socket says 172.21.15.154:46634) 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5211c6640 1 -- 172.21.15.154:0/2022852051 learned_addr learned my addr 172.21.15.154:0/2022852051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5221c8640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4711310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.007+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd472aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5211c6640 1 -- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 msgr2=0x561cd4711310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5211c6640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4711310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5211c6640 1 -- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 msgr2=0x561cd472aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5211c6640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd472aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5211c6640 1 -- 172.21.15.154:0/2022852051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c0b40a0 con 0x561cd46f9030 2023-11-27T22:30:00.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd472aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5211c6640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4710dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe50c02bf00 tx=0x7fe50c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da47230dff83bc6f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe4fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe4fcff9640 1 -- 172.21.15.154:0/2022852051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c004440 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe4fcff9640 1 -- 172.21.15.154:0/2022852051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe50c03f070 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cd4630b50 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe4fcff9640 1 -- 172.21.15.154:0/2022852051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe50c003610 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 10 client.4674 fetch_fsmap learned FSMap version 6 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x561cd46361f0 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe4fcff9640 1 -- 172.21.15.154:0/2022852051 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561cd4630b50 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe4fcff9640 1 -- 172.21.15.154:0/2022852051 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe50c003770 con 0x561cd46f9030 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 10 client.4674 fetch_fsmap finished waiting for FSMap version 6 2023-11-27T22:30:00.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 20 client.4674 populate_metadata read hostname 'smithi154' 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd46e7340 0x561cd46e7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 4 client.4674 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.008+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 --> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cd4630870 con 0x561cd46e7340 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.009+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd46e7340 0x561cd46e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.009+0000 7fe4fcff9640 10 client.4674 ms_handle_connect on v2:172.21.15.194:6834/4111391598 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.009+0000 7fe5219c7640 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd46e7340 0x561cd46e7720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f231e1dd891668 server_cookie=5a66466df79c091f in_seq=0 out_seq=0 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe4fcff9640 1 -- 172.21.15.154:0/2022852051 <== mds.0 v2:172.21.15.194:6834/4111391598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561cd4630870 con 0x561cd46e7340 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe4fcff9640 10 client.4674 handle_command_reply: tid=0 2023-11-27T22:30:00.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 client.4674 shutdown 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 msgr2=0x561cd4710dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4710dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe50c02bf00 tx=0x7fe50c004730 comp rx=0 tx=0).stop 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 shutdown_connections 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4711310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4710dd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd46e7340 0x561cd46e7720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 --2- 172.21.15.154:0/2022852051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd472aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe4fcff9640 0 client.4674 ms_handle_reset on v2:172.21.15.194:6834/4111391598 2023-11-27T22:30:00.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 >> 172.21.15.154:0/2022852051 conn(0x561cd46cc130 msgr2=0x561cd46cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 shutdown_connections 2023-11-27T22:30:00.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 1 -- 172.21.15.154:0/2022852051 wait complete. 2023-11-27T22:30:00.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.010+0000 7fe5267bd740 20 client.4674 trim_cache size 0 max 16384 2023-11-27T22:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 Processor -- start 2023-11-27T22:30:00.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 -- start start 2023-11-27T22:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 0x561cd4712150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f9030 0x561cd477b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd45b7270 con 0x561cd46f8c50 2023-11-27T22:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd46fe310 con 0x561cd46ff3a0 2023-11-27T22:30:00.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cd46c7880 con 0x561cd46f9030 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5219c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 0x561cd4712150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5219c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 0x561cd4712150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46640/0 (socket says 172.21.15.154:46640) 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.026+0000 7fe5219c7640 1 -- 172.21.15.154:0/658222482 learned_addr learned my addr 172.21.15.154:0/658222482 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5219c7640 1 -- 172.21.15.154:0/658222482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f9030 msgr2=0x561cd477b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5219c7640 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f9030 0x561cd477b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5219c7640 1 -- 172.21.15.154:0/658222482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46ff3a0 msgr2=0x561cd4728c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5219c7640 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5219c7640 1 -- 172.21.15.154:0/658222482 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cd45d3d00 con 0x561cd46f8c50 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5219c7640 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 0x561cd4712150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe518000f60 tx=0x7fe518012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a94036e2c8b48d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe4fffff640 1 -- 172.21.15.154:0/658222482 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518001c90 con 0x561cd46f8c50 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe4fffff640 1 -- 172.21.15.154:0/658222482 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518029070 con 0x561cd46f8c50 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe4fffff640 1 -- 172.21.15.154:0/658222482 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518025860 con 0x561cd46f8c50 2023-11-27T22:30:00.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 -- 172.21.15.154:0/658222482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 msgr2=0x561cd4712150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 0x561cd4712150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe518000f60 tx=0x7fe518012000 comp rx=0 tx=0).stop 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 -- 172.21.15.154:0/658222482 shutdown_connections 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46f9030 0x561cd477b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 --2- 172.21.15.154:0/658222482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f8c50 0x561cd4712150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 -- 172.21.15.154:0/658222482 >> 172.21.15.154:0/658222482 conn(0x561cd46cc130 msgr2=0x561cd4716e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.027+0000 7fe5267bd740 1 -- 172.21.15.154:0/658222482 shutdown_connections 2023-11-27T22:30:00.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.028+0000 7fe5267bd740 1 -- 172.21.15.154:0/658222482 wait complete. 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.028+0000 7fe5267bd740 1 -- start start 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.028+0000 7fe5267bd740 1 Processor -- start 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd4779f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4739a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd4712a10 con 0x561cd46f9030 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cd470d290 con 0x561cd46f8c50 2023-11-27T22:30:00.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561cd4712730 con 0x561cd46ff3a0 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5267bd740 10 client.0 _ll_register_callbacks cb 0x7fe5140095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4739a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4739a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46642/0 (socket says 172.21.15.154:46642) 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 -- 172.21.15.154:0/3934231145 learned_addr learned my addr 172.21.15.154:0/3934231145 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5219c7640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd4779f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5221c8640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 -- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 msgr2=0x561cd4728c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 -- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 msgr2=0x561cd4779f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd4779f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5211c6640 1 -- 172.21.15.154:0/3934231145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51801d040 con 0x561cd46f9030 2023-11-27T22:30:00.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.029+0000 7fe5219c7640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd4779f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5211c6640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4739a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe50c02bf00 tx=0x7fe50c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fdd7b7bec4f57b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe4fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe4fcff9640 1 -- 172.21.15.154:0/3934231145 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c04d430 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe4fcff9640 1 -- 172.21.15.154:0/3934231145 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe50c03f040 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe50c031c70 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe4fcff9640 1 -- 172.21.15.154:0/3934231145 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe50c04d590 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 10 client.4680 fetch_fsmap learned FSMap version 6 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x561cd45f94f0 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe4fcff9640 1 -- 172.21.15.154:0/3934231145 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c031c70 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe4fcff9640 1 -- 172.21.15.154:0/3934231145 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe50c04d6f0 con 0x561cd46f9030 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 10 client.4680 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-27T22:30:00.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 20 client.4680 populate_metadata read hostname 'smithi154' 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd470c370 0x561cd470c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 4 client.4680 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 --> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561cd43386c0 con 0x561cd470c370 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.030+0000 7fe5219c7640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd470c370 0x561cd470c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe4fcff9640 10 client.4680 ms_handle_connect on v2:172.21.15.194:6834/4111391598 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5219c7640 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd470c370 0x561cd470c750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4abd64cc0554da3b server_cookie=c5ce46a7bbcb7e4e in_seq=0 out_seq=0 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe4fcff9640 1 -- 172.21.15.154:0/3934231145 <== mds.0 v2:172.21.15.194:6834/4111391598 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561cd43386c0 con 0x561cd470c370 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe4fcff9640 10 client.4680 handle_command_reply: tid=0 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 client.4680 shutdown 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 msgr2=0x561cd4739a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4739a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe50c02bf00 tx=0x7fe50c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 shutdown_connections 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561cd46ff3a0 0x561cd4728c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561cd46f9030 0x561cd4739a50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:6834/4111391598,v1:172.21.15.194:6835/4111391598] conn(0x561cd470c370 0x561cd470c750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 --2- 172.21.15.154:0/3934231145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561cd46f8c50 0x561cd4779f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 >> 172.21.15.154:0/3934231145 conn(0x561cd46cc130 msgr2=0x561cd4716e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe4fcff9640 0 client.4680 ms_handle_reset on v2:172.21.15.194:6834/4111391598 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 shutdown_connections 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 1 -- 172.21.15.154:0/3934231145 wait complete. 2023-11-27T22:30:00.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.031+0000 7fe5267bd740 20 client.4680 trim_cache size 0 max 16384 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "480179ad-e540-429b-b1ff-bfa2150dc1f7", 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4294, 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 20.364983516999999, 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 6, 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 20, 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 20, 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 27.352422932 2023-11-27T22:30:00.040 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-27T22:30:00.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe50006b1c0 msgr2=0x7fe50006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe50006b1c0 0x7fe50006d680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe518007fd0 tx=0x7fe518009040 comp rx=0 tx=0).stop 2023-11-27T22:30:00.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 msgr2=0x7fe51c151f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 0x7fe51c151f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe51400efc0 tx=0x7fe51400c490 comp rx=0 tx=0).stop 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 shutdown_connections 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe51c15d2b0 0x7fe51c158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe50006b1c0 0x7fe50006d680 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe51c151310 0x7fe51c151f10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 --2- 172.21.15.154:0/2729176898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe51c072390 0x7fe51c154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 >> 172.21.15.154:0/2729176898 conn(0x7fe51c0b4720 msgr2=0x7fe51c1578e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 shutdown_connections 2023-11-27T22:30:00.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.032+0000 7fe523c2b640 1 -- 172.21.15.154:0/2729176898 wait complete. 2023-11-27T22:30:00.044 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-27T22:30:00.069 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-27T22:30:00.069 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-27T22:30:00.069 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-27T22:30:00.069 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T22:30:00.069 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:00.069 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-27T22:30:00.069 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T22:30:00.069 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:00.070 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-27T22:30:00.070 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T22:30:00.070 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:00.070 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-27T22:30:00.070 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T22:30:00.070 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:00.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.074 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-27T22:30:00.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-11-27T22:30:00.159 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-11-27T22:30:00.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:30:00.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.161 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-11-27T22:30:00.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-11-27T22:30:00.253 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2023-11-27T22:30:00.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:30:00.255 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-27T22:30:00.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.354+0000 7f7822087640 1 Processor -- start 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.354+0000 7f7822087640 1 -- start start 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7822087640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 0x7f781c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7822087640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 0x7f781c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7822087640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c071770 con 0x7f781c0b4370 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7822087640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c0ccdc0 con 0x7f781c144980 2023-11-27T22:30:00.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7822087640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0cd0a0 con 0x7f781c0ceb70 2023-11-27T22:30:00.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7812ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 0x7f781c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f781b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 0x7f781c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f781bfff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f781c0b4370 0x7f781c071c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:54666/0 (socket says 172.21.15.154:54666) 2023-11-27T22:30:00.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f7812ffd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 0x7f781c0cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:49640/0 (socket says 172.21.15.154:49640) 2023-11-27T22:30:00.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f781b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 0x7f781c15c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:44442/0 (socket says 172.21.15.154:44442) 2023-11-27T22:30:00.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.355+0000 7f781bfff640 1 -- 172.21.15.154:0/3035154247 learned_addr learned my addr 172.21.15.154:0/3035154247 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:00.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.356+0000 7f7812ffd640 1 -- 172.21.15.154:0/3035154247 >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 msgr2=0x7f781c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:00.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.356+0000 7f7812ffd640 1 --2- 172.21.15.154:0/3035154247 >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 0x7f781c15c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.356+0000 7f7812ffd640 1 -- 172.21.15.154:0/3035154247 >> v1:172.21.15.194:6789/0 conn(0x7f781c0b4370 legacy=0x7f781c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.356+0000 7f7812ffd640 1 -- 172.21.15.154:0/3035154247 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c0cd380 con 0x7f781c0ceb70 2023-11-27T22:30:00.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.356+0000 7f781b7fe640 1 --2- 172.21.15.154:0/3035154247 >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 0x7f781c15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:00.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7812ffd640 1 --2- 172.21.15.154:0/3035154247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 0x7f781c0cc450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78040097a0 tx=0x7f780402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75cc10faf9af1aa1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f781affd640 1 -- 172.21.15.154:0/3035154247 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804031830 con 0x7f781c0ceb70 2023-11-27T22:30:00.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f781affd640 1 -- 172.21.15.154:0/3035154247 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804031990 con 0x7f781c0ceb70 2023-11-27T22:30:00.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f781affd640 1 -- 172.21.15.154:0/3035154247 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804031d20 con 0x7f781c0ceb70 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 -- 172.21.15.154:0/3035154247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 msgr2=0x7f781c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 --2- 172.21.15.154:0/3035154247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 0x7f781c0cc450 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78040097a0 tx=0x7f780402b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 -- 172.21.15.154:0/3035154247 shutdown_connections 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 --2- 172.21.15.154:0/3035154247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c0ceb70 0x7f781c0cc450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 --2- 172.21.15.154:0/3035154247 >> v2:172.21.15.194:3300/0 conn(0x7f781c144980 0x7f781c15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 -- 172.21.15.154:0/3035154247 >> 172.21.15.154:0/3035154247 conn(0x7f781c06a4d0 msgr2=0x7f781c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 -- 172.21.15.154:0/3035154247 shutdown_connections 2023-11-27T22:30:00.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.357+0000 7f7822087640 1 -- 172.21.15.154:0/3035154247 wait complete. 2023-11-27T22:30:00.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.358+0000 7f7822087640 1 Processor -- start 2023-11-27T22:30:00.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 -- start start 2023-11-27T22:30:00.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 0x7f781c140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f781c0ceb70 0x7f781c0aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c144980 0x7f781c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0afc50 con 0x7f781c0b4370 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c140f40 con 0x7f781c0ceb70 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.359+0000 7f7822087640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0af690 con 0x7f781c144980 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 0x7f781c140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 0x7f781c140a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46654/0 (socket says 172.21.15.154:46654) 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 -- 172.21.15.154:0/1494006495 learned_addr learned my addr 172.21.15.154:0/1494006495 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f7812ffd640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f781c0ceb70 0x7f781c0aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781bfff640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c144980 0x7f781c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 -- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c144980 msgr2=0x7f781c0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c144980 0x7f781c0aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 -- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f781c0ceb70 msgr2=0x7f781c0aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f781c0ceb70 0x7f781c0aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 -- 172.21.15.154:0/1494006495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c009400 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f781b7fe640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 0x7f781c140a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f780c00e960 tx=0x7f780c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00ca00 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804009400 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00cb60 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c013470 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.360+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c0b0720 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.361+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c0b0580 con 0x7f781c0b4370 2023-11-27T22:30:00.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.362+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f780c0135d0 con 0x7f781c0b4370 2023-11-27T22:30:00.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.362+0000 7f7818ff9640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f77fc06b1c0 0x7f77fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:00.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.362+0000 7f7812ffd640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f77fc06b1c0 0x7f77fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:00.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.362+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f780c089c30 con 0x7f781c0b4370 2023-11-27T22:30:00.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.362+0000 7f7812ffd640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f77fc06b1c0 0x7f77fc06d680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7804036000 tx=0x7f780403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:00.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.366+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f781c0b0580 con 0x7f781c0b4370 2023-11-27T22:30:00.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.573+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f781c0b0580 con 0x7f781c0b4370 2023-11-27T22:30:00.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.573+0000 7f7818ff9640 1 -- 172.21.15.154:0/1494006495 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f781c0b0580 con 0x7f781c0b4370 2023-11-27T22:30:00.576 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T22:30:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.575+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f77fc06b1c0 msgr2=0x7f77fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.575+0000 7f7822087640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f77fc06b1c0 0x7f77fc06d680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7804036000 tx=0x7f780403c040 comp rx=0 tx=0).stop 2023-11-27T22:30:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.575+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 msgr2=0x7f781c140a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:00.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.575+0000 7f7822087640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 0x7f781c140a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f780c00e960 tx=0x7f780c00ee20 comp rx=0 tx=0).stop 2023-11-27T22:30:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 shutdown_connections 2023-11-27T22:30:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f781c0ceb70 0x7f781c0aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f77fc06b1c0 0x7f77fc06d680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f781c144980 0x7f781c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 --2- 172.21.15.154:0/1494006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f781c0b4370 0x7f781c140a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:00.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 >> 172.21.15.154:0/1494006495 conn(0x7f781c06a4d0 msgr2=0x7f781c0b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 shutdown_connections 2023-11-27T22:30:00.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:00.576+0000 7f7822087640 1 -- 172.21.15.154:0/1494006495 wait complete. 2023-11-27T22:30:00.588 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T22:30:00.589 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T22:30:00.589 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-11-27T22:30:00.589 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T22:30:00.589 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:00.589 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T22:30:00.589 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T22:30:00.590 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T22:30:00.590 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T22:30:00.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.590 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-11-27T22:30:00.605 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:00.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:00.605 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:00.605 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:00.606 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T22:30:00.607 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:00.607 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T22:30:00.607 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42674sec preferred_lft 42674sec 2023-11-27T22:30:00.607 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-11-27T22:30:00.607 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:00.607 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T22:30:00.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T22:30:00.608 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:00.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.774 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T22:30:00.801 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-11-27T22:30:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.802 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-11-27T22:30:00.868 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-11-27T22:30:00.868 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T22:30:00.868 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T22:30:00.868 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T22:30:00.868 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T22:30:00.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:00.869 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:00.869 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:00.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T22:30:00.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T22:30:00.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T22:30:00.869 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:01.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.133 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-27T22:30:01.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.149 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-11-27T22:30:01.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.204 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:01.204 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:01.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:01.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-27T22:30:01.205 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:01.289 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-27T22:30:01.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.289 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-27T22:30:01.290 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:01.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.391 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:01.391 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:01.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-11-27T22:30:01.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T22:30:01.392 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:01.435 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-27T22:30:01.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:01.435 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:01.491 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T22:30:01.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:01.491 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:01.546 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-27T22:30:01.615 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:01.680 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-27T22:30:01.680 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-27T22:30:01.680 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-27T22:30:01.681 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-27T22:30:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:01.683 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:01.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.684 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-27T22:30:01.740 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T22:30:01.740 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-27T22:30:01.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-27T22:30:01.826 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:01.887 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:2023-11-27T22:30:01.883+0000 7fa181e4c480 -1 init, newargv = 0x55c10f17d4c0 newargc=15 2023-11-27T22:30:01.887 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[98248]: starting ceph client 2023-11-27T22:30:01.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[98248]: starting fuse 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-27T22:30:01.893 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-27T22:30:01.894 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-27T22:30:01.894 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-27T22:30:01.894 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-27T22:30:01.894 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-27T22:30:01.894 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-27T22:30:01.895 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:01.896 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:01.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:01.897 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-27T22:30:01.956 INFO:teuthology.orchestra.run.smithi154.stdout:41 2023-11-27T22:30:01.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-11-27T22:30:01.957 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-27T22:30:01.958 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-11-27T22:30:01.958 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-27T22:30:01.958 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:01.958 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-11-27T22:30:01.958 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-11-27T22:30:01.958 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-11-27T22:30:01.959 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-11-27T22:30:01.959 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:01.959 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-11-27T22:30:01.959 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T22:30:01.959 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T22:30:01.959 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T22:30:01.960 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-11-27T22:30:01.960 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-11-27T22:30:01.960 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-11-27T22:30:01.960 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T22:30:01.961 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:01.961 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.0")) 2023-11-27T22:30:01.961 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-11-27T22:30:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.0.98248.asok 2023-11-27T22:30:02.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T22:30:02.094 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.98248.asok 2023-11-27T22:30:02.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.98248.asok status 2023-11-27T22:30:02.244 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-27T22:30:02.244 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-11-27T22:30:02.244 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T22:30:02.244 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T22:30:02.244 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "0", 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "98248", 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4692, 2023-11-27T22:30:02.245 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-11-27T22:30:02.246 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-11-27T22:30:02.246 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-11-27T22:30:02.246 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4692 2023-11-27T22:30:02.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:02.246 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-27T22:30:02.246 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 4173389580 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-27T22:30:02.247 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 4173389580 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4692 192.168.0.1:0/4173389580", 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/4173389580", 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 6, 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 20, 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-11-27T22:30:02.248 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-27T22:30:02.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T22:30:02.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.355+0000 7f4c08697640 1 Processor -- start 2023-11-27T22:30:02.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.355+0000 7f4c08697640 1 -- start start 2023-11-27T22:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.356+0000 7f4c08697640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c00150940 0x7f4c0015d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.356+0000 7f4c08697640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c0015dec0 0x7f4c0015d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.356+0000 7f4c08697640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c000b49f0 con 0x7f4c00150560 2023-11-27T22:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.356+0000 7f4c08697640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000b3560 con 0x7f4c0015dec0 2023-11-27T22:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.356+0000 7f4c08697640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000b3de0 con 0x7f4c00150940 2023-11-27T22:30:02.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c06433640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4c00150560 0x7f4c000b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:40262/0 (socket says 172.21.15.154:40262) 2023-11-27T22:30:02.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c06433640 1 -- 172.21.15.154:0/1949057163 learned_addr learned my addr 172.21.15.154:0/1949057163 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:02.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c06c34640 1 --2- 172.21.15.154:0/1949057163 >> v2:172.21.15.194:3300/0 conn(0x7f4c0015dec0 0x7f4c0015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05c32640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c00150940 0x7f4c0015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852685364 0 0) 0x7f4c000b49f0 con 0x7f4c00150560 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bec003520 con 0x7f4c00150560 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1045571804 0 0) 0x7f4bec003520 con 0x7f4c00150560 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c00150940 msgr2=0x7f4c0015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c00150940 0x7f4c0015d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 >> v2:172.21.15.194:3300/0 conn(0x7f4c0015dec0 msgr2=0x7f4c0015d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 --2- 172.21.15.154:0/1949057163 >> v2:172.21.15.194:3300/0 conn(0x7f4c0015dec0 0x7f4c0015d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000b40c0 con 0x7f4c00150560 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f4bf8001670 con 0x7f4c00150560 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 >> v1:172.21.15.154:6789/0 conn(0x7f4c00150560 legacy=0x7f4c000b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:02.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bec003970 0x7f4bec003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4bec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bec004e10 0x7f4bec005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000b3560 con 0x7f4bec0042d0 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000b3de0 con 0x7f4bec004e10 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bec00bd00 con 0x7f4bec003970 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c05c32640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4bec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c06433640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bec003970 0x7f4bec003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.357+0000 7f4c06c34640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bec004e10 0x7f4bec005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05c32640 1 -- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bec003970 msgr2=0x7f4bec003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05c32640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4bec003970 0x7f4bec003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05c32640 1 -- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bec004e10 msgr2=0x7f4bec005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05c32640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bec004e10 0x7f4bec005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05c32640 1 -- 172.21.15.154:0/1949057163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec003520 con 0x7f4bec0042d0 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05c32640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4bec0047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000aac0 tx=0x7f4bec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9664cf0c8f19a4ec server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0034600 con 0x7f4bec0042d0 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf0030050 con 0x7f4bec0042d0 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.358+0000 7f4c05431640 1 -- 172.21.15.154:0/1949057163 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0034980 con 0x7f4bec0042d0 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c08697640 1 -- 172.21.15.154:0/1949057163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 msgr2=0x7f4bec0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c08697640 1 --2- 172.21.15.154:0/1949057163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4bec0047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000aac0 tx=0x7f4bec0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c06c34640 1 -- 172.21.15.154:0/1949057163 reap_dead start 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c08697640 1 -- 172.21.15.154:0/1949057163 shutdown_connections 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c08697640 1 -- 172.21.15.154:0/1949057163 >> 172.21.15.154:0/1949057163 conn(0x7f4c0006a4d0 msgr2=0x7f4c0006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c08697640 1 -- 172.21.15.154:0/1949057163 shutdown_connections 2023-11-27T22:30:02.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.359+0000 7f4c08697640 1 -- 172.21.15.154:0/1949057163 wait complete. 2023-11-27T22:30:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.360+0000 7f4c08697640 1 Processor -- start 2023-11-27T22:30:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.360+0000 7f4c08697640 1 -- start start 2023-11-27T22:30:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c08697640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4c001ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c08697640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c001f15f0 0x7f4c001e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c08697640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c0014c620 0x7f4c001e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c08697640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001eea00 con 0x7f4bec0042d0 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c08697640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00158aa0 con 0x7f4c0014c620 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c08697640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00158d80 con 0x7f4c001f15f0 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4c001ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4c001ee4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46668/0 (socket says 172.21.15.154:46668) 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 -- 172.21.15.154:0/2820706575 learned_addr learned my addr 172.21.15.154:0/2820706575 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c05c32640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c001f15f0 0x7f4c001e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06c34640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c0014c620 0x7f4c001e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 -- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c001f15f0 msgr2=0x7f4c001e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c001f15f0 0x7f4c001e4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 -- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c0014c620 msgr2=0x7f4c001e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:02.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c0014c620 0x7f4c001e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.361+0000 7f4c06433640 1 -- 172.21.15.154:0/2820706575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00159060 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.362+0000 7f4c06433640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4c001ee4c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8001aa0 tx=0x7f4bf80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.362+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8007ea0 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.362+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf800f990 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.362+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800fd40 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.362+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c00159340 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.362+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00158730 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.363+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c00159860 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.363+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4bf801d460 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.363+0000 7f4bf6ffd640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4be406b1c0 0x7f4be406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.364+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bf8089a80 con 0x7f4bec0042d0 2023-11-27T22:30:02.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.364+0000 7f4c05c32640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4be406b1c0 0x7f4be406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:02.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.364+0000 7f4c05c32640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4be406b1c0 0x7f4be406d680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0037000 tx=0x7f4bf0032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:02.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.368+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4bf8054860 con 0x7f4bec0042d0 2023-11-27T22:30:02.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.570+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c00069400 con 0x7f4bec0042d0 2023-11-27T22:30:02.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.570+0000 7f4bf6ffd640 1 -- 172.21.15.154:0/2820706575 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4bf800fea0 con 0x7f4bec0042d0 2023-11-27T22:30:02.573 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T22:30:02.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4be406b1c0 msgr2=0x7f4be406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:02.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4be406b1c0 0x7f4be406d680 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0037000 tx=0x7f4bf0032000 comp rx=0 tx=0).stop 2023-11-27T22:30:02.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 msgr2=0x7f4c001ee4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:02.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4c001ee4c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8001aa0 tx=0x7f4bf80077a0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 shutdown_connections 2023-11-27T22:30:02.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c0014c620 0x7f4c001e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4be406b1c0 0x7f4be406d680 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c001f15f0 0x7f4c001e4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 --2- 172.21.15.154:0/2820706575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4bec0042d0 0x7f4c001ee4c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:02.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 >> 172.21.15.154:0/2820706575 conn(0x7f4c0006a4d0 msgr2=0x7f4c000cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:02.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 shutdown_connections 2023-11-27T22:30:02.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:02.572+0000 7f4c08697640 1 -- 172.21.15.154:0/2820706575 wait complete. 2023-11-27T22:30:02.585 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T22:30:02.585 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T22:30:02.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-11-27T22:30:02.585 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-27T22:30:02.586 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:02.586 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T22:30:02.586 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T22:30:02.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T22:30:02.587 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-27T22:30:02.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.587 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-11-27T22:30:02.604 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-11-27T22:30:02.605 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42672sec preferred_lft 42672sec 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ae:4a:cf:38:5a:08 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T22:30:02.606 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::248f:8fff:fe27:29a8/64 scope link 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ae:4a:cf:38:5a:08 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ac4a:cfff:fe38:5a08/64 scope link tentative 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:02.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.607 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T22:30:02.679 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-11-27T22:30:02.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.679 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-11-27T22:30:02.739 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-11-27T22:30:02.740 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T22:30:02.740 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T22:30:02.740 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T22:30:02.740 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T22:30:02.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.740 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:02.741 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:02.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T22:30:02.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T22:30:02.742 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T22:30:02.742 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:02.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.838 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-27T22:30:02.852 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T22:30:02.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.853 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-11-27T22:30:02.908 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-27T22:30:02.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.909 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:02.909 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:02.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:02.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-27T22:30:02.909 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:02.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:02.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-27T22:30:03.059 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:03.059 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 96:ae:8d:9e:2b:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::94ae:8dff:fe9e:2bee/64 scope link tentative 2023-11-27T22:30:03.060 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:03.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.128 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 96:ae:8d:9e:2b:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T22:30:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T22:30:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::94ae:8dff:fe9e:2bee/64 scope link tentative 2023-11-27T22:30:03.129 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:03.130 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-27T22:30:03.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:03.130 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:03.131 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:03.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-27T22:30:03.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-27T22:30:03.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-27T22:30:03.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-27T22:30:03.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-27T22:30:03.132 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:03.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:03.256 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:03.256 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:03.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2023-11-27T22:30:03.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2023-11-27T22:30:03.256 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:03.298 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-27T22:30:03.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:03.299 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:03.353 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-27T22:30:03.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:03.354 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:03.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-27T22:30:03.476 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-27T22:30:03.533 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:03.534 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:03.535 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:03.536 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:03.536 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:03.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:03.536 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-27T22:30:03.588 INFO:teuthology.orchestra.run.smithi154.stdout:41 2023-11-27T22:30:03.589 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-27T22:30:03.589 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-27T22:30:03.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-27T22:30:03.660 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-27T22:30:03.716 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-27T22:30:03.717 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:03.718 INFO:teuthology.orchestra.run.smithi154.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:03.719 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:03.719 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:03.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:03.719 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-27T22:30:03.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi154.stderr:2023-11-27T22:30:03.716+0000 7f87d943e480 -1 init, newargv = 0x55b8e0dfe560 newargc=15 2023-11-27T22:30:03.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi154.stderr:ceph-fuse[98743]: starting ceph client 2023-11-27T22:30:03.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi154.stderr:ceph-fuse[98743]: starting fuse 2023-11-27T22:30:03.734 INFO:teuthology.orchestra.run.smithi154.stdout:41 2023-11-27T22:30:03.734 INFO:teuthology.orchestra.run.smithi154.stdout:44 2023-11-27T22:30:03.734 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-11-27T22:30:03.735 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-11-27T22:30:03.736 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T22:30:03.737 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:03.737 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.2")) 2023-11-27T22:30:03.737 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-11-27T22:30:03.854 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.2.98743.asok 2023-11-27T22:30:03.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T22:30:03.865 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.98743.asok 2023-11-27T22:30:03.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:03.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.98743.asok status 2023-11-27T22:30:04.002 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-27T22:30:04.002 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-11-27T22:30:04.002 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "2", 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "98743", 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-11-27T22:30:04.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4704, 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4704 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 4130188829 2023-11-27T22:30:04.004 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 4130188829 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4704 192.168.0.2:0/4130188829", 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.2:0/4130188829", 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 6, 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 20, 2023-11-27T22:30:04.005 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-11-27T22:30:04.006 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-11-27T22:30:04.006 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-11-27T22:30:04.006 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-27T22:30:04.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T22:30:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.108+0000 7f526296f640 1 Processor -- start 2023-11-27T22:30:04.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.108+0000 7f526296f640 1 -- start start 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f526296f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f525c0ceb70 0x7f525c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f526296f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c0b4370 0x7f525c0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f526296f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525c071770 con 0x7f525c144980 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f526296f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525c15ced0 con 0x7f525c0ceb70 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f526296f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c0b4ce0 con 0x7f525c0b4370 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f525bfff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f525c144980 0x7f525c15c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:54676/0 (socket says 172.21.15.154:54676) 2023-11-27T22:30:04.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f525bfff640 1 -- 172.21.15.154:0/2049813375 learned_addr learned my addr 172.21.15.154:0/2049813375 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f525b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f525c0ceb70 0x7f525c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f5260f0c640 1 --2- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c0b4370 0x7f525c0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f525b7fe640 1 -- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c0b4370 msgr2=0x7f525c0b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f525b7fe640 1 --2- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c0b4370 0x7f525c0b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.109+0000 7f525b7fe640 1 -- 172.21.15.154:0/2049813375 >> v1:172.21.15.194:6789/0 conn(0x7f525c144980 legacy=0x7f525c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.110+0000 7f525affd640 1 -- 172.21.15.154:0/2049813375 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569244560 0 0) 0x7f525c071770 con 0x7f525c144980 2023-11-27T22:30:04.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.110+0000 7f525b7fe640 1 -- 172.21.15.154:0/2049813375 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0ccdc0 con 0x7f525c0ceb70 2023-11-27T22:30:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.110+0000 7f525b7fe640 1 --2- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0ceb70 0x7f525c0cc450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52500097a0 tx=0x7f525002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c427b66f05e21e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f525affd640 1 -- 172.21.15.154:0/2049813375 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250031830 con 0x7f525c0ceb70 2023-11-27T22:30:04.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f525affd640 1 -- 172.21.15.154:0/2049813375 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250031990 con 0x7f525c0ceb70 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f525affd640 1 -- 172.21.15.154:0/2049813375 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250031d20 con 0x7f525c0ceb70 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 -- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0ceb70 msgr2=0x7f525c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 --2- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0ceb70 0x7f525c0cc450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f52500097a0 tx=0x7f525002b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 -- 172.21.15.154:0/2049813375 shutdown_connections 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 --2- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c0b4370 0x7f525c0b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 --2- 172.21.15.154:0/2049813375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0ceb70 0x7f525c0cc450 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 -- 172.21.15.154:0/2049813375 >> 172.21.15.154:0/2049813375 conn(0x7f525c06a4d0 msgr2=0x7f525c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 -- 172.21.15.154:0/2049813375 shutdown_connections 2023-11-27T22:30:04.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.111+0000 7f526296f640 1 -- 172.21.15.154:0/2049813375 wait complete. 2023-11-27T22:30:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.112+0000 7f526296f640 1 Processor -- start 2023-11-27T22:30:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 -- start start 2023-11-27T22:30:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0b4370 0x7f525c13d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 0x7f525c154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:04.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c144980 0x7f525c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c13cdf0 con 0x7f525c0ceb70 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525c13eca0 con 0x7f525c0b4370 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f526296f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525c13d750 con 0x7f525c144980 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f525b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 0x7f525c154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f525b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 0x7f525c154bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46676/0 (socket says 172.21.15.154:46676) 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.113+0000 7f525b7fe640 1 -- 172.21.15.154:0/836976392 learned_addr learned my addr 172.21.15.154:0/836976392 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525bfff640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0b4370 0x7f525c13d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f5260f0c640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c144980 0x7f525c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525b7fe640 1 -- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c144980 msgr2=0x7f525c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525b7fe640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c144980 0x7f525c158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525b7fe640 1 -- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0b4370 msgr2=0x7f525c13d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:04.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525b7fe640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0b4370 0x7f525c13d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525b7fe640 1 -- 172.21.15.154:0/836976392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250009400 con 0x7f525c0ceb70 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f525b7fe640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 0x7f525c154bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5250000c00 tx=0x7f52500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5250004230 con 0x7f525c0ceb70 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250004390 con 0x7f525c0ceb70 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525c13c1b0 con 0x7f525c0ceb70 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525003a880 con 0x7f525c0ceb70 2023-11-27T22:30:04.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.114+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525c13ca10 con 0x7f525c0ceb70 2023-11-27T22:30:04.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.115+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525c13cf30 con 0x7f525c0ceb70 2023-11-27T22:30:04.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.116+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f525003a9e0 con 0x7f525c0ceb70 2023-11-27T22:30:04.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.116+0000 7f5258ff9640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f524806b1c0 0x7f524806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:04.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.116+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52500ac0e0 con 0x7f525c0ceb70 2023-11-27T22:30:04.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.116+0000 7f525bfff640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f524806b1c0 0x7f524806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:04.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.116+0000 7f525bfff640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f524806b1c0 0x7f524806d680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f524c000f60 tx=0x7f524c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:04.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.120+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f525c13cf30 con 0x7f525c0ceb70 2023-11-27T22:30:04.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.321+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f525c13cf30 con 0x7f525c0ceb70 2023-11-27T22:30:04.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.321+0000 7f5258ff9640 1 -- 172.21.15.154:0/836976392 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f525c13cf30 con 0x7f525c0ceb70 2023-11-27T22:30:04.323 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T22:30:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f524806b1c0 msgr2=0x7f524806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f524806b1c0 0x7f524806d680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f524c000f60 tx=0x7f524c007d50 comp rx=0 tx=0).stop 2023-11-27T22:30:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 msgr2=0x7f525c154bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 0x7f525c154bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5250000c00 tx=0x7f52500046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 shutdown_connections 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f524806b1c0 0x7f524806d680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f525c144980 0x7f525c158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f525c0ceb70 0x7f525c154bc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 --2- 172.21.15.154:0/836976392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f525c0b4370 0x7f525c13d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 >> 172.21.15.154:0/836976392 conn(0x7f525c06a4d0 msgr2=0x7f525c15bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 shutdown_connections 2023-11-27T22:30:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:04.323+0000 7f526296f640 1 -- 172.21.15.154:0/836976392 wait complete. 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T22:30:04.336 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-27T22:30:04.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.336 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2023-11-27T22:30:04.355 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:04.356 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42663sec preferred_lft 42663sec 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2023-11-27T22:30:04.357 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:04.357 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T22:30:04.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T22:30:04.358 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:04.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.529 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T22:30:04.556 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-11-27T22:30:04.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.558 DEBUG:teuthology.orchestra.run.smithi194:> route 2023-11-27T22:30:04.628 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2023-11-27T22:30:04.629 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T22:30:04.629 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T22:30:04.629 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T22:30:04.629 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T22:30:04.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.629 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:04.629 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:04.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T22:30:04.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T22:30:04.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T22:30:04.630 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:04.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.896 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-11-27T22:30:04.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.913 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2023-11-27T22:30:04.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:04.967 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:04.967 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:04.967 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:04.967 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-27T22:30:04.968 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:05.052 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-27T22:30:05.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-27T22:30:05.053 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:05.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:05.153 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:05.153 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:05.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2023-11-27T22:30:05.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T22:30:05.154 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:05.195 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-27T22:30:05.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:05.196 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:05.251 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-27T22:30:05.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:05.251 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:05.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2023-11-27T22:30:05.375 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:05.431 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2023-11-27T22:30:05.431 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2023-11-27T22:30:05.431 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2023-11-27T22:30:05.431 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2023-11-27T22:30:05.431 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2023-11-27T22:30:05.431 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2023-11-27T22:30:05.432 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2023-11-27T22:30:05.433 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-4 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-5 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-6 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-7 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:05.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:05.434 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2023-11-27T22:30:05.485 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T22:30:05.485 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-27T22:30:05.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2023-11-27T22:30:05.555 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:05.611 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2023-11-27T22:30:05.611 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2023-11-27T22:30:05.611 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2023-11-27T22:30:05.611 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2023-11-27T22:30:05.611 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2023-11-27T22:30:05.612 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2023-11-27T22:30:05.613 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:05.613 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2023-11-27T22:30:05.613 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2023-11-27T22:30:05.614 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2023-11-27T22:30:05.614 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2023-11-27T22:30:05.614 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:05.614 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2023-11-27T22:30:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:05.615 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-4 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-5 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-6 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-7 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2023-11-27T22:30:05.616 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:05.617 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:05.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:05.617 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2023-11-27T22:30:05.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:2023-11-27T22:30:05.622+0000 7fa5b1e38480 -1 init, newargv = 0x56013b20eaa0 newargc=15 2023-11-27T22:30:05.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:ceph-fuse[95475]: starting ceph client 2023-11-27T22:30:05.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi194.stderr:ceph-fuse[95475]: starting fuse 2023-11-27T22:30:05.639 INFO:teuthology.orchestra.run.smithi194.stdout:41 2023-11-27T22:30:05.639 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-27T22:30:05.639 DEBUG:teuthology.orchestra.run.smithi194:> sudo stdin-killer -- python3 -c ' 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> import glob 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> import re 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> import os 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> import subprocess 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> def _find_admin_socket(client_name): 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> files = glob.glob(asok_path) 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:05.640 DEBUG:teuthology.orchestra.run.smithi194:> # Given a non-glob path, it better be there 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> if "*" not in asok_path: 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> assert(len(files) == 1) 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> return files[0] 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> for f in files: 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> contents = proc_f.read() 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> if mountpoint in contents: 2023-11-27T22:30:05.641 DEBUG:teuthology.orchestra.run.smithi194:> return f 2023-11-27T22:30:05.642 DEBUG:teuthology.orchestra.run.smithi194:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T22:30:05.642 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:05.642 DEBUG:teuthology.orchestra.run.smithi194:> print(_find_admin_socket("client.1")) 2023-11-27T22:30:05.642 DEBUG:teuthology.orchestra.run.smithi194:> ' 2023-11-27T22:30:05.759 INFO:teuthology.orchestra.run.smithi194.stdout:/var/run/ceph/ceph-client.1.95475.asok 2023-11-27T22:30:05.762 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:30:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T22:30:05.770 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95475.asok 2023-11-27T22:30:05.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:05.770 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95475.asok status 2023-11-27T22:30:05.907 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-11-27T22:30:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "metadata": { 2023-11-27T22:30:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T22:30:05.907 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "entity_id": "1", 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "hostname": "smithi194", 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "pid": "95475", 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "root": "/" 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_count": 0, 2023-11-27T22:30:05.908 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_pinned_count": 0, 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 4502, 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "inst": { 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "name": { 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "client", 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "num": 4502 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:05.909 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.1:0", 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 2280298120 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2023-11-27T22:30:05.910 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.1:0", 2023-11-27T22:30:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 2280298120 2023-11-27T22:30:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "inst_str": "client.4502 192.168.0.1:0/2280298120", 2023-11-27T22:30:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "addr_str": "192.168.0.1:0/2280298120", 2023-11-27T22:30:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "inode_count": 1, 2023-11-27T22:30:05.911 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_epoch": 6, 2023-11-27T22:30:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch": 20, 2023-11-27T22:30:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch_barrier": 0, 2023-11-27T22:30:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "blocklisted": false, 2023-11-27T22:30:05.912 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "cephfs" 2023-11-27T22:30:05.912 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-11-27T22:30:05.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T22:30:06.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.027+0000 7f7984810640 1 Processor -- start 2023-11-27T22:30:06.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.027+0000 7f7984810640 1 -- start start 2023-11-27T22:30:06.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f7984810640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7980144980 0x7f798015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:06.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f7984810640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f79800cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f7984810640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7980071770 con 0x7f79800b4370 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f7984810640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79800ccdc0 con 0x7f7980144980 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f7984810640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800cd0a0 con 0x7f79800ceb70 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f797e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7980144980 0x7f798015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f797e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7980144980 0x7f798015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46684/0 (socket says 172.21.15.154:46684) 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f797e59c640 1 -- 172.21.15.154:0/523385812 learned_addr learned my addr 172.21.15.154:0/523385812 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.028+0000 7f797dd9b640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f79800cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.029+0000 7f797e59c640 1 -- 172.21.15.154:0/523385812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 msgr2=0x7f79800cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.029+0000 7f797e59c640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f79800cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.029+0000 7f797e59c640 1 -- 172.21.15.154:0/523385812 >> v1:172.21.15.194:6789/0 conn(0x7f79800b4370 legacy=0x7f7980071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.029+0000 7f797e59c640 1 -- 172.21.15.154:0/523385812 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800cd380 con 0x7f7980144980 2023-11-27T22:30:06.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.029+0000 7f797dd9b640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f79800cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.029+0000 7f797e59c640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f798015c7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a73079f225d9d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f797d59a640 1 -- 172.21.15.154:0/523385812 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797002cb00 con 0x7f7980144980 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f797d59a640 1 -- 172.21.15.154:0/523385812 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797002cc60 con 0x7f7980144980 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f797d59a640 1 -- 172.21.15.154:0/523385812 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700343f0 con 0x7f7980144980 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 -- 172.21.15.154:0/523385812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 msgr2=0x7f798015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f798015c7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797002bf60 comp rx=0 tx=0).stop 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 -- 172.21.15.154:0/523385812 shutdown_connections 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f79800cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 --2- 172.21.15.154:0/523385812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f798015c7c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 -- 172.21.15.154:0/523385812 >> 172.21.15.154:0/523385812 conn(0x7f798006a4d0 msgr2=0x7f798006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 -- 172.21.15.154:0/523385812 shutdown_connections 2023-11-27T22:30:06.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.030+0000 7f7984810640 1 -- 172.21.15.154:0/523385812 wait complete. 2023-11-27T22:30:06.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 Processor -- start 2023-11-27T22:30:06.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 -- start start 2023-11-27T22:30:06.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79800b4370 0x7f798013e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:06.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f798013f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:06.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f7980156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800b1c00 con 0x7f7980144980 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798013fc60 con 0x7f79800b4370 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f7984810640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798013ff40 con 0x7f79800ceb70 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f797ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f7980156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f797ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f7980156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46686/0 (socket says 172.21.15.154:46686) 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.032+0000 7f797ed9d640 1 -- 172.21.15.154:0/1234668145 learned_addr learned my addr 172.21.15.154:0/1234668145 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:06.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797dd9b640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f798013f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:06.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797e59c640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79800b4370 0x7f798013e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:06.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797ed9d640 1 -- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 msgr2=0x7f798013f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:06.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797ed9d640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f798013f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797ed9d640 1 -- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79800b4370 msgr2=0x7f798013e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:06.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797ed9d640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79800b4370 0x7f798013e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797ed9d640 1 -- 172.21.15.154:0/1234668145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970009b30 con 0x7f7980144980 2023-11-27T22:30:06.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797e59c640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79800b4370 0x7f798013e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:06.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f797ed9d640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f7980156d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7978001eb0 tx=0x7f797800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:06.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79780052d0 con 0x7f7980144980 2023-11-27T22:30:06.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978005430 con 0x7f7980144980 2023-11-27T22:30:06.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7980140220 con 0x7f7980144980 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978003810 con 0x7f7980144980 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.033+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79801407e0 con 0x7f7980144980 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.034+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7980069400 con 0x7f7980144980 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.035+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7978003970 con 0x7f7980144980 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.035+0000 7f796effd640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f796006b1c0 0x7f796006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.035+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7978088f60 con 0x7f7980144980 2023-11-27T22:30:06.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.035+0000 7f797e59c640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f796006b1c0 0x7f796006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.035+0000 7f797e59c640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f796006b1c0 0x7f796006d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7970035000 tx=0x7f7970030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:06.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.039+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7978053d20 con 0x7f7980144980 2023-11-27T22:30:06.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.240+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79801409a0 con 0x7f7980144980 2023-11-27T22:30:06.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.240+0000 7f796effd640 1 -- 172.21.15.154:0/1234668145 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7978017070 con 0x7f7980144980 2023-11-27T22:30:06.242 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T22:30:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f796006b1c0 msgr2=0x7f796006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f796006b1c0 0x7f796006d680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7970035000 tx=0x7f7970030000 comp rx=0 tx=0).stop 2023-11-27T22:30:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 msgr2=0x7f7980156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f7980156d10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7978001eb0 tx=0x7f797800c890 comp rx=0 tx=0).stop 2023-11-27T22:30:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 shutdown_connections 2023-11-27T22:30:06.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f796006b1c0 0x7f796006d680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7980144980 0x7f7980156d10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f79800ceb70 0x7f798013f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 --2- 172.21.15.154:0/1234668145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79800b4370 0x7f798013e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:06.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 >> 172.21.15.154:0/1234668145 conn(0x7f798006a4d0 msgr2=0x7f798015b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:06.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 shutdown_connections 2023-11-27T22:30:06.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:06.242+0000 7f7984810640 1 -- 172.21.15.154:0/1234668145 wait complete. 2023-11-27T22:30:06.254 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T22:30:06.255 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T22:30:06.255 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2023-11-27T22:30:06.255 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-27T22:30:06.255 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:06.255 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T22:30:06.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T22:30:06.256 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T22:30:06.256 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-27T22:30:06.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.256 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2023-11-27T22:30:06.272 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:06.273 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42661sec preferred_lft 42661sec 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 32:52:7e:f1:2f:ad brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.274 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::b824:ebff:fe69:f2dd/64 scope link tentative 2023-11-27T22:30:06.275 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.275 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T22:30:06.275 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 32:52:7e:f1:2f:ad brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:06.275 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::3052:7eff:fef1:2fad/64 scope link tentative 2023-11-27T22:30:06.275 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.275 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T22:30:06.339 INFO:teuthology.orchestra.run.smithi194.stdout:1 2023-11-27T22:30:06.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.345 DEBUG:teuthology.orchestra.run.smithi194:> route 2023-11-27T22:30:06.400 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2023-11-27T22:30:06.400 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T22:30:06.400 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T22:30:06.400 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T22:30:06.400 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T22:30:06.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.401 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:06.401 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:06.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T22:30:06.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T22:30:06.401 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T22:30:06.401 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:06.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.495 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-11-27T22:30:06.510 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-27T22:30:06.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.512 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2023-11-27T22:30:06.564 INFO:teuthology.orchestra.run.smithi194.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-27T22:30:06.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.565 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:06.565 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:06.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-27T22:30:06.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-27T22:30:06.565 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:06.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.647 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-27T22:30:06.713 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:d1:e5:8e:72:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::10d1:e5ff:fe8e:724f/64 scope link 2023-11-27T22:30:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.716 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-27T22:30:06.782 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:d1:e5:8e:72:4f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-27T22:30:06.783 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::10d1:e5ff:fe8e:724f/64 scope link 2023-11-27T22:30:06.784 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:06.785 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-27T22:30:06.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.785 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:06.785 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:06.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-27T22:30:06.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-27T22:30:06.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-27T22:30:06.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-27T22:30:06.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-27T22:30:06.787 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:06.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:06.914 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2023-11-27T22:30:06.915 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2023-11-27T22:30:06.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.1 up 2023-11-27T22:30:06.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.1 master ceph-brx 2023-11-27T22:30:06.915 DEBUG:teuthology.orchestra.run.smithi194:> ') 2023-11-27T22:30:06.957 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-27T22:30:06.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:06.957 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:07.013 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-27T22:30:07.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:07.013 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:07.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2023-11-27T22:30:07.135 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:07.192 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2023-11-27T22:30:07.192 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2023-11-27T22:30:07.193 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2023-11-27T22:30:07.193 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2023-11-27T22:30:07.193 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2023-11-27T22:30:07.193 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2023-11-27T22:30:07.194 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2023-11-27T22:30:07.194 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2023-11-27T22:30:07.194 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2023-11-27T22:30:07.194 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2023-11-27T22:30:07.195 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2023-11-27T22:30:07.195 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:07.196 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-4 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-5 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-6 2023-11-27T22:30:07.197 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-7 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run.smithi194.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-27T22:30:07.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.198 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2023-11-27T22:30:07.247 INFO:teuthology.orchestra.run.smithi194.stdout:41 2023-11-27T22:30:07.247 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-27T22:30:07.247 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-27T22:30:07.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo modprobe fuse 2023-11-27T22:30:07.315 DEBUG:teuthology.orchestra.run.smithi194:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:07.371 INFO:teuthology.orchestra.run.smithi194.stdout:/proc 2023-11-27T22:30:07.371 INFO:teuthology.orchestra.run.smithi194.stdout:/sys 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/dev 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/security 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/shm 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/pts 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/run 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/cgroup 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/pstore 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/bpf 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/ 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/selinux 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:07.372 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/hugepages 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/dev/mqueue 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/debug 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/tracing 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/sys/kernel/config 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/run/user/1000 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph 2023-11-27T22:30:07.373 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-4 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-5 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-6 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/var/lib/ceph/osd/ceph-7 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run.smithi194.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-27T22:30:07.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.375 DEBUG:teuthology.orchestra.run.smithi194:> ls /sys/fs/fuse/connections 2023-11-27T22:30:07.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi194.stderr:2023-11-27T22:30:07.372+0000 7f3d196d4480 -1 init, newargv = 0x564a8f20e210 newargc=15 2023-11-27T22:30:07.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi194.stderr:ceph-fuse[95923]: starting ceph client 2023-11-27T22:30:07.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi194.stderr:ceph-fuse[95923]: starting fuse 2023-11-27T22:30:07.390 INFO:teuthology.orchestra.run.smithi194.stdout:41 2023-11-27T22:30:07.390 INFO:teuthology.orchestra.run.smithi194.stdout:44 2023-11-27T22:30:07.391 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-27T22:30:07.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo stdin-killer -- python3 -c ' 2023-11-27T22:30:07.391 DEBUG:teuthology.orchestra.run.smithi194:> import glob 2023-11-27T22:30:07.391 DEBUG:teuthology.orchestra.run.smithi194:> import re 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> import os 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> import subprocess 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> def _find_admin_socket(client_name): 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> files = glob.glob(asok_path) 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-27T22:30:07.392 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> # Given a non-glob path, it better be there 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> if "*" not in asok_path: 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> assert(len(files) == 1) 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> return files[0] 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> for f in files: 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T22:30:07.393 DEBUG:teuthology.orchestra.run.smithi194:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> contents = proc_f.read() 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> if mountpoint in contents: 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> return f 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> print(_find_admin_socket("client.3")) 2023-11-27T22:30:07.394 DEBUG:teuthology.orchestra.run.smithi194:> ' 2023-11-27T22:30:07.509 INFO:teuthology.orchestra.run.smithi194.stdout:/var/run/ceph/ceph-client.3.95923.asok 2023-11-27T22:30:07.512 INFO:teuthology.orchestra.run.smithi194.stderr:2023-11-27T22:30:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T22:30:07.519 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.95923.asok 2023-11-27T22:30:07.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.520 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.95923.asok status 2023-11-27T22:30:07.655 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "metadata": { 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "entity_id": "3", 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "hostname": "smithi194", 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "pid": "95923", 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "root": "/" 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:07.656 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_count": 0, 2023-11-27T22:30:07.657 INFO:teuthology.orchestra.run.smithi194.stdout: "dentry_pinned_count": 0, 2023-11-27T22:30:07.657 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 4651, 2023-11-27T22:30:07.657 INFO:teuthology.orchestra.run.smithi194.stdout: "inst": { 2023-11-27T22:30:07.657 INFO:teuthology.orchestra.run.smithi194.stdout: "name": { 2023-11-27T22:30:07.657 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "client", 2023-11-27T22:30:07.658 INFO:teuthology.orchestra.run.smithi194.stdout: "num": 4651 2023-11-27T22:30:07.658 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:07.658 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2023-11-27T22:30:07.658 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2023-11-27T22:30:07.658 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.2:0", 2023-11-27T22:30:07.659 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 1807200869 2023-11-27T22:30:07.659 INFO:teuthology.orchestra.run.smithi194.stdout: } 2023-11-27T22:30:07.659 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:07.659 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": { 2023-11-27T22:30:07.659 INFO:teuthology.orchestra.run.smithi194.stdout: "type": "v1", 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "addr": "192.168.0.2:0", 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "nonce": 1807200869 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "inst_str": "client.4651 192.168.0.2:0/1807200869", 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "addr_str": "192.168.0.2:0/1807200869", 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "inode_count": 1, 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_epoch": 6, 2023-11-27T22:30:07.660 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch": 20, 2023-11-27T22:30:07.661 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_epoch_barrier": 0, 2023-11-27T22:30:07.661 INFO:teuthology.orchestra.run.smithi194.stdout: "blocklisted": false, 2023-11-27T22:30:07.661 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "cephfs" 2023-11-27T22:30:07.661 INFO:teuthology.orchestra.run.smithi194.stdout:} 2023-11-27T22:30:07.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.664 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-11-27T22:30:07.664 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:07.683 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-11-27T22:30:07.684 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:07.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:07.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.757 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-11-27T22:30:07.757 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:07.815 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-11-27T22:30:07.816 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:07.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:07.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.888 DEBUG:teuthology.orchestra.run.smithi194:> stat --file-system '--printf=%T 2023-11-27T22:30:07.888 DEBUG:teuthology.orchestra.run.smithi194:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:07.904 INFO:teuthology.orchestra.run.smithi194.stdout:fuseblk 2023-11-27T22:30:07.904 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:07.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:07.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:07.972 DEBUG:teuthology.orchestra.run.smithi194:> stat --file-system '--printf=%T 2023-11-27T22:30:07.972 DEBUG:teuthology.orchestra.run.smithi194:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:08.027 INFO:teuthology.orchestra.run.smithi194.stdout:fuseblk 2023-11-27T22:30:08.027 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:08.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:08.027 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:08.094 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-27T22:30:08.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:08.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.221+0000 7f91308e5640 1 Processor -- start 2023-11-27T22:30:08.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.221+0000 7f91308e5640 1 -- start start 2023-11-27T22:30:08.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f91308e5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 0x7f912c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f91308e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 0x7f912c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f91308e5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c15e2a0 con 0x7f912c143490 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f91308e5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c15b520 con 0x7f912c0b1400 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f91308e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c143870 con 0x7f912c15e730 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f9123fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 0x7f912c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912ad9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 0x7f912c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912a59c640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f912c143490 0x7f912c0b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:54702/0 (socket says 172.21.15.154:54702) 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f9123fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 0x7f912c15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:44512/0 (socket says 172.21.15.154:44512) 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912ad9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 0x7f912c15aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:49724/0 (socket says 172.21.15.154:49724) 2023-11-27T22:30:08.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912a59c640 1 -- 172.21.15.154:0/2879768639 learned_addr learned my addr 172.21.15.154:0/2879768639 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:08.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912ad9d640 1 -- 172.21.15.154:0/2879768639 >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 msgr2=0x7f912c15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:08.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912ad9d640 1 --2- 172.21.15.154:0/2879768639 >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 0x7f912c15a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912ad9d640 1 -- 172.21.15.154:0/2879768639 >> v1:172.21.15.194:6789/0 conn(0x7f912c143490 legacy=0x7f912c0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f912ad9d640 1 -- 172.21.15.154:0/2879768639 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c15b240 con 0x7f912c15e730 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f9129d9b640 1 -- 172.21.15.154:0/2879768639 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006545251 0 0) 0x7f912c15e2a0 con 0x7f912c143490 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.222+0000 7f9123fff640 1 --2- 172.21.15.154:0/2879768639 >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 0x7f912c15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.223+0000 7f912ad9d640 1 --2- 172.21.15.154:0/2879768639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 0x7f912c15aa20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9124009d90 tx=0x7f912402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcde0e063974729 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.223+0000 7f9129d9b640 1 -- 172.21.15.154:0/2879768639 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912402cc60 con 0x7f912c15e730 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.223+0000 7f9129d9b640 1 -- 172.21.15.154:0/2879768639 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912402cdc0 con 0x7f912c15e730 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.223+0000 7f9129d9b640 1 -- 172.21.15.154:0/2879768639 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124034660 con 0x7f912c15e730 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 -- 172.21.15.154:0/2879768639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 msgr2=0x7f912c15aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 --2- 172.21.15.154:0/2879768639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 0x7f912c15aa20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9124009d90 tx=0x7f912402beb0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 -- 172.21.15.154:0/2879768639 shutdown_connections 2023-11-27T22:30:08.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 --2- 172.21.15.154:0/2879768639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c15e730 0x7f912c15aa20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 --2- 172.21.15.154:0/2879768639 >> v2:172.21.15.194:3300/0 conn(0x7f912c0b1400 0x7f912c15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 -- 172.21.15.154:0/2879768639 >> 172.21.15.154:0/2879768639 conn(0x7f912c06a4d0 msgr2=0x7f912c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:08.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 -- 172.21.15.154:0/2879768639 shutdown_connections 2023-11-27T22:30:08.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.224+0000 7f91308e5640 1 -- 172.21.15.154:0/2879768639 wait complete. 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.225+0000 7f91308e5640 1 Processor -- start 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.225+0000 7f91308e5640 1 -- start start 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f91308e5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 0x7f912c139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f91308e5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c143490 0x7f912c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f91308e5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912c15e730 0x7f912c13e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f91308e5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c13c990 con 0x7f912c0b1400 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f91308e5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c13a030 con 0x7f912c15e730 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f91308e5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c13bd80 con 0x7f912c143490 2023-11-27T22:30:08.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 0x7f912c139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 0x7f912c139af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:46700/0 (socket says 172.21.15.154:46700) 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 -- 172.21.15.154:0/63372414 learned_addr learned my addr 172.21.15.154:0/63372414 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912ad9d640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912c15e730 0x7f912c13e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f9123fff640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c143490 0x7f912c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 -- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c143490 msgr2=0x7f912c13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c143490 0x7f912c13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 -- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912c15e730 msgr2=0x7f912c13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.226+0000 7f912a59c640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912c15e730 0x7f912c13e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f912a59c640 1 -- 172.21.15.154:0/63372414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9114009400 con 0x7f912c0b1400 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f912a59c640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 0x7f912c139af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c4d0 tx=0x7f911c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0074e0 con 0x7f912c0b1400 2023-11-27T22:30:08.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c007660 con 0x7f912c0b1400 2023-11-27T22:30:08.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9124009a70 con 0x7f912c0b1400 2023-11-27T22:30:08.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c004a20 con 0x7f912c0b1400 2023-11-27T22:30:08.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.227+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c13c340 con 0x7f912c0b1400 2023-11-27T22:30:08.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.228+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c069400 con 0x7f912c0b1400 2023-11-27T22:30:08.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.228+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f911c004b80 con 0x7f912c0b1400 2023-11-27T22:30:08.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.229+0000 7f9122ffd640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f910c06b1c0 0x7f910c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.229+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f911c088af0 con 0x7f912c0b1400 2023-11-27T22:30:08.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.229+0000 7f9123fff640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f910c06b1c0 0x7f910c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.229+0000 7f9123fff640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f910c06b1c0 0x7f910c06d680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f912c13a500 tx=0x7f9114009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.233+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f911c0538e0 con 0x7f912c0b1400 2023-11-27T22:30:08.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.403+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f912c0b3ef0 con 0x7f912c0b1400 2023-11-27T22:30:08.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.404+0000 7f9122ffd640 1 -- 172.21.15.154:0/63372414 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f911c056f00 con 0x7f912c0b1400 2023-11-27T22:30:08.406 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:08.406 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f910c06b1c0 msgr2=0x7f910c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f910c06b1c0 0x7f910c06d680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f912c13a500 tx=0x7f9114009190 comp rx=0 tx=0).stop 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 msgr2=0x7f912c139af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 0x7f912c139af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c4d0 tx=0x7f911c00c990 comp rx=0 tx=0).stop 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 shutdown_connections 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f912c15e730 0x7f912c13e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f910c06b1c0 0x7f910c06d680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912c143490 0x7f912c13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 --2- 172.21.15.154:0/63372414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f912c0b1400 0x7f912c139af0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 >> 172.21.15.154:0/63372414 conn(0x7f912c06a4d0 msgr2=0x7f912c0af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:08.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 shutdown_connections 2023-11-27T22:30:08.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.406+0000 7f91308e5640 1 -- 172.21.15.154:0/63372414 wait complete. 2023-11-27T22:30:08.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:08.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:08.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.521+0000 7fd9bb5b0640 1 Processor -- start 2023-11-27T22:30:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.521+0000 7fd9bb5b0640 1 -- start start 2023-11-27T22:30:08.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9bb5b0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9b40b4370 0x7fd9b40b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9bb5b0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b4071770 con 0x7fd9b4144980 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9bb5b0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b40ccb60 con 0x7fd9b40ceb70 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9bb5b0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b415ced0 con 0x7fd9b40b4370 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b9b4d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9b40b4370 0x7fd9b40b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b934c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd9b4144980 0x7fd9b415c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37764/0 (socket says 172.21.15.154:37764) 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b934c640 1 -- 172.21.15.154:0/1697893989 learned_addr learned my addr 172.21.15.154:0/1697893989 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b9b4d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9b40b4370 0x7fd9b40b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44018/0 (socket says 172.21.15.154:44018) 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b9b4d640 1 -- 172.21.15.154:0/1697893989 >> v1:172.21.15.194:6789/0 conn(0x7fd9b40ceb70 legacy=0x7fd9b40cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b9b4d640 1 -- 172.21.15.154:0/1697893989 >> v1:172.21.15.154:6789/0 conn(0x7fd9b4144980 legacy=0x7fd9b415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.522+0000 7fd9b9b4d640 1 -- 172.21.15.154:0/1697893989 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40b4ce0 con 0x7fd9b40b4370 2023-11-27T22:30:08.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.523+0000 7fd9b9b4d640 1 --2- 172.21.15.154:0/1697893989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40b4370 0x7fd9b40b47a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40b4e70 tx=0x7fd9ac02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b4cccfc1125d7d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.523+0000 7fd9abfff640 1 -- 172.21.15.154:0/1697893989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac02cc50 con 0x7fd9b40b4370 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.523+0000 7fd9abfff640 1 -- 172.21.15.154:0/1697893989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac02cdb0 con 0x7fd9b40b4370 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.523+0000 7fd9abfff640 1 -- 172.21.15.154:0/1697893989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac034660 con 0x7fd9b40b4370 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/1697893989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40b4370 msgr2=0x7fd9b40b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/1697893989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40b4370 0x7fd9b40b47a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40b4e70 tx=0x7fd9ac02bea0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/1697893989 shutdown_connections 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/1697893989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40b4370 0x7fd9b40b47a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/1697893989 >> 172.21.15.154:0/1697893989 conn(0x7fd9b406a4d0 msgr2=0x7fd9b406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/1697893989 shutdown_connections 2023-11-27T22:30:08.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.524+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/1697893989 wait complete. 2023-11-27T22:30:08.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.525+0000 7fd9bb5b0640 1 Processor -- start 2023-11-27T22:30:08.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.525+0000 7fd9bb5b0640 1 -- start start 2023-11-27T22:30:08.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.525+0000 7fd9bb5b0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9b40b4370 0x7fd9b413a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9bb5b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 0x7fd9b4140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9bb5b0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b4144980 0x7fd9b41405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9bb5b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b415e7d0 con 0x7fd9b40ceb70 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9bb5b0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c8fa0 con 0x7fd9b4144980 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9bb5b0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b4140b10 con 0x7fd9b40b4370 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 0x7fd9b4140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 0x7fd9b4140090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44022/0 (socket says 172.21.15.154:44022) 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 -- 172.21.15.154:0/3872171216 learned_addr learned my addr 172.21.15.154:0/3872171216 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b934c640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9b40b4370 0x7fd9b413a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b9b4d640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b4144980 0x7fd9b41405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 -- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9b40b4370 msgr2=0x7fd9b413a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9b40b4370 0x7fd9b413a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 -- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b4144980 msgr2=0x7fd9b41405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b4144980 0x7fd9b41405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 -- 172.21.15.154:0/3872171216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009a70 con 0x7fd9b40ceb70 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9b8b4b640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 0x7fd9b4140090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c460 tx=0x7fd9a400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4012830 con 0x7fd9b40ceb70 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a40129d0 con 0x7fd9b40ceb70 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b40b3ba0 con 0x7fd9b40ceb70 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.526+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4012d80 con 0x7fd9b40ceb70 2023-11-27T22:30:08.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.527+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b40c8950 con 0x7fd9b40ceb70 2023-11-27T22:30:08.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.528+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b4069400 con 0x7fd9b40ceb70 2023-11-27T22:30:08.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.528+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd9a401a3b0 con 0x7fd9b40ceb70 2023-11-27T22:30:08.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.528+0000 7fd9a9ffb640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.528+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9a4089560 con 0x7fd9b40ceb70 2023-11-27T22:30:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.528+0000 7fd9b934c640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.529+0000 7fd9b934c640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0005880 tx=0x7fd9b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.532+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd9a4054340 con 0x7fd9b40ceb70 2023-11-27T22:30:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.698+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9b4143e70 con 0x7fd9b40ceb70 2023-11-27T22:30:08.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.699+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/3872171216 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9a4057960 con 0x7fd9b40ceb70 2023-11-27T22:30:08.701 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:08.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 msgr2=0x7fd99806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0005880 tx=0x7fd9b0009040 comp rx=0 tx=0).stop 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 msgr2=0x7fd9b4140090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 0x7fd9b4140090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd9a400c460 tx=0x7fd9a400c920 comp rx=0 tx=0).stop 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 shutdown_connections 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9b4144980 0x7fd9b41405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b40ceb70 0x7fd9b4140090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 --2- 172.21.15.154:0/3872171216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9b40b4370 0x7fd9b413a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 >> 172.21.15.154:0/3872171216 conn(0x7fd9b406a4d0 msgr2=0x7fd9b406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 shutdown_connections 2023-11-27T22:30:08.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.701+0000 7fd9bb5b0640 1 -- 172.21.15.154:0/3872171216 wait complete. 2023-11-27T22:30:08.713 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.814+0000 7f6a0a9b7640 1 Processor -- start 2023-11-27T22:30:08.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.814+0000 7f6a0a9b7640 1 -- start start 2023-11-27T22:30:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a0a9b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a04143490 0x7f6a040b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a0a9b7640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0415e2a0 con 0x7f6a0415abf0 2023-11-27T22:30:08.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a0a9b7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0415b240 con 0x7f6a0415e730 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a0a9b7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0415b520 con 0x7f6a04143490 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a08f54640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6a0415abf0 0x7f6a040b2f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37774/0 (socket says 172.21.15.154:37774) 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a08f54640 1 -- 172.21.15.154:0/773994301 learned_addr learned my addr 172.21.15.154:0/773994301 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a03fff640 1 --2- 172.21.15.154:0/773994301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a04143490 0x7f6a040b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441370746 0 0) 0x7f6a0415e2a0 con 0x7f6a0415abf0 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.815+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69ec003520 con 0x7f6a0415abf0 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018883233 0 0) 0x7f6a0415b240 con 0x7f6a0415e730 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0415e2a0 con 0x7f6a0415e730 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722078811 0 0) 0x7f69ec003520 con 0x7f6a0415abf0 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a03fff640 1 -- 172.21.15.154:0/773994301 >> v1:172.21.15.194:6789/0 conn(0x7f6a0415e730 legacy=0x7f6a0415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a03fff640 1 -- 172.21.15.154:0/773994301 >> v1:172.21.15.154:6789/0 conn(0x7f6a0415abf0 legacy=0x7f6a040b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a03fff640 1 -- 172.21.15.154:0/773994301 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0415dc50 con 0x7f6a04143490 2023-11-27T22:30:08.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.816+0000 7f6a03fff640 1 --2- 172.21.15.154:0/773994301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a04143490 0x7f6a040b0cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097d0 tx=0x7f69f402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f849c6f6062735ed server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0019f0 con 0x7f6a04143490 2023-11-27T22:30:08.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f402e050 con 0x7f6a04143490 2023-11-27T22:30:08.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a02ffd640 1 -- 172.21.15.154:0/773994301 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4030710 con 0x7f6a04143490 2023-11-27T22:30:08.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/773994301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a04143490 msgr2=0x7f6a040b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/773994301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a04143490 0x7f6a040b0cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f69f40097d0 tx=0x7f69f402b800 comp rx=0 tx=0).stop 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/773994301 shutdown_connections 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/773994301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a04143490 0x7f6a040b0cf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/773994301 >> 172.21.15.154:0/773994301 conn(0x7f6a0406a4d0 msgr2=0x7f6a0406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/773994301 shutdown_connections 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.817+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/773994301 wait complete. 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.818+0000 7f6a0a9b7640 1 Processor -- start 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 -- start start 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 0x7f6a040aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0415abf0 0x7f6a04159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0415e730 0x7f6a040b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040ab100 con 0x7f6a04143490 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a040b0ad0 con 0x7f6a0415e730 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a0a9b7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0413c570 con 0x7f6a0415abf0 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 0x7f6a040aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a03fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 0x7f6a040aabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44024/0 (socket says 172.21.15.154:44024) 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a03fff640 1 -- 172.21.15.154:0/3496471267 learned_addr learned my addr 172.21.15.154:0/3496471267 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a037fe640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0415abf0 0x7f6a04159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.819+0000 7f6a08f54640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0415e730 0x7f6a040b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a03fff640 1 -- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0415abf0 msgr2=0x7f6a04159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a03fff640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0415abf0 0x7f6a04159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a03fff640 1 -- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0415e730 msgr2=0x7f6a040b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:08.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a03fff640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0415e730 0x7f6a040b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a03fff640 1 -- 172.21.15.154:0/3496471267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009400 con 0x7f6a04143490 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a03fff640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 0x7f6a040aabc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000c00 tx=0x7f69f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f403d890 con 0x7f6a04143490 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f403da10 con 0x7f6a04143490 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0413c850 con 0x7f6a04143490 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f403ddc0 con 0x7f6a04143490 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.820+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0413ce10 con 0x7f6a04143490 2023-11-27T22:30:08.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.821+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a04069400 con 0x7f6a04143490 2023-11-27T22:30:08.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.822+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f69f4039040 con 0x7f6a04143490 2023-11-27T22:30:08.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.822+0000 7f6a00ff9640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f69f006b1c0 0x7f69f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:08.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.822+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69f40ab8a0 con 0x7f6a04143490 2023-11-27T22:30:08.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.822+0000 7f6a037fe640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f69f006b1c0 0x7f69f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:08.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.822+0000 7f6a037fe640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f69f006b1c0 0x7f69f006d680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a041f2fb0 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:08.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.826+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f69f40767b0 con 0x7f6a04143490 2023-11-27T22:30:08.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:08.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.998+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a040b2820 con 0x7f6a04143490 2023-11-27T22:30:09.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:08.999+0000 7f6a00ff9640 1 -- 172.21.15.154:0/3496471267 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69f404d0a0 con 0x7f6a04143490 2023-11-27T22:30:09.000 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.000+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f69f006b1c0 msgr2=0x7f69f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.000+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f69f006b1c0 0x7f69f006d680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6a041f2fb0 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2023-11-27T22:30:09.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.000+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 msgr2=0x7f6a040aabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.000+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 0x7f6a040aabc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000c00 tx=0x7f69f40046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.000+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 shutdown_connections 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0415e730 0x7f6a040b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f69f006b1c0 0x7f69f006d680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0415abf0 0x7f6a04159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 --2- 172.21.15.154:0/3496471267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a04143490 0x7f6a040aabc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 >> 172.21.15.154:0/3496471267 conn(0x7f6a0406a4d0 msgr2=0x7f6a04141e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 shutdown_connections 2023-11-27T22:30:09.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.001+0000 7f6a0a9b7640 1 -- 172.21.15.154:0/3496471267 wait complete. 2023-11-27T22:30:09.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:09.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.115+0000 7f16f4339640 1 Processor -- start 2023-11-27T22:30:09.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.115+0000 7f16f4339640 1 -- start start 2023-11-27T22:30:09.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f4339640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16ec1432a0 0x7f16ec15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f4339640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16ec06abe0 0x7f16ec1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f4339640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec06e960 con 0x7f16ec143680 2023-11-27T22:30:09.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f4339640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec15dec0 con 0x7f16ec1432a0 2023-11-27T22:30:09.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f4339640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec15e1a0 con 0x7f16ec06abe0 2023-11-27T22:30:09.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f20d5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16ec1432a0 0x7f16ec15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f18d4640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f16ec143680 0x7f16ec06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37782/0 (socket says 172.21.15.154:37782) 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.116+0000 7f16f18d4640 1 -- 172.21.15.154:0/3398917220 learned_addr learned my addr 172.21.15.154:0/3398917220 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f28d6640 1 --2- 172.21.15.154:0/3398917220 >> v2:172.21.15.194:3300/0 conn(0x7f16ec06abe0 0x7f16ec1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f20d5640 1 -- 172.21.15.154:0/3398917220 >> v2:172.21.15.194:3300/0 conn(0x7f16ec06abe0 msgr2=0x7f16ec1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f20d5640 1 --2- 172.21.15.154:0/3398917220 >> v2:172.21.15.194:3300/0 conn(0x7f16ec06abe0 0x7f16ec1409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f20d5640 1 -- 172.21.15.154:0/3398917220 >> v1:172.21.15.154:6789/0 conn(0x7f16ec143680 legacy=0x7f16ec06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f20d5640 1 -- 172.21.15.154:0/3398917220 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec15e480 con 0x7f16ec1432a0 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f10d3640 1 -- 172.21.15.154:0/3398917220 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797443160 0 0) 0x7f16ec06e960 con 0x7f16ec143680 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f28d6640 1 --2- 172.21.15.154:0/3398917220 >> v2:172.21.15.194:3300/0 conn(0x7f16ec06abe0 0x7f16ec1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:09.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.117+0000 7f16f20d5640 1 --2- 172.21.15.154:0/3398917220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec15d8e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0ace00 tx=0x7f16e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cca348f0b5a2695 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f10d3640 1 -- 172.21.15.154:0/3398917220 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e802cc80 con 0x7f16ec1432a0 2023-11-27T22:30:09.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f10d3640 1 -- 172.21.15.154:0/3398917220 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e802cde0 con 0x7f16ec1432a0 2023-11-27T22:30:09.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f10d3640 1 -- 172.21.15.154:0/3398917220 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8034660 con 0x7f16ec1432a0 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 -- 172.21.15.154:0/3398917220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 msgr2=0x7f16ec15d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 --2- 172.21.15.154:0/3398917220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec15d8e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0ace00 tx=0x7f16e802bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 -- 172.21.15.154:0/3398917220 shutdown_connections 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 --2- 172.21.15.154:0/3398917220 >> v2:172.21.15.194:3300/0 conn(0x7f16ec06abe0 0x7f16ec1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 --2- 172.21.15.154:0/3398917220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec15d8e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 -- 172.21.15.154:0/3398917220 >> 172.21.15.154:0/3398917220 conn(0x7f16ec0b1de0 msgr2=0x7f16ec0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 -- 172.21.15.154:0/3398917220 shutdown_connections 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.118+0000 7f16f4339640 1 -- 172.21.15.154:0/3398917220 wait complete. 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.119+0000 7f16f4339640 1 Processor -- start 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.119+0000 7f16f4339640 1 -- start start 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f4339640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16ec06abe0 0x7f16ec156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f4339640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec1f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f4339640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16ec143680 0x7f16ec159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f4339640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec156a60 con 0x7f16ec1432a0 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f4339640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec15ce70 con 0x7f16ec143680 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f4339640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec157fa0 con 0x7f16ec06abe0 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f18d4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec1f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f18d4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec1f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44042/0 (socket says 172.21.15.154:44042) 2023-11-27T22:30:09.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f18d4640 1 -- 172.21.15.154:0/2641216572 learned_addr learned my addr 172.21.15.154:0/2641216572 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f20d5640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16ec06abe0 0x7f16ec156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.120+0000 7f16f28d6640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16ec143680 0x7f16ec159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f18d4640 1 -- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16ec06abe0 msgr2=0x7f16ec156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f18d4640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16ec06abe0 0x7f16ec156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f18d4640 1 -- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16ec143680 msgr2=0x7f16ec159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f18d4640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16ec143680 0x7f16ec159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f18d4640 1 -- 172.21.15.154:0/2641216572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8009a70 con 0x7f16ec1432a0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f18d4640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec1f3e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c430 tx=0x7f16dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc0074e0 con 0x7f16ec1432a0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc007660 con 0x7f16ec1432a0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec158280 con 0x7f16ec1432a0 2023-11-27T22:30:09.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc004a20 con 0x7f16ec1432a0 2023-11-27T22:30:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.121+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec158840 con 0x7f16ec1432a0 2023-11-27T22:30:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.122+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec0afbc0 con 0x7f16ec1432a0 2023-11-27T22:30:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.122+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f16dc004b80 con 0x7f16ec1432a0 2023-11-27T22:30:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.123+0000 7f16e2ffd640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f16d006b1c0 0x7f16d006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.123+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16dc0898d0 con 0x7f16ec1432a0 2023-11-27T22:30:09.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.123+0000 7f16f20d5640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f16d006b1c0 0x7f16d006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.123+0000 7f16f20d5640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f16d006b1c0 0x7f16d006d680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16e8036000 tx=0x7f16e8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.127+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f16dc054600 con 0x7f16ec1432a0 2023-11-27T22:30:09.294 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.293+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16ec067420 con 0x7f16ec1432a0 2023-11-27T22:30:09.295 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.293+0000 7f16e2ffd640 1 -- 172.21.15.154:0/2641216572 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16dc057c20 con 0x7f16ec1432a0 2023-11-27T22:30:09.295 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f16d006b1c0 msgr2=0x7f16d006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f16d006b1c0 0x7f16d006d680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16e8036000 tx=0x7f16e8030000 comp rx=0 tx=0).stop 2023-11-27T22:30:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 msgr2=0x7f16ec1f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec1f3e10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c430 tx=0x7f16dc00c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 shutdown_connections 2023-11-27T22:30:09.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16ec143680 0x7f16ec159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f16d006b1c0 0x7f16d006d680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16ec1432a0 0x7f16ec1f3e10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 --2- 172.21.15.154:0/2641216572 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16ec06abe0 0x7f16ec156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 >> 172.21.15.154:0/2641216572 conn(0x7f16ec0b1de0 msgr2=0x7f16ec160380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 shutdown_connections 2023-11-27T22:30:09.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.295+0000 7f16f4339640 1 -- 172.21.15.154:0/2641216572 wait complete. 2023-11-27T22:30:09.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:09.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.406+0000 7fed047d0640 1 Processor -- start 2023-11-27T22:30:09.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.406+0000 7fed047d0640 1 -- start start 2023-11-27T22:30:09.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed047d0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecfc15d2b0 0x7fecfc071c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed047d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc0ae480 0x7fecfc0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed047d0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc0ae910 con 0x7fecfc072840 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed047d0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0b2200 con 0x7fecfc15d2b0 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed047d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0b24e0 con 0x7fecfc0ae480 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed0256c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecfc15d2b0 0x7fecfc071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed0256c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fecfc15d2b0 0x7fecfc071c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44050/0 (socket says 172.21.15.154:44050) 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed02d6d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fecfc072840 0x7fecfc06d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37790/0 (socket says 172.21.15.154:37790) 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed0256c640 1 -- 172.21.15.154:0/1971280770 learned_addr learned my addr 172.21.15.154:0/1971280770 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.407+0000 7fed01d6b640 1 --2- 172.21.15.154:0/1971280770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc0ae480 0x7fecfc0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0256c640 1 -- 172.21.15.154:0/1971280770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc0ae480 msgr2=0x7fecfc0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0256c640 1 --2- 172.21.15.154:0/1971280770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc0ae480 0x7fecfc0721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0256c640 1 -- 172.21.15.154:0/1971280770 >> v1:172.21.15.154:6789/0 conn(0x7fecfc072840 legacy=0x7fecfc06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0156a640 1 -- 172.21.15.154:0/1971280770 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278681019 0 0) 0x7fecfc0ae910 con 0x7fecfc072840 2023-11-27T22:30:09.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0256c640 1 -- 172.21.15.154:0/1971280770 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0b40a0 con 0x7fecfc15d2b0 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0256c640 1 --2- 172.21.15.154:0/1971280770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc15d2b0 0x7fecfc071c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009e50 tx=0x7fecf802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9f2eb7daef6e0a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0156a640 1 -- 172.21.15.154:0/1971280770 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf802ca70 con 0x7fecfc15d2b0 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0156a640 1 -- 172.21.15.154:0/1971280770 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf802cbd0 con 0x7fecfc15d2b0 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.408+0000 7fed0156a640 1 -- 172.21.15.154:0/1971280770 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf80343f0 con 0x7fecfc15d2b0 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 -- 172.21.15.154:0/1971280770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc15d2b0 msgr2=0x7fecfc071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 --2- 172.21.15.154:0/1971280770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc15d2b0 0x7fecfc071c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fecf8009e50 tx=0x7fecf802bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 -- 172.21.15.154:0/1971280770 shutdown_connections 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 --2- 172.21.15.154:0/1971280770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc0ae480 0x7fecfc0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 --2- 172.21.15.154:0/1971280770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc15d2b0 0x7fecfc071c80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 -- 172.21.15.154:0/1971280770 >> 172.21.15.154:0/1971280770 conn(0x7fecfc0b4720 msgr2=0x7fecfc0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 -- 172.21.15.154:0/1971280770 shutdown_connections 2023-11-27T22:30:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.409+0000 7fed047d0640 1 -- 172.21.15.154:0/1971280770 wait complete. 2023-11-27T22:30:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.410+0000 7fed047d0640 1 Processor -- start 2023-11-27T22:30:09.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.410+0000 7fed047d0640 1 -- start start 2023-11-27T22:30:09.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed047d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc072840 0x7fecfc1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed047d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc15d2b0 0x7fecfc14c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed047d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 0x7fecfc14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed047d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0afa20 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed047d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0afd00 con 0x7fecfc15d2b0 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed047d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0affe0 con 0x7fecfc072840 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 0x7fecfc14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 0x7fecfc14cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44056/0 (socket says 172.21.15.154:44056) 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 -- 172.21.15.154:0/184484359 learned_addr learned my addr 172.21.15.154:0/184484359 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed0256c640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc072840 0x7fecfc1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed01d6b640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc15d2b0 0x7fecfc14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 -- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc072840 msgr2=0x7fecfc1482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc072840 0x7fecfc1482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 -- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc15d2b0 msgr2=0x7fecfc14c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc15d2b0 0x7fecfc14c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed02d6d640 1 -- 172.21.15.154:0/184484359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf8009b30 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.411+0000 7fed01d6b640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc15d2b0 0x7fecfc14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.412+0000 7fed02d6d640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 0x7fecfc14cdb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c430 tx=0x7fecf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.412+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf40074e0 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.412+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf4007660 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.412+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4004a20 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.412+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc0b2af0 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.412+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc0b05a0 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.413+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc0b2950 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.413+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fecf4004b80 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.413+0000 7fecf2ffd640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fece006b1c0 0x7fece006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.414+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecf4089840 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.414+0000 7fed0256c640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fece006b1c0 0x7fece006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.414+0000 7fed0256c640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fece006b1c0 0x7fece006d680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fecf8035000 tx=0x7fecf8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.418+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fecfc0b2950 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.585+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc0b2950 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.588 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.587+0000 7fecf2ffd640 1 -- 172.21.15.154:0/184484359 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fecfc0b2950 con 0x7fecfc1f5eb0 2023-11-27T22:30:09.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:09.589 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.588+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fece006b1c0 msgr2=0x7fece006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.588+0000 7fed047d0640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fece006b1c0 0x7fece006d680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fecf8035000 tx=0x7fecf8030000 comp rx=0 tx=0).stop 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.588+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 msgr2=0x7fecfc14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.588+0000 7fed047d0640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 0x7fecfc14cdb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c430 tx=0x7fecf400c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 shutdown_connections 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fecfc15d2b0 0x7fecfc14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fece006b1c0 0x7fece006d680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fecfc1f5eb0 0x7fecfc14cdb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 --2- 172.21.15.154:0/184484359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fecfc072840 0x7fecfc1482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 >> 172.21.15.154:0/184484359 conn(0x7fecfc0b4720 msgr2=0x7fecfc06c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 shutdown_connections 2023-11-27T22:30:09.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.589+0000 7fed047d0640 1 -- 172.21.15.154:0/184484359 wait complete. 2023-11-27T22:30:09.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:09.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:09.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.705+0000 7f7b30210640 1 Processor -- start 2023-11-27T22:30:09.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.705+0000 7f7b30210640 1 -- start start 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b30210640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 0x7f7b2806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b30210640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b280d0ed0 0x7f7b280d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b30210640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b28161d20 con 0x7f7b28160fb0 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b30210640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b28161b20 con 0x7f7b280d0ed0 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b30210640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2806f370 con 0x7f7b2806ea50 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 0x7f7b2806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2e7ad640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b280d0ed0 0x7f7b280d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 0x7f7b2806ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:52396/0 (socket says 172.21.15.154:52396) 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1814820135 learned_addr learned my addr 172.21.15.154:0/1814820135 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2d7ab640 1 --1- 172.21.15.154:0/1814820135 >> v1:172.21.15.194:6789/0 conn(0x7f7b28160fb0 0x7f7b28161410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:45106/0 (socket says 172.21.15.154:45106) 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1814820135 >> v2:172.21.15.194:3300/0 conn(0x7f7b280d0ed0 msgr2=0x7f7b280d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 --2- 172.21.15.154:0/1814820135 >> v2:172.21.15.194:3300/0 conn(0x7f7b280d0ed0 0x7f7b280d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1814820135 >> v1:172.21.15.194:6789/0 conn(0x7f7b28160fb0 legacy=0x7f7b28161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1814820135 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2815e760 con 0x7f7b2806ea50 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2cfaa640 1 -- 172.21.15.154:0/1814820135 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460101877 0 0) 0x7f7b28161d20 con 0x7f7b28160fb0 2023-11-27T22:30:09.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.706+0000 7f7b2e7ad640 1 --2- 172.21.15.154:0/1814820135 >> v2:172.21.15.194:3300/0 conn(0x7f7b280d0ed0 0x7f7b280d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:09.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.707+0000 7f7b2dfac640 1 --2- 172.21.15.154:0/1814820135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 0x7f7b2806ee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009870 tx=0x7f7b2402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ecc4de072ece01 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.707+0000 7f7b2cfaa640 1 -- 172.21.15.154:0/1814820135 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24030840 con 0x7f7b2806ea50 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.707+0000 7f7b2cfaa640 1 -- 172.21.15.154:0/1814820135 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b240309a0 con 0x7f7b2806ea50 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.707+0000 7f7b2cfaa640 1 -- 172.21.15.154:0/1814820135 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24030d30 con 0x7f7b2806ea50 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 -- 172.21.15.154:0/1814820135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 msgr2=0x7f7b2806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 --2- 172.21.15.154:0/1814820135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 0x7f7b2806ee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009870 tx=0x7f7b2402b980 comp rx=0 tx=0).stop 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 -- 172.21.15.154:0/1814820135 shutdown_connections 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 --2- 172.21.15.154:0/1814820135 >> v2:172.21.15.194:3300/0 conn(0x7f7b280d0ed0 0x7f7b280d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 --2- 172.21.15.154:0/1814820135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b2806ea50 0x7f7b2806ee30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 -- 172.21.15.154:0/1814820135 >> 172.21.15.154:0/1814820135 conn(0x7f7b2806a6b0 msgr2=0x7f7b2806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 -- 172.21.15.154:0/1814820135 shutdown_connections 2023-11-27T22:30:09.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.708+0000 7f7b30210640 1 -- 172.21.15.154:0/1814820135 wait complete. 2023-11-27T22:30:09.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.709+0000 7f7b30210640 1 Processor -- start 2023-11-27T22:30:09.712 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.709+0000 7f7b30210640 1 -- start start 2023-11-27T22:30:09.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b30210640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 0x7f7b281569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b30210640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b280d0ed0 0x7f7b280cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b30210640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b28160fb0 0x7f7b280cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b30210640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28156f00 con 0x7f7b2806ea50 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b30210640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2815a180 con 0x7f7b280d0ed0 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b30210640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b281588d0 con 0x7f7b28160fb0 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 0x7f7b281569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 0x7f7b281569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44062/0 (socket says 172.21.15.154:44062) 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1118946698 learned_addr learned my addr 172.21.15.154:0/1118946698 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2d7ab640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b280d0ed0 0x7f7b280cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2e7ad640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b28160fb0 0x7f7b280cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b28160fb0 msgr2=0x7f7b280cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.714 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b28160fb0 0x7f7b280cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b280d0ed0 msgr2=0x7f7b280cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b280d0ed0 0x7f7b280cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 -- 172.21.15.154:0/1118946698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009a70 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.710+0000 7f7b2dfac640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 0x7f7b281569c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000c00 tx=0x7f7b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.711+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2403e070 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.711+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b24004030 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.711+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b240094d0 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.711+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b240043e0 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.711+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28158e90 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.712+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b28069400 con 0x7f7b2806ea50 2023-11-27T22:30:09.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.712+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7b24042070 con 0x7f7b2806ea50 2023-11-27T22:30:09.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.712+0000 7f7b1e7fc640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7b0c06b1c0 0x7f7b0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:09.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.713+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b240ab6d0 con 0x7f7b2806ea50 2023-11-27T22:30:09.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.713+0000 7f7b2d7ab640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7b0c06b1c0 0x7f7b0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:09.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.713+0000 7f7b2d7ab640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7b0c06b1c0 0x7f7b0c06d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7b18007f70 tx=0x7f7b18007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:09.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.717+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7b24076420 con 0x7f7b2806ea50 2023-11-27T22:30:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.885+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b280d1c30 con 0x7f7b2806ea50 2023-11-27T22:30:09.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.885+0000 7f7b1e7fc640 1 -- 172.21.15.154:0/1118946698 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b24034070 con 0x7f7b2806ea50 2023-11-27T22:30:09.887 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:09.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7b0c06b1c0 msgr2=0x7f7b0c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7b0c06b1c0 0x7f7b0c06d680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7b18007f70 tx=0x7f7b18007f00 comp rx=0 tx=0).stop 2023-11-27T22:30:09.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 msgr2=0x7f7b281569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 0x7f7b281569c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000c00 tx=0x7f7b240046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 shutdown_connections 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b280d0ed0 0x7f7b280cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7b0c06b1c0 0x7f7b0c06d680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b28160fb0 0x7f7b280cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 --2- 172.21.15.154:0/1118946698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b2806ea50 0x7f7b281569c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.887+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 >> 172.21.15.154:0/1118946698 conn(0x7f7b2806a6b0 msgr2=0x7f7b2815ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.888+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 shutdown_connections 2023-11-27T22:30:09.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:09.888+0000 7f7b30210640 1 -- 172.21.15.154:0/1118946698 wait complete. 2023-11-27T22:30:09.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:10.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.001+0000 7f57b1287640 1 Processor -- start 2023-11-27T22:30:10.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.001+0000 7f57b1287640 1 -- start start 2023-11-27T22:30:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57b1287640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f57ac15b130 0x7f57ac0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57b1287640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57ac15f760 0x7f57ac0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57b1287640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0cf560 con 0x7f57ac0cf150 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57b1287640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac15fd20 con 0x7f57ac15f760 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57b1287640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0d0730 con 0x7f57ac15b130 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57aa7fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f57ac15f760 0x7f57ac0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57ab7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f57ac0cf150 0x7f57ac06ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37804/0 (socket says 172.21.15.154:37804) 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57ab7fe640 1 -- 172.21.15.154:0/3731744077 learned_addr learned my addr 172.21.15.154:0/3731744077 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.002+0000 7f57aaffd640 1 --2- 172.21.15.154:0/3731744077 >> v2:172.21.15.194:3300/0 conn(0x7f57ac15b130 0x7f57ac0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57aa7fc640 1 -- 172.21.15.154:0/3731744077 >> v2:172.21.15.194:3300/0 conn(0x7f57ac15b130 msgr2=0x7f57ac0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57aa7fc640 1 --2- 172.21.15.154:0/3731744077 >> v2:172.21.15.194:3300/0 conn(0x7f57ac15b130 0x7f57ac0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57aa7fc640 1 -- 172.21.15.154:0/3731744077 >> v1:172.21.15.154:6789/0 conn(0x7f57ac0cf150 legacy=0x7f57ac06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57aa7fc640 1 -- 172.21.15.154:0/3731744077 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0b3f10 con 0x7f57ac15f760 2023-11-27T22:30:10.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57a9ffb640 1 -- 172.21.15.154:0/3731744077 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360274453 0 0) 0x7f57ac0cf560 con 0x7f57ac0cf150 2023-11-27T22:30:10.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57aaffd640 1 --2- 172.21.15.154:0/3731744077 >> v2:172.21.15.194:3300/0 conn(0x7f57ac15b130 0x7f57ac0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.003+0000 7f57aa7fc640 1 --2- 172.21.15.154:0/3731744077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac0cec10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f57ac06ede0 tx=0x7f57a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d4197e6c5c7ac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57a9ffb640 1 -- 172.21.15.154:0/3731744077 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a002e070 con 0x7f57ac15f760 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57a9ffb640 1 -- 172.21.15.154:0/3731744077 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a00315a0 con 0x7f57ac15f760 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57a9ffb640 1 -- 172.21.15.154:0/3731744077 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0031930 con 0x7f57ac15f760 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 -- 172.21.15.154:0/3731744077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 msgr2=0x7f57ac0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 --2- 172.21.15.154:0/3731744077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac0cec10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f57ac06ede0 tx=0x7f57a002b840 comp rx=0 tx=0).stop 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 -- 172.21.15.154:0/3731744077 shutdown_connections 2023-11-27T22:30:10.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 --2- 172.21.15.154:0/3731744077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac0cec10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 --2- 172.21.15.154:0/3731744077 >> v2:172.21.15.194:3300/0 conn(0x7f57ac15b130 0x7f57ac0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 -- 172.21.15.154:0/3731744077 >> 172.21.15.154:0/3731744077 conn(0x7f57ac0b2c10 msgr2=0x7f57ac0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 -- 172.21.15.154:0/3731744077 shutdown_connections 2023-11-27T22:30:10.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.004+0000 7f57b1287640 1 -- 172.21.15.154:0/3731744077 wait complete. 2023-11-27T22:30:10.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.005+0000 7f57b1287640 1 Processor -- start 2023-11-27T22:30:10.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 -- start start 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57ac0cf150 0x7f57ac0d1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57ac15b130 0x7f57ac06cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0c49a0 con 0x7f57ac15f760 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0c70d0 con 0x7f57ac0cf150 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57b1287640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0c7350 con 0x7f57ac15b130 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57ab7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44082/0 (socket says 172.21.15.154:44082) 2023-11-27T22:30:10.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.006+0000 7f57ab7fe640 1 -- 172.21.15.154:0/680563461 learned_addr learned my addr 172.21.15.154:0/680563461 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57aa7fc640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57ac15b130 0x7f57ac06cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57aaffd640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57ac0cf150 0x7f57ac0d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57ab7fe640 1 -- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57ac15b130 msgr2=0x7f57ac06cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57ab7fe640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57ac15b130 0x7f57ac06cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57ab7fe640 1 -- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57ac0cf150 msgr2=0x7f57ac0d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57ab7fe640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57ac0cf150 0x7f57ac0d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57ab7fe640 1 -- 172.21.15.154:0/680563461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0009400 con 0x7f57ac15f760 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57ab7fe640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac158520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f57a400c480 tx=0x7f57a400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a40074e0 con 0x7f57ac15f760 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4007660 con 0x7f57ac15f760 2023-11-27T22:30:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0c7630 con 0x7f57ac15f760 2023-11-27T22:30:10.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4004a20 con 0x7f57ac15f760 2023-11-27T22:30:10.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.007+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac0c4ed0 con 0x7f57ac15f760 2023-11-27T22:30:10.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.008+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac067fc0 con 0x7f57ac15f760 2023-11-27T22:30:10.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.008+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f57a4004b80 con 0x7f57ac15f760 2023-11-27T22:30:10.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.009+0000 7f57937fe640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f579806b1c0 0x7f579806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.009+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57a4088eb0 con 0x7f57ac15f760 2023-11-27T22:30:10.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.009+0000 7f57aaffd640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f579806b1c0 0x7f579806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.009+0000 7f57aaffd640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f579806b1c0 0x7f579806d680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f579c003fd0 tx=0x7f579c0039f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.013+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f57a4053d30 con 0x7f57ac15f760 2023-11-27T22:30:10.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.178+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57ac0c50c0 con 0x7f57ac15f760 2023-11-27T22:30:10.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.178+0000 7f57937fe640 1 -- 172.21.15.154:0/680563461 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57a40180a0 con 0x7f57ac15f760 2023-11-27T22:30:10.180 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:10.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f579806b1c0 msgr2=0x7f579806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f579806b1c0 0x7f579806d680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f579c003fd0 tx=0x7f579c0039f0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 msgr2=0x7f57ac158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac158520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f57a400c480 tx=0x7f57a400c940 comp rx=0 tx=0).stop 2023-11-27T22:30:10.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 shutdown_connections 2023-11-27T22:30:10.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f579806b1c0 0x7f579806d680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f57ac15f760 0x7f57ac158520 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57ac15b130 0x7f57ac06cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 --2- 172.21.15.154:0/680563461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57ac0cf150 0x7f57ac0d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 >> 172.21.15.154:0/680563461 conn(0x7f57ac0b2c10 msgr2=0x7f57ac0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 shutdown_connections 2023-11-27T22:30:10.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.180+0000 7f57b1287640 1 -- 172.21.15.154:0/680563461 wait complete. 2023-11-27T22:30:10.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.296+0000 7f1ba7d7c640 1 Processor -- start 2023-11-27T22:30:10.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.296+0000 7f1ba7d7c640 1 -- start start 2023-11-27T22:30:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.297+0000 7f1ba7d7c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.297+0000 7f1ba7d7c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1ba00d3730 0x7f1ba00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.297+0000 7f1ba7d7c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba00b2b10 con 0x7f1ba015d330 2023-11-27T22:30:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.297+0000 7f1ba7d7c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00d3b50 con 0x7f1ba00d3730 2023-11-27T22:30:10.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.297+0000 7f1ba7d7c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00d1590 con 0x7f1ba00d2910 2023-11-27T22:30:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:52436/0 (socket says 172.21.15.154:52436) 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 -- 172.21.15.154:0/2336355449 learned_addr learned my addr 172.21.15.154:0/2336355449 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba6319640 1 --2- 172.21.15.154:0/2336355449 >> v2:172.21.15.194:3300/0 conn(0x7f1ba00d3730 0x7f1ba00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 -- 172.21.15.154:0/2336355449 >> v2:172.21.15.194:3300/0 conn(0x7f1ba00d3730 msgr2=0x7f1ba00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 --2- 172.21.15.154:0/2336355449 >> v2:172.21.15.194:3300/0 conn(0x7f1ba00d3730 0x7f1ba00b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 -- 172.21.15.154:0/2336355449 >> v1:172.21.15.194:6789/0 conn(0x7f1ba015d330 legacy=0x7f1ba00b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.298+0000 7f1ba5317640 1 -- 172.21.15.154:0/2336355449 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00d1870 con 0x7f1ba00d2910 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.299+0000 7f1ba5317640 1 --2- 172.21.15.154:0/2336355449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00d31f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009870 tx=0x7f1b9002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65c0f28725e6362 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.299+0000 7f1ba4b16640 1 -- 172.21.15.154:0/2336355449 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90031640 con 0x7f1ba00d2910 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.299+0000 7f1ba4b16640 1 -- 172.21.15.154:0/2336355449 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900317a0 con 0x7f1ba00d2910 2023-11-27T22:30:10.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.299+0000 7f1ba4b16640 1 -- 172.21.15.154:0/2336355449 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90031b30 con 0x7f1ba00d2910 2023-11-27T22:30:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.299+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/2336355449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 msgr2=0x7f1ba00d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.299+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/2336355449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00d31f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009870 tx=0x7f1b9002b8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.300+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/2336355449 shutdown_connections 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.300+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/2336355449 >> v2:172.21.15.194:3300/0 conn(0x7f1ba00d3730 0x7f1ba00b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.300+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/2336355449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00d31f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.300+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/2336355449 >> 172.21.15.154:0/2336355449 conn(0x7f1ba0072020 msgr2=0x7f1ba0072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.300+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/2336355449 shutdown_connections 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.300+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/2336355449 wait complete. 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 Processor -- start 2023-11-27T22:30:10.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 -- start start 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba00d3730 0x7f1ba00cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 0x7f1ba01f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00cb230 con 0x7f1ba015d330 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0155050 con 0x7f1ba00d3730 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.301+0000 7f1ba7d7c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00c7670 con 0x7f1ba00d2910 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 0x7f1ba01f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 0x7f1ba01f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44092/0 (socket says 172.21.15.154:44092) 2023-11-27T22:30:10.305 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 -- 172.21.15.154:0/628258962 learned_addr learned my addr 172.21.15.154:0/628258962 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba5b18640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba5317640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba00d3730 0x7f1ba00cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 -- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 msgr2=0x7f1ba00c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 -- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba00d3730 msgr2=0x7f1ba00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba00d3730 0x7f1ba00cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 -- 172.21.15.154:0/628258962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900094d0 con 0x7f1ba015d330 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba6319640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 0x7f1ba01f3c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800e960 tx=0x7f1b9800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98009690 con 0x7f1ba015d330 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9800c980 con 0x7f1ba015d330 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba00cb440 con 0x7f1ba015d330 2023-11-27T22:30:10.306 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800cd30 con 0x7f1ba015d330 2023-11-27T22:30:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.302+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba00c7020 con 0x7f1ba015d330 2023-11-27T22:30:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.303+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba0069400 con 0x7f1ba015d330 2023-11-27T22:30:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.304+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1b98013470 con 0x7f1ba015d330 2023-11-27T22:30:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.304+0000 7f1b967fc640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1b8406b1f0 0x7f1b8406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.304+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b98089ba0 con 0x7f1ba015d330 2023-11-27T22:30:10.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.304+0000 7f1ba5b18640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1b8406b1f0 0x7f1b8406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.305+0000 7f1ba5b18640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1b8406b1f0 0x7f1b8406d6b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ba015cf80 tx=0x7f1b9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.308+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1b98054980 con 0x7f1ba015d330 2023-11-27T22:30:10.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.473+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ba00c77b0 con 0x7f1ba015d330 2023-11-27T22:30:10.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.474+0000 7f1b967fc640 1 -- 172.21.15.154:0/628258962 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b980210a0 con 0x7f1ba015d330 2023-11-27T22:30:10.476 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:10.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1b8406b1f0 msgr2=0x7f1b8406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1b8406b1f0 0x7f1b8406d6b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ba015cf80 tx=0x7f1b9c009040 comp rx=0 tx=0).stop 2023-11-27T22:30:10.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 msgr2=0x7f1ba01f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 0x7f1ba01f3c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800e960 tx=0x7f1b9800ee20 comp rx=0 tx=0).stop 2023-11-27T22:30:10.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 shutdown_connections 2023-11-27T22:30:10.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ba00d3730 0x7f1ba00cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1b8406b1f0 0x7f1b8406d6b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ba015d330 0x7f1ba01f3c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 --2- 172.21.15.154:0/628258962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ba00d2910 0x7f1ba00c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 >> 172.21.15.154:0/628258962 conn(0x7f1ba0072020 msgr2=0x7f1ba00b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 shutdown_connections 2023-11-27T22:30:10.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.476+0000 7f1ba7d7c640 1 -- 172.21.15.154:0/628258962 wait complete. 2023-11-27T22:30:10.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:10.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 Processor -- start 2023-11-27T22:30:10.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 -- start start 2023-11-27T22:30:10.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb50c0d2910 0x7fb50c0d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb50c0d3730 0x7fb50c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0b2b10 con 0x7fb50c15d330 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0d3bc0 con 0x7fb50c0d3730 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.590+0000 7fb512f2c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0d1590 con 0x7fb50c0d2910 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb50c0d3730 0x7fb50c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb50c0d3730 0x7fb50c0b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44104/0 (socket says 172.21.15.154:44104) 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 -- 172.21.15.154:0/1717506481 learned_addr learned my addr 172.21.15.154:0/1717506481 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb50bfff640 1 --2- 172.21.15.154:0/1717506481 >> v2:172.21.15.194:3300/0 conn(0x7fb50c0d2910 0x7fb50c0d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 -- 172.21.15.154:0/1717506481 >> v2:172.21.15.194:3300/0 conn(0x7fb50c0d2910 msgr2=0x7fb50c0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 --2- 172.21.15.154:0/1717506481 >> v2:172.21.15.194:3300/0 conn(0x7fb50c0d2910 0x7fb50c0d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 -- 172.21.15.154:0/1717506481 >> v1:172.21.15.194:6789/0 conn(0x7fb50c15d330 legacy=0x7fb50c0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.591+0000 7fb5114c9640 1 -- 172.21.15.154:0/1717506481 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0d1870 con 0x7fb50c0d3730 2023-11-27T22:30:10.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb5114c9640 1 --2- 172.21.15.154:0/1717506481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d3730 0x7fb50c0b6390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0d1540 tx=0x7fb50402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d63ce3bb17a594 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb50b7fe640 1 -- 172.21.15.154:0/1717506481 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50402c9f0 con 0x7fb50c0d3730 2023-11-27T22:30:10.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb50b7fe640 1 -- 172.21.15.154:0/1717506481 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50402cb50 con 0x7fb50c0d3730 2023-11-27T22:30:10.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb50b7fe640 1 -- 172.21.15.154:0/1717506481 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5040343f0 con 0x7fb50c0d3730 2023-11-27T22:30:10.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 -- 172.21.15.154:0/1717506481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d3730 msgr2=0x7fb50c0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 --2- 172.21.15.154:0/1717506481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d3730 0x7fb50c0b6390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0d1540 tx=0x7fb50402be50 comp rx=0 tx=0).stop 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 -- 172.21.15.154:0/1717506481 shutdown_connections 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 --2- 172.21.15.154:0/1717506481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d3730 0x7fb50c0b6390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 --2- 172.21.15.154:0/1717506481 >> v2:172.21.15.194:3300/0 conn(0x7fb50c0d2910 0x7fb50c0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 -- 172.21.15.154:0/1717506481 >> 172.21.15.154:0/1717506481 conn(0x7fb50c072020 msgr2=0x7fb50c072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 -- 172.21.15.154:0/1717506481 shutdown_connections 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.592+0000 7fb512f2c640 1 -- 172.21.15.154:0/1717506481 wait complete. 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.593+0000 7fb512f2c640 1 Processor -- start 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 -- start start 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 0x7fb50c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb50c0d3730 0x7fb50c1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb50c15d330 0x7fb50c1f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c15f900 con 0x7fb50c0d2910 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0cc790 con 0x7fb50c15d330 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb512f2c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c1592e0 con 0x7fb50c0d3730 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb510cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 0x7fb50c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb510cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 0x7fb50c158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44106/0 (socket says 172.21.15.154:44106) 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.594+0000 7fb510cc8640 1 -- 172.21.15.154:0/2986066658 learned_addr learned my addr 172.21.15.154:0/2986066658 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb5114c9640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb50c15d330 0x7fb50c1f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb510cc8640 1 -- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb50c0d3730 msgr2=0x7fb50c1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb50bfff640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb50c0d3730 0x7fb50c1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb510cc8640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb50c0d3730 0x7fb50c1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb510cc8640 1 -- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb50c15d330 msgr2=0x7fb50c1f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb510cc8640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb50c15d330 0x7fb50c1f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb510cc8640 1 -- 172.21.15.154:0/2986066658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009b30 con 0x7fb50c0d2910 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb5114c9640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb50c15d330 0x7fb50c1f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb50bfff640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb50c0d3730 0x7fb50c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb510cc8640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 0x7fb50c158da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c430 tx=0x7fb50000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500011790 con 0x7fb50c0d2910 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5000118f0 con 0x7fb50c0d2910 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500011ce0 con 0x7fb50c0d2910 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0cbb10 con 0x7fb50c0d2910 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.595+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0cc0d0 con 0x7fb50c0d2910 2023-11-27T22:30:10.600 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.596+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c069400 con 0x7fb50c0d2910 2023-11-27T22:30:10.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.596+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb50001c460 con 0x7fb50c0d2910 2023-11-27T22:30:10.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.597+0000 7fb5097fa640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb4f006b1c0 0x7fb4f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.597+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5000899e0 con 0x7fb50c0d2910 2023-11-27T22:30:10.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.597+0000 7fb50bfff640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb4f006b1c0 0x7fb4f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.597+0000 7fb50bfff640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb4f006b1c0 0x7fb4f006d680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0cb610 tx=0x7fb4f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.601+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb500054710 con 0x7fb50c0d2910 2023-11-27T22:30:10.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.772+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb50c0d12f0 con 0x7fb50c0d2910 2023-11-27T22:30:10.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.773+0000 7fb5097fa640 1 -- 172.21.15.154:0/2986066658 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fb500057d30 con 0x7fb50c0d2910 2023-11-27T22:30:10.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:10.775 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb4f006b1c0 msgr2=0x7fb4f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb4f006b1c0 0x7fb4f006d680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0cb610 tx=0x7fb4f8008040 comp rx=0 tx=0).stop 2023-11-27T22:30:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 msgr2=0x7fb50c158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 0x7fb50c158da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb50000c430 tx=0x7fb50000c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 shutdown_connections 2023-11-27T22:30:10.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb50c15d330 0x7fb50c1f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb4f006b1c0 0x7fb4f006d680 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb50c0d3730 0x7fb50c1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 --2- 172.21.15.154:0/2986066658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d2910 0x7fb50c158da0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 >> 172.21.15.154:0/2986066658 conn(0x7fb50c072020 msgr2=0x7fb50c072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 shutdown_connections 2023-11-27T22:30:10.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.775+0000 7fb512f2c640 1 -- 172.21.15.154:0/2986066658 wait complete. 2023-11-27T22:30:10.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:10.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:10.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.892+0000 7f5e7aca2640 1 Processor -- start 2023-11-27T22:30:10.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.892+0000 7f5e7aca2640 1 -- start start 2023-11-27T22:30:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7aca2640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5e74140310 0x7f5e741618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7aca2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741409d0 0x7f5e7406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7aca2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e741406f0 con 0x7f5e741428d0 2023-11-27T22:30:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7aca2640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e74161e20 con 0x7f5e74140310 2023-11-27T22:30:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7aca2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74143960 con 0x7f5e741409d0 2023-11-27T22:30:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7923f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5e741428d0 0x7f5e740714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37814/0 (socket says 172.21.15.154:37814) 2023-11-27T22:30:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e7923f640 1 -- 172.21.15.154:0/3760827985 learned_addr learned my addr 172.21.15.154:0/3760827985 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e73fff640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741409d0 0x7f5e7406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e78a3e640 1 --2- 172.21.15.154:0/3760827985 >> v2:172.21.15.194:3300/0 conn(0x7f5e74140310 0x7f5e741618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321685084 0 0) 0x7f5e741406f0 con 0x7f5e741428d0 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e64003520 con 0x7f5e741428d0 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128952818 0 0) 0x7f5e64003520 con 0x7f5e741428d0 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741409d0 msgr2=0x7f5e7406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741409d0 0x7f5e7406a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 >> v2:172.21.15.194:3300/0 conn(0x7f5e74140310 msgr2=0x7f5e741618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 --2- 172.21.15.154:0/3760827985 >> v2:172.21.15.194:3300/0 conn(0x7f5e74140310 0x7f5e741618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74142de0 con 0x7f5e741428d0 2023-11-27T22:30:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f5e6c0019f0 con 0x7f5e741428d0 2023-11-27T22:30:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 >> v1:172.21.15.154:6789/0 conn(0x7f5e741428d0 legacy=0x7f5e740714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e64003970 0x7f5e64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e640047c0 0x7f5e64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74161e20 con 0x7f5e64005180 2023-11-27T22:30:10.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74143960 con 0x7f5e64003970 2023-11-27T22:30:10.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6400bf10 con 0x7f5e640047c0 2023-11-27T22:30:10.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e78a3e640 1 --2- 172.21.15.154:0/3760827985 >> v2:172.21.15.194:3300/0 conn(0x7f5e74140310 0x7f5e741618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:10.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.893+0000 7f5e73fff640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741409d0 0x7f5e7406a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e73fff640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e640047c0 0x7f5e64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 -- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e640047c0 msgr2=0x7f5e64004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e640047c0 0x7f5e64004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 -- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e64003970 msgr2=0x7f5e64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e64003970 0x7f5e64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 -- 172.21.15.154:0/3760827985 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e64003520 con 0x7f5e64005180 2023-11-27T22:30:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e73fff640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e640047c0 0x7f5e64004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.894+0000 7f5e7923f640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e6400b980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00a860 tx=0x7f5e640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6218940c6ede9c55 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c034630 con 0x7f5e64005180 2023-11-27T22:30:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c02f070 con 0x7f5e64005180 2023-11-27T22:30:10.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e737fe640 1 -- 172.21.15.154:0/3760827985 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0349f0 con 0x7f5e64005180 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7aca2640 1 -- 172.21.15.154:0/3760827985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 msgr2=0x7f5e6400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/3760827985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e6400b980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00a860 tx=0x7f5e640057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7923f640 1 -- 172.21.15.154:0/3760827985 reap_dead start 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7aca2640 1 -- 172.21.15.154:0/3760827985 shutdown_connections 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7aca2640 1 -- 172.21.15.154:0/3760827985 >> 172.21.15.154:0/3760827985 conn(0x7f5e740b1e50 msgr2=0x7f5e740b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7aca2640 1 -- 172.21.15.154:0/3760827985 shutdown_connections 2023-11-27T22:30:10.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.895+0000 7f5e7aca2640 1 -- 172.21.15.154:0/3760827985 wait complete. 2023-11-27T22:30:10.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.896+0000 7f5e7aca2640 1 Processor -- start 2023-11-27T22:30:10.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.896+0000 7f5e7aca2640 1 -- start start 2023-11-27T22:30:10.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7aca2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e74145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7aca2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e7413caf0 0x7f5e740af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7aca2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741566d0 0x7f5e74156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7aca2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7413f830 con 0x7f5e64005180 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7aca2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74157090 con 0x7f5e7413caf0 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7aca2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74145a30 con 0x7f5e741566d0 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e78a3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e74145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e78a3e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e74145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44126/0 (socket says 172.21.15.154:44126) 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e78a3e640 1 -- 172.21.15.154:0/2751313130 learned_addr learned my addr 172.21.15.154:0/2751313130 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e73fff640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e7413caf0 0x7f5e740af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e7923f640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741566d0 0x7f5e74156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.897+0000 7f5e78a3e640 1 -- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741566d0 msgr2=0x7f5e74156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e78a3e640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741566d0 0x7f5e74156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e78a3e640 1 -- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e7413caf0 msgr2=0x7f5e740af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e78a3e640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e7413caf0 0x7f5e740af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e78a3e640 1 -- 172.21.15.154:0/2751313130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7415f970 con 0x7f5e64005180 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e73fff640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e7413caf0 0x7f5e740af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:10.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e78a3e640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e74145ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800eb30 tx=0x7f5e68009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68009750 con 0x7f5e64005180 2023-11-27T22:30:10.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6800ca00 con 0x7f5e64005180 2023-11-27T22:30:10.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7415f3f0 con 0x7f5e64005180 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6800cd90 con 0x7f5e64005180 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.898+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e741456c0 con 0x7f5e64005180 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.899+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e74161030 con 0x7f5e64005180 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.899+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5e68004030 con 0x7f5e64005180 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.900+0000 7f5e717fa640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e5806b1c0 0x7f5e5806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.900+0000 7f5e73fff640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e5806b1c0 0x7f5e5806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.900+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e68089e20 con 0x7f5e64005180 2023-11-27T22:30:10.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.900+0000 7f5e73fff640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e5806b1c0 0x7f5e5806d680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e740aeee0 tx=0x7f5e60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:10.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:10.904+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5e68054be0 con 0x7f5e64005180 2023-11-27T22:30:11.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.072+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e74069400 con 0x7f5e64005180 2023-11-27T22:30:11.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.072+0000 7f5e717fa640 1 -- 172.21.15.154:0/2751313130 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e680200a0 con 0x7f5e64005180 2023-11-27T22:30:11.074 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:11.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e5806b1c0 msgr2=0x7f5e5806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e5806b1c0 0x7f5e5806d680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e740aeee0 tx=0x7f5e60008040 comp rx=0 tx=0).stop 2023-11-27T22:30:11.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 msgr2=0x7f5e74145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e74145ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800eb30 tx=0x7f5e68009e10 comp rx=0 tx=0).stop 2023-11-27T22:30:11.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 shutdown_connections 2023-11-27T22:30:11.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e7413caf0 0x7f5e740af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5e5806b1c0 0x7f5e5806d680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e741566d0 0x7f5e74156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 --2- 172.21.15.154:0/2751313130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e64005180 0x7f5e74145ec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 >> 172.21.15.154:0/2751313130 conn(0x7f5e740b1e50 msgr2=0x7f5e7406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 shutdown_connections 2023-11-27T22:30:11.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.074+0000 7f5e7aca2640 1 -- 172.21.15.154:0/2751313130 wait complete. 2023-11-27T22:30:11.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.187+0000 7f5b6d5d0640 1 Processor -- start 2023-11-27T22:30:11.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.187+0000 7f5b6d5d0640 1 -- start start 2023-11-27T22:30:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b6d5d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b6815d270 0x7f5b6806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.192 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b6d5d0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b680cdee0 0x7f5b680cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b6d5d0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680d0c40 con 0x7f5b680709c0 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b6d5d0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680ced90 con 0x7f5b680cdee0 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b6d5d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680cf070 con 0x7f5b6815d270 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b677fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b680cdee0 0x7f5b680cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b677fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5b680cdee0 0x7f5b680cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44130/0 (socket says 172.21.15.154:44130) 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b677fe640 1 -- 172.21.15.154:0/201527838 learned_addr learned my addr 172.21.15.154:0/201527838 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.188+0000 7f5b667fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5b680709c0 0x7f5b680cd7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37826/0 (socket says 172.21.15.154:37826) 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b66ffd640 1 --2- 172.21.15.154:0/201527838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b6815d270 0x7f5b6806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b677fe640 1 -- 172.21.15.154:0/201527838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b6815d270 msgr2=0x7f5b6806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b677fe640 1 --2- 172.21.15.154:0/201527838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b6815d270 0x7f5b6806ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.193 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b677fe640 1 -- 172.21.15.154:0/201527838 >> v1:172.21.15.154:6789/0 conn(0x7f5b680709c0 legacy=0x7f5b680cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b65ffb640 1 -- 172.21.15.154:0/201527838 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846303796 0 0) 0x7f5b680d0c40 con 0x7f5b680709c0 2023-11-27T22:30:11.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b677fe640 1 -- 172.21.15.154:0/201527838 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680d08f0 con 0x7f5b680cdee0 2023-11-27T22:30:11.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.189+0000 7f5b677fe640 1 --2- 172.21.15.154:0/201527838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680cdee0 0x7f5b680cc6a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b6002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90840a5ed77bfc3e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b65ffb640 1 -- 172.21.15.154:0/201527838 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60031640 con 0x7f5b680cdee0 2023-11-27T22:30:11.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b65ffb640 1 -- 172.21.15.154:0/201527838 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b600317a0 con 0x7f5b680cdee0 2023-11-27T22:30:11.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b65ffb640 1 -- 172.21.15.154:0/201527838 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b60031b30 con 0x7f5b680cdee0 2023-11-27T22:30:11.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/201527838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680cdee0 msgr2=0x7f5b680cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/201527838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680cdee0 0x7f5b680cc6a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b6002b8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/201527838 shutdown_connections 2023-11-27T22:30:11.196 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/201527838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680cdee0 0x7f5b680cc6a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/201527838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b6815d270 0x7f5b6806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.200 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/201527838 >> 172.21.15.154:0/201527838 conn(0x7f5b680b2c10 msgr2=0x7f5b680b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/201527838 shutdown_connections 2023-11-27T22:30:11.201 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.190+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/201527838 wait complete. 2023-11-27T22:30:11.205 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.191+0000 7f5b6d5d0640 1 Processor -- start 2023-11-27T22:30:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 -- start start 2023-11-27T22:30:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 0x7f5b681f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b680cdee0 0x7f5b6815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b6815d270 0x7f5b680b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680c60b0 con 0x7f5b680709c0 2023-11-27T22:30:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680c5010 con 0x7f5b6815d270 2023-11-27T22:30:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b6d5d0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680c52f0 con 0x7f5b680cdee0 2023-11-27T22:30:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b66ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 0x7f5b681f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b66ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 0x7f5b681f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44144/0 (socket says 172.21.15.154:44144) 2023-11-27T22:30:11.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b66ffd640 1 -- 172.21.15.154:0/3070099599 learned_addr learned my addr 172.21.15.154:0/3070099599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:11.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b677fe640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b6815d270 0x7f5b680b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.192+0000 7f5b667fc640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b680cdee0 0x7f5b6815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b66ffd640 1 -- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b680cdee0 msgr2=0x7f5b6815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.211 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b66ffd640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b680cdee0 0x7f5b6815e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b66ffd640 1 -- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b6815d270 msgr2=0x7f5b680b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b66ffd640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b6815d270 0x7f5b680b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b66ffd640 1 -- 172.21.15.154:0/3070099599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600094d0 con 0x7f5b680709c0 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b66ffd640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 0x7f5b681f23f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b58007e60 tx=0x7f5b5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58014620 con 0x7f5b680709c0 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5800ee90 con 0x7f5b680709c0 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b680c55d0 con 0x7f5b680709c0 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b580149e0 con 0x7f5b680709c0 2023-11-27T22:30:11.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.193+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b680c5b90 con 0x7f5b680709c0 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.194+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b68067fc0 con 0x7f5b680709c0 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.194+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5b58014b40 con 0x7f5b680709c0 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.195+0000 7f5b4f7fe640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5b5406b1c0 0x7f5b5406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.195+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b5808a360 con 0x7f5b680709c0 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.195+0000 7f5b667fc640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5b5406b1c0 0x7f5b5406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.195+0000 7f5b667fc640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5b5406b1c0 0x7f5b5406d680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5b680b6580 tx=0x7f5b5c007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.199+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5b58055120 con 0x7f5b680709c0 2023-11-27T22:30:11.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.365+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b680c5db0 con 0x7f5b680709c0 2023-11-27T22:30:11.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.366+0000 7f5b4f7fe640 1 -- 172.21.15.154:0/3070099599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b58058740 con 0x7f5b680709c0 2023-11-27T22:30:11.368 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5b5406b1c0 msgr2=0x7f5b5406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5b5406b1c0 0x7f5b5406d680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5b680b6580 tx=0x7f5b5c007b50 comp rx=0 tx=0).stop 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 msgr2=0x7f5b681f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 0x7f5b681f23f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b58007e60 tx=0x7f5b5800e4b0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 shutdown_connections 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b6815d270 0x7f5b680b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5b5406b1c0 0x7f5b5406d680 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b680cdee0 0x7f5b6815e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 --2- 172.21.15.154:0/3070099599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b680709c0 0x7f5b681f23f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 >> 172.21.15.154:0/3070099599 conn(0x7f5b680b2c10 msgr2=0x7f5b6806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 shutdown_connections 2023-11-27T22:30:11.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.368+0000 7f5b6d5d0640 1 -- 172.21.15.154:0/3070099599 wait complete. 2023-11-27T22:30:11.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:11.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.484+0000 7f026ff05640 1 Processor -- start 2023-11-27T22:30:11.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.484+0000 7f026ff05640 1 -- start start 2023-11-27T22:30:11.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026ff05640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02680ad640 0x7f026806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026ff05640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680adae0 con 0x7f026806bbf0 2023-11-27T22:30:11.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026ff05640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680addc0 con 0x7f026815d1d0 2023-11-27T22:30:11.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026ff05640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680ae0a0 con 0x7f02680ad640 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026e4a2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f026806bbf0 0x7f026806d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37834/0 (socket says 172.21.15.154:37834) 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026e4a2640 1 -- 172.21.15.154:0/720544386 learned_addr learned my addr 172.21.15.154:0/720544386 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026d4a0640 1 --2- 172.21.15.154:0/720544386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02680ad640 0x7f026806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157753206 0 0) 0x7f02680adae0 con 0x7f026806bbf0 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0254003520 con 0x7f026806bbf0 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122319764 0 0) 0x7f02680addc0 con 0x7f026815d1d0 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02680adae0 con 0x7f026815d1d0 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026d4a0640 1 -- 172.21.15.154:0/720544386 >> v1:172.21.15.194:6789/0 conn(0x7f026815d1d0 legacy=0x7f026806b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026d4a0640 1 -- 172.21.15.154:0/720544386 >> v1:172.21.15.154:6789/0 conn(0x7f026806bbf0 legacy=0x7f026806d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.485+0000 7f026d4a0640 1 -- 172.21.15.154:0/720544386 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680ae380 con 0x7f02680ad640 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.486+0000 7f026d4a0640 1 --2- 172.21.15.154:0/720544386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02680ad640 0x7f026806d0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0258009800 tx=0x7f025802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d616fdbfa681c3f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.486+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258031890 con 0x7f02680ad640 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.486+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02580319f0 con 0x7f02680ad640 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.486+0000 7f026cc9f640 1 -- 172.21.15.154:0/720544386 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258031d80 con 0x7f02680ad640 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 -- 172.21.15.154:0/720544386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02680ad640 msgr2=0x7f026806d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 --2- 172.21.15.154:0/720544386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02680ad640 0x7f026806d0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0258009800 tx=0x7f025802b930 comp rx=0 tx=0).stop 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 -- 172.21.15.154:0/720544386 shutdown_connections 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 --2- 172.21.15.154:0/720544386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02680ad640 0x7f026806d0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 -- 172.21.15.154:0/720544386 >> 172.21.15.154:0/720544386 conn(0x7f0268070e70 msgr2=0x7f0268071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 -- 172.21.15.154:0/720544386 shutdown_connections 2023-11-27T22:30:11.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.487+0000 7f026ff05640 1 -- 172.21.15.154:0/720544386 wait complete. 2023-11-27T22:30:11.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.488+0000 7f026ff05640 1 Processor -- start 2023-11-27T22:30:11.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.488+0000 7f026ff05640 1 -- start start 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 0x7f026815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680ad640 0x7f0268154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f026815d1d0 0x7f02681f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268153cc0 con 0x7f026806bbf0 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02681f6b70 con 0x7f02680ad640 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02681f6e50 con 0x7f026815d1d0 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 0x7f026815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 0x7f026815ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44156/0 (socket says 172.21.15.154:44156) 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 -- 172.21.15.154:0/346444471 learned_addr learned my addr 172.21.15.154:0/346444471 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026d4a0640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680ad640 0x7f0268154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 -- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f026815d1d0 msgr2=0x7f02681f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f026815d1d0 0x7f02681f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 -- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680ad640 msgr2=0x7f0268154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680ad640 0x7f0268154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 -- 172.21.15.154:0/346444471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0258009400 con 0x7f026806bbf0 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026d4a0640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680ad640 0x7f0268154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026dca1640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 0x7f026815ba80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f026400c430 tx=0x7f026400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02640052d0 con 0x7f026806bbf0 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264005450 con 0x7f026806bbf0 2023-11-27T22:30:11.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264003830 con 0x7f026806bbf0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0268153f10 con 0x7f026806bbf0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.489+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02680cc760 con 0x7f026806bbf0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.490+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268069400 con 0x7f026806bbf0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.491+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0264003990 con 0x7f026806bbf0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.491+0000 7f025e7fc640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f024c06b1f0 0x7f024c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.491+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0264088fa0 con 0x7f026806bbf0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.491+0000 7f026d4a0640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f024c06b1f0 0x7f024c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.492+0000 7f026d4a0640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f024c06b1f0 0x7f024c06d6b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0258036000 tx=0x7f0258008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.497 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.496+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f02640bbe90 con 0x7f026806bbf0 2023-11-27T22:30:11.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.669+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02680cf840 con 0x7f026806bbf0 2023-11-27T22:30:11.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.669+0000 7f025e7fc640 1 -- 172.21.15.154:0/346444471 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02640170a0 con 0x7f026806bbf0 2023-11-27T22:30:11.671 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:11.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f024c06b1f0 msgr2=0x7f024c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f024c06b1f0 0x7f024c06d6b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0258036000 tx=0x7f0258008030 comp rx=0 tx=0).stop 2023-11-27T22:30:11.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 msgr2=0x7f026815ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 0x7f026815ba80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f026400c430 tx=0x7f026400c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 shutdown_connections 2023-11-27T22:30:11.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680ad640 0x7f0268154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f024c06b1f0 0x7f024c06d6b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f026815d1d0 0x7f02681f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 --2- 172.21.15.154:0/346444471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f026806bbf0 0x7f026815ba80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 >> 172.21.15.154:0/346444471 conn(0x7f0268070e70 msgr2=0x7f02680af880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 shutdown_connections 2023-11-27T22:30:11.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.671+0000 7f026ff05640 1 -- 172.21.15.154:0/346444471 wait complete. 2023-11-27T22:30:11.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:11.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.783+0000 7fcb0cf6e640 1 Processor -- start 2023-11-27T22:30:11.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.783+0000 7fcb0cf6e640 1 -- start start 2023-11-27T22:30:11.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.784+0000 7fcb0cf6e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcb0815d330 0x7fcb080b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.784+0000 7fcb0cf6e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080b2b10 con 0x7fcb080d3900 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.784+0000 7fcb0cf6e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb080d1590 con 0x7fcb080d2910 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.784+0000 7fcb0cf6e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb080d1870 con 0x7fcb0815d330 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.784+0000 7fcb06d9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fcb080d3900 0x7fcb080b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37840/0 (socket says 172.21.15.154:37840) 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.784+0000 7fcb06d9d640 1 -- 172.21.15.154:0/2719728312 learned_addr learned my addr 172.21.15.154:0/2719728312 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0659c640 1 --2- 172.21.15.154:0/2719728312 >> v2:172.21.15.194:3300/0 conn(0x7fcb0815d330 0x7fcb080b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0559a640 1 -- 172.21.15.154:0/2719728312 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265967044 0 0) 0x7fcb080b2b10 con 0x7fcb080d3900 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0559a640 1 -- 172.21.15.154:0/2719728312 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf0003520 con 0x7fcb080d3900 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0659c640 1 -- 172.21.15.154:0/2719728312 >> v1:172.21.15.194:6789/0 conn(0x7fcb080d2910 legacy=0x7fcb080d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0659c640 1 -- 172.21.15.154:0/2719728312 >> v1:172.21.15.154:6789/0 conn(0x7fcb080d3900 legacy=0x7fcb080b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0559a640 1 -- 172.21.15.154:0/2719728312 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490106975 0 0) 0x7fcaf0003520 con 0x7fcb080d3900 2023-11-27T22:30:11.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.785+0000 7fcb0659c640 1 -- 172.21.15.154:0/2719728312 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb080d1b50 con 0x7fcb0815d330 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0659c640 1 --2- 172.21.15.154:0/2719728312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb0815d330 0x7fcb080b8b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009d90 tx=0x7fcaf802bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2951b336c07fbc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0559a640 1 -- 172.21.15.154:0/2719728312 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00001670 con 0x7fcb0815d330 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0559a640 1 -- 172.21.15.154:0/2719728312 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf802c8b0 con 0x7fcb0815d330 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0559a640 1 -- 172.21.15.154:0/2719728312 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf802cc40 con 0x7fcb0815d330 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2719728312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb0815d330 msgr2=0x7fcb080b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2719728312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb0815d330 0x7fcb080b8b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009d90 tx=0x7fcaf802bd80 comp rx=0 tx=0).stop 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2719728312 shutdown_connections 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2719728312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb0815d330 0x7fcb080b8b80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2719728312 >> 172.21.15.154:0/2719728312 conn(0x7fcb08072020 msgr2=0x7fcb08072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2719728312 shutdown_connections 2023-11-27T22:30:11.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.786+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2719728312 wait complete. 2023-11-27T22:30:11.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 Processor -- start 2023-11-27T22:30:11.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 -- start start 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb080d2910 0x7fcb080ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb080d3900 0x7fcb08149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 0x7fcb080ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080cd650 con 0x7fcb0815d330 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080c7730 con 0x7fcb080d2910 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.788+0000 7fcb0cf6e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb080c7a10 con 0x7fcb080d3900 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 0x7fcb080ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 0x7fcb080ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44170/0 (socket says 172.21.15.154:44170) 2023-11-27T22:30:11.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 -- 172.21.15.154:0/2539349172 learned_addr learned my addr 172.21.15.154:0/2539349172 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb0659c640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb080d2910 0x7fcb080ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb05d9b640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb080d3900 0x7fcb08149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 -- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb080d3900 msgr2=0x7fcb08149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb080d3900 0x7fcb08149a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 -- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb080d2910 msgr2=0x7fcb080ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb080d2910 0x7fcb080ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 -- 172.21.15.154:0/2539349172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8009a70 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb0659c640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb080d2910 0x7fcb080ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb06d9d640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 0x7fcb080ca330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb000011e0 tx=0x7fcb0000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00005ad0 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00005c30 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb080c7cf0 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00007070 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.789+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb080cd290 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.790+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb080c8210 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.791+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcb000071d0 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.791+0000 7fcaf6ffd640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcae806b1c0 0x7fcae806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.791+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb00089830 con 0x7fcb0815d330 2023-11-27T22:30:11.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.791+0000 7fcb0659c640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcae806b1c0 0x7fcae806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:11.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.791+0000 7fcb0659c640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcae806b1c0 0x7fcae806d680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8036000 tx=0x7fcaf8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:11.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.795+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcb000544e0 con 0x7fcb0815d330 2023-11-27T22:30:11.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.964+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb080d0b50 con 0x7fcb0815d330 2023-11-27T22:30:11.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.965+0000 7fcaf6ffd640 1 -- 172.21.15.154:0/2539349172 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fcb00057b00 con 0x7fcb0815d330 2023-11-27T22:30:11.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:11.967 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:11.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcae806b1c0 msgr2=0x7fcae806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcae806b1c0 0x7fcae806d680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8036000 tx=0x7fcaf8030000 comp rx=0 tx=0).stop 2023-11-27T22:30:11.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 msgr2=0x7fcb080ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:11.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 0x7fcb080ca330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb000011e0 tx=0x7fcb0000cbe0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 shutdown_connections 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcae806b1c0 0x7fcae806d680 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0815d330 0x7fcb080ca330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcb080d3900 0x7fcb08149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 --2- 172.21.15.154:0/2539349172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb080d2910 0x7fcb080ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 >> 172.21.15.154:0/2539349172 conn(0x7fcb08072020 msgr2=0x7fcb080d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 shutdown_connections 2023-11-27T22:30:11.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:11.967+0000 7fcb0cf6e640 1 -- 172.21.15.154:0/2539349172 wait complete. 2023-11-27T22:30:11.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:11.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:12.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.082+0000 7fdce3843640 1 Processor -- start 2023-11-27T22:30:12.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.083+0000 7fdce3843640 1 -- start start 2023-11-27T22:30:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.083+0000 7fdce3843640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcdc150560 0x7fdcdc0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.083+0000 7fdce3843640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdcdc0b3390 0x7fdcdc15d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.083+0000 7fdce3843640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0b49f0 con 0x7fdcdc150940 2023-11-27T22:30:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.083+0000 7fdce3843640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0b3de0 con 0x7fdcdc150560 2023-11-27T22:30:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.083+0000 7fdce3843640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0b40c0 con 0x7fdcdc0b3390 2023-11-27T22:30:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcdc150560 0x7fdcdc0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdcdc150560 0x7fdcdc0b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44172/0 (socket says 172.21.15.154:44172) 2023-11-27T22:30:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 -- 172.21.15.154:0/3542212409 learned_addr learned my addr 172.21.15.154:0/3542212409 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:12.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce1de0640 1 --1- 172.21.15.154:0/3542212409 >> v1:172.21.15.154:6789/0 conn(0x7fdcdc150940 0x7fdcdc0ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37852/0 (socket says 172.21.15.154:37852) 2023-11-27T22:30:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce0dde640 1 --2- 172.21.15.154:0/3542212409 >> v2:172.21.15.194:3300/0 conn(0x7fdcdc0b3390 0x7fdcdc15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 -- 172.21.15.154:0/3542212409 >> v2:172.21.15.194:3300/0 conn(0x7fdcdc0b3390 msgr2=0x7fdcdc15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:12.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 --2- 172.21.15.154:0/3542212409 >> v2:172.21.15.194:3300/0 conn(0x7fdcdc0b3390 0x7fdcdc15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 -- 172.21.15.154:0/3542212409 >> v1:172.21.15.154:6789/0 conn(0x7fdcdc150940 legacy=0x7fdcdc0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdce15df640 1 -- 172.21.15.154:0/3542212409 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0b43a0 con 0x7fdcdc150560 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.084+0000 7fdcd3fff640 1 -- 172.21.15.154:0/3542212409 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622514388 0 0) 0x7fdcdc0b49f0 con 0x7fdcdc150940 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce15df640 1 --2- 172.21.15.154:0/3542212409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc150560 0x7fdcdc0b2e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc072810 tx=0x7fdcd802bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96f8b1d8e8c38c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdcd3fff640 1 -- 172.21.15.154:0/3542212409 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd802d900 con 0x7fdcdc150560 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdcd3fff640 1 -- 172.21.15.154:0/3542212409 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd802da60 con 0x7fdcdc150560 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdcd3fff640 1 -- 172.21.15.154:0/3542212409 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd802ddf0 con 0x7fdcdc150560 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce3843640 1 -- 172.21.15.154:0/3542212409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc150560 msgr2=0x7fdcdc0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce3843640 1 --2- 172.21.15.154:0/3542212409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc150560 0x7fdcdc0b2e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc072810 tx=0x7fdcd802bb40 comp rx=0 tx=0).stop 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce3843640 1 -- 172.21.15.154:0/3542212409 shutdown_connections 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce3843640 1 --2- 172.21.15.154:0/3542212409 >> v2:172.21.15.194:3300/0 conn(0x7fdcdc0b3390 0x7fdcdc15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce3843640 1 --2- 172.21.15.154:0/3542212409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc150560 0x7fdcdc0b2e50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.085+0000 7fdce3843640 1 -- 172.21.15.154:0/3542212409 >> 172.21.15.154:0/3542212409 conn(0x7fdcdc06a4d0 msgr2=0x7fdcdc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:12.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.086+0000 7fdce3843640 1 -- 172.21.15.154:0/3542212409 shutdown_connections 2023-11-27T22:30:12.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.086+0000 7fdce3843640 1 -- 172.21.15.154:0/3542212409 wait complete. 2023-11-27T22:30:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 Processor -- start 2023-11-27T22:30:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 -- start start 2023-11-27T22:30:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 0x7fdcdc15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcdc150560 0x7fdcdc14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcdc1f2d60 0x7fdcdc14c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc14c830 con 0x7fdcdc0b3390 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc14d350 con 0x7fdcdc1f2d60 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce3843640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc14a240 con 0x7fdcdc150560 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.087+0000 7fdce15df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 0x7fdcdc15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 0x7fdcdc15a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44180/0 (socket says 172.21.15.154:44180) 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 -- 172.21.15.154:0/3260794902 learned_addr learned my addr 172.21.15.154:0/3260794902 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce1de0640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcdc1f2d60 0x7fdcdc14c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce0dde640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcdc150560 0x7fdcdc14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 -- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcdc150560 msgr2=0x7fdcdc14bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcdc150560 0x7fdcdc14bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 -- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcdc1f2d60 msgr2=0x7fdcdc14c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcdc1f2d60 0x7fdcdc14c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 -- 172.21.15.154:0/3260794902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8007420 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce15df640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 0x7fdcdc15a410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80078b0 tx=0x7fdcd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8035c90 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8035df0 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc14a500 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8040620 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.088+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc158970 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.089+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc14d520 con 0x7fdcdc0b3390 2023-11-27T22:30:12.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.090+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdcd802c420 con 0x7fdcdc0b3390 2023-11-27T22:30:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.090+0000 7fdcd1ffb640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdcc006b1c0 0x7fdcc006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.090+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcd80ab900 con 0x7fdcdc0b3390 2023-11-27T22:30:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.090+0000 7fdce0dde640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdcc006b1c0 0x7fdcc006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.091+0000 7fdce0dde640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdcc006b1c0 0x7fdcc006d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc1587e0 tx=0x7fdccc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.094+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdcd80766c0 con 0x7fdcdc0b3390 2023-11-27T22:30:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.266+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcdc069400 con 0x7fdcdc0b3390 2023-11-27T22:30:12.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.266+0000 7fdcd1ffb640 1 -- 172.21.15.154:0/3260794902 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcd8079ce0 con 0x7fdcdc0b3390 2023-11-27T22:30:12.269 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdcc006b1c0 msgr2=0x7fdcc006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdcc006b1c0 0x7fdcc006d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc1587e0 tx=0x7fdccc008040 comp rx=0 tx=0).stop 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 msgr2=0x7fdcdc15a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 0x7fdcdc15a410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdcd80078b0 tx=0x7fdcd80046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 shutdown_connections 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcdc1f2d60 0x7fdcdc14c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdcc006b1c0 0x7fdcc006d680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdcdc150560 0x7fdcdc14bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 --2- 172.21.15.154:0/3260794902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdcdc0b3390 0x7fdcdc15a410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 >> 172.21.15.154:0/3260794902 conn(0x7fdcdc06a4d0 msgr2=0x7fdcdc0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:12.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 shutdown_connections 2023-11-27T22:30:12.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.269+0000 7fdce3843640 1 -- 172.21.15.154:0/3260794902 wait complete. 2023-11-27T22:30:12.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:12.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.384+0000 7f731ce4f640 1 Processor -- start 2023-11-27T22:30:12.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.384+0000 7f731ce4f640 1 -- start start 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f731ce4f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f731815bbe0 0x7f73180cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f731ce4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f731815bfc0 0x7f73180c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f731ce4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731815f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f731ce4f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180cf0f0 con 0x7f731815bfc0 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f731ce4f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180c7ee0 con 0x7f731815bbe0 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f731ce4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73180cf330 con 0x7f73180c63c0 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f7315d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f731815bfc0 0x7f73180c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f7315d9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f731815bfc0 0x7f73180c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44184/0 (socket says 172.21.15.154:44184) 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.385+0000 7f7315d9b640 1 -- 172.21.15.154:0/1503367475 learned_addr learned my addr 172.21.15.154:0/1503367475 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f731659c640 1 --2- 172.21.15.154:0/1503367475 >> v2:172.21.15.194:3300/0 conn(0x7f731815bbe0 0x7f73180cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7316d9d640 1 --2- 172.21.15.154:0/1503367475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7315d9b640 1 -- 172.21.15.154:0/1503367475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 msgr2=0x7f731815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:12.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7315d9b640 1 --2- 172.21.15.154:0/1503367475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7315d9b640 1 -- 172.21.15.154:0/1503367475 >> v2:172.21.15.194:3300/0 conn(0x7f731815bbe0 msgr2=0x7f73180cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:12.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7315d9b640 1 --2- 172.21.15.154:0/1503367475 >> v2:172.21.15.194:3300/0 conn(0x7f731815bbe0 0x7f73180cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7315d9b640 1 -- 172.21.15.154:0/1503367475 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73180c7920 con 0x7f731815bfc0 2023-11-27T22:30:12.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.386+0000 7f7315d9b640 1 --2- 172.21.15.154:0/1503367475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f73180c5e80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f73180741e0 tx=0x7f730002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80253391142669e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731559a640 1 -- 172.21.15.154:0/1503367475 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000317e0 con 0x7f731815bfc0 2023-11-27T22:30:12.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731559a640 1 -- 172.21.15.154:0/1503367475 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7300031940 con 0x7f731815bfc0 2023-11-27T22:30:12.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731559a640 1 -- 172.21.15.154:0/1503367475 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300031cd0 con 0x7f731815bfc0 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 -- 172.21.15.154:0/1503367475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 msgr2=0x7f73180c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1503367475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f73180c5e80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f73180741e0 tx=0x7f730002b880 comp rx=0 tx=0).stop 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 -- 172.21.15.154:0/1503367475 shutdown_connections 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1503367475 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1503367475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f73180c5e80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1503367475 >> v2:172.21.15.194:3300/0 conn(0x7f731815bbe0 0x7f73180cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 -- 172.21.15.154:0/1503367475 >> 172.21.15.154:0/1503367475 conn(0x7f73180b2c10 msgr2=0x7f73180b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 -- 172.21.15.154:0/1503367475 shutdown_connections 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.387+0000 7f731ce4f640 1 -- 172.21.15.154:0/1503367475 wait complete. 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.388+0000 7f731ce4f640 1 Processor -- start 2023-11-27T22:30:12.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 -- start start 2023-11-27T22:30:12.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731815bbe0 0x7f731806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f731806fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731806d3d0 con 0x7f731815bfc0 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73180b3e30 con 0x7f731815bbe0 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731ce4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731806c360 con 0x7f73180c63c0 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f7316d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f731806fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f7316d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f731806fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44192/0 (socket says 172.21.15.154:44192) 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f7316d9d640 1 -- 172.21.15.154:0/1602954928 learned_addr learned my addr 172.21.15.154:0/1602954928 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f731659c640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.389+0000 7f7315d9b640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731815bbe0 0x7f731806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f7316d9d640 1 -- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 msgr2=0x7f731814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f7316d9d640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f7316d9d640 1 -- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731815bbe0 msgr2=0x7f731806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f7316d9d640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731815bbe0 0x7f731806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f7316d9d640 1 -- 172.21.15.154:0/1602954928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000094d0 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f7316d9d640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f731806fd30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f731000d5d0 tx=0x7f731000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100125f0 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310012770 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310012b20 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731806c640 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.390+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731806cc00 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.391+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7318069400 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.391+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7310012c80 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.392+0000 7f730effd640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f72f806b1c0 0x7f72f806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.392+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7310089d50 con 0x7f731815bfc0 2023-11-27T22:30:12.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.392+0000 7f731659c640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f72f806b1c0 0x7f72f806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.392+0000 7f731659c640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f72f806b1c0 0x7f72f806d680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7308003aa0 tx=0x7f73080098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.396+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f731008d030 con 0x7f731815bfc0 2023-11-27T22:30:12.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.562+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73180b3f70 con 0x7f731815bfc0 2023-11-27T22:30:12.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.563+0000 7f730effd640 1 -- 172.21.15.154:0/1602954928 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7310054b40 con 0x7f731815bfc0 2023-11-27T22:30:12.564 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:12.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f72f806b1c0 msgr2=0x7f72f806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f72f806b1c0 0x7f72f806d680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7308003aa0 tx=0x7f73080098d0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 msgr2=0x7f731806fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f731806fd30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f731000d5d0 tx=0x7f731000da90 comp rx=0 tx=0).stop 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 shutdown_connections 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f731815bbe0 0x7f731806ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.564+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f72f806b1c0 0x7f72f806d680 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.565+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f731815bfc0 0x7f731806fd30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.565+0000 7f731ce4f640 1 --2- 172.21.15.154:0/1602954928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73180c63c0 0x7f731814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.565+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 >> 172.21.15.154:0/1602954928 conn(0x7f73180b2c10 msgr2=0x7f73180c71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.565+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 shutdown_connections 2023-11-27T22:30:12.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.565+0000 7f731ce4f640 1 -- 172.21.15.154:0/1602954928 wait complete. 2023-11-27T22:30:12.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:12.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.679+0000 7fe825353640 1 Processor -- start 2023-11-27T22:30:12.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.679+0000 7fe825353640 1 -- start start 2023-11-27T22:30:12.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe825353640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe820160fb0 0x7fe820161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe825353640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8200d0ed0 0x7fe8200d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe825353640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe820161d20 con 0x7fe82006ea50 2023-11-27T22:30:12.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe825353640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82015e760 con 0x7fe820160fb0 2023-11-27T22:30:12.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe825353640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015d9a0 con 0x7fe8200d0ed0 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81effd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe82006ea50 0x7fe82006ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37866/0 (socket says 172.21.15.154:37866) 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81effd640 1 -- 172.21.15.154:0/3455258163 learned_addr learned my addr 172.21.15.154:0/3455258163 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81e7fc640 1 --2- 172.21.15.154:0/3455258163 >> v2:172.21.15.194:3300/0 conn(0x7fe820160fb0 0x7fe820161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81f7fe640 1 --2- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8200d0ed0 0x7fe8200d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81dffb640 1 -- 172.21.15.154:0/3455258163 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596191577 0 0) 0x7fe820161d20 con 0x7fe82006ea50 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81dffb640 1 -- 172.21.15.154:0/3455258163 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003520 con 0x7fe82006ea50 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81e7fc640 1 -- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8200d0ed0 msgr2=0x7fe8200d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81e7fc640 1 --2- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8200d0ed0 0x7fe8200d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81e7fc640 1 -- 172.21.15.154:0/3455258163 >> v1:172.21.15.154:6789/0 conn(0x7fe82006ea50 legacy=0x7fe82006ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.680+0000 7fe81e7fc640 1 -- 172.21.15.154:0/3455258163 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82015dc80 con 0x7fe820160fb0 2023-11-27T22:30:12.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.681+0000 7fe81e7fc640 1 --2- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe820160fb0 0x7fe820161440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097a0 tx=0x7fe81402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86613c4f19fa3138 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.681+0000 7fe81dffb640 1 -- 172.21.15.154:0/3455258163 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814031830 con 0x7fe820160fb0 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.681+0000 7fe81dffb640 1 -- 172.21.15.154:0/3455258163 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814031990 con 0x7fe820160fb0 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.681+0000 7fe81dffb640 1 -- 172.21.15.154:0/3455258163 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814031d20 con 0x7fe820160fb0 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 -- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe820160fb0 msgr2=0x7fe820161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 --2- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe820160fb0 0x7fe820161440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097a0 tx=0x7fe81402b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 -- 172.21.15.154:0/3455258163 shutdown_connections 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 --2- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8200d0ed0 0x7fe8200d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 --2- 172.21.15.154:0/3455258163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe820160fb0 0x7fe820161440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 -- 172.21.15.154:0/3455258163 >> 172.21.15.154:0/3455258163 conn(0x7fe82006a6b0 msgr2=0x7fe82006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:12.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 -- 172.21.15.154:0/3455258163 shutdown_connections 2023-11-27T22:30:12.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.682+0000 7fe825353640 1 -- 172.21.15.154:0/3455258163 wait complete. 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.683+0000 7fe825353640 1 Processor -- start 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.683+0000 7fe825353640 1 -- start start 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe825353640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe82006ea50 0x7fe820159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe825353640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8200d0ed0 0x7fe8200cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe825353640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 0x7fe82013f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe825353640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201f3f60 con 0x7fe820160fb0 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe825353640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82015a430 con 0x7fe8200d0ed0 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe825353640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201f33e0 con 0x7fe82006ea50 2023-11-27T22:30:12.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 0x7fe82013f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe81f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 0x7fe82013f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44198/0 (socket says 172.21.15.154:44198) 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe81effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe82006ea50 0x7fe820159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe81f7fe640 1 -- 172.21.15.154:0/2023271318 learned_addr learned my addr 172.21.15.154:0/2023271318 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.684+0000 7fe81e7fc640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8200d0ed0 0x7fe8200cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe81f7fe640 1 -- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe82006ea50 msgr2=0x7fe820159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe81f7fe640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe82006ea50 0x7fe820159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe81f7fe640 1 -- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8200d0ed0 msgr2=0x7fe8200cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe81f7fe640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8200d0ed0 0x7fe8200cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe81f7fe640 1 -- 172.21.15.154:0/2023271318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814009400 con 0x7fe820160fb0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe81f7fe640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 0x7fe82013f180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe81800e860 tx=0x7fe81800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800c6d0 con 0x7fe820160fb0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800c830 con 0x7fe820160fb0 2023-11-27T22:30:12.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8201f36c0 con 0x7fe820160fb0 2023-11-27T22:30:12.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81800cbe0 con 0x7fe820160fb0 2023-11-27T22:30:12.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.685+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8200cbad0 con 0x7fe820160fb0 2023-11-27T22:30:12.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.686+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8201f3ac0 con 0x7fe820160fb0 2023-11-27T22:30:12.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.686+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe81800cd60 con 0x7fe820160fb0 2023-11-27T22:30:12.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.687+0000 7fe8077fe640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe80c06b1c0 0x7fe80c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.687+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe818089b70 con 0x7fe820160fb0 2023-11-27T22:30:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.687+0000 7fe81effd640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe80c06b1c0 0x7fe80c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:12.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.687+0000 7fe81effd640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe80c06b1c0 0x7fe80c06d680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe810005c00 tx=0x7fe810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:12.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.691+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe8180549e0 con 0x7fe820160fb0 2023-11-27T22:30:12.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.856+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8201f6680 con 0x7fe820160fb0 2023-11-27T22:30:12.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.857+0000 7fe8077fe640 1 -- 172.21.15.154:0/2023271318 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe818058000 con 0x7fe820160fb0 2023-11-27T22:30:12.858 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe80c06b1c0 msgr2=0x7fe80c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe80c06b1c0 0x7fe80c06d680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe810005c00 tx=0x7fe810009040 comp rx=0 tx=0).stop 2023-11-27T22:30:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 msgr2=0x7fe82013f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:12.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 0x7fe82013f180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe81800e860 tx=0x7fe81800ed20 comp rx=0 tx=0).stop 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 shutdown_connections 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8200d0ed0 0x7fe8200cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe80c06b1c0 0x7fe80c06d680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe820160fb0 0x7fe82013f180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 --2- 172.21.15.154:0/2023271318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe82006ea50 0x7fe820159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.858+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 >> 172.21.15.154:0/2023271318 conn(0x7fe82006a6b0 msgr2=0x7fe8200d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.859+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 shutdown_connections 2023-11-27T22:30:12.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:12.859+0000 7fe825353640 1 -- 172.21.15.154:0/2023271318 wait complete. 2023-11-27T22:30:12.937 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-27T22:30:12.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.037+0000 7f9e3da36640 1 Processor -- start 2023-11-27T22:30:13.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.037+0000 7f9e3da36640 1 -- start start 2023-11-27T22:30:13.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e3da36640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e38160f70 0x7f9e380cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e3da36640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e380ce480 0x7f9e380d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e3da36640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e381614e0 con 0x7f9e3815d2d0 2023-11-27T22:30:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e3da36640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e381617c0 con 0x7f9e38160f70 2023-11-27T22:30:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e3da36640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38161aa0 con 0x7f9e380ce480 2023-11-27T22:30:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e367fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9e38160f70 0x7f9e380cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e36ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9e3815d2d0 0x7f9e380b8b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37878/0 (socket says 172.21.15.154:37878) 2023-11-27T22:30:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e36ffd640 1 -- 172.21.15.154:0/296110654 learned_addr learned my addr 172.21.15.154:0/296110654 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e367fc640 1 -- 172.21.15.154:0/296110654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e380ce480 msgr2=0x7f9e380d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e377fe640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e380ce480 0x7f9e380d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e367fc640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e380ce480 0x7f9e380d1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e35ffb640 1 -- 172.21.15.154:0/296110654 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069639397 0 0) 0x7f9e381614e0 con 0x7f9e3815d2d0 2023-11-27T22:30:13.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e367fc640 1 -- 172.21.15.154:0/296110654 >> v1:172.21.15.154:6789/0 conn(0x7f9e3815d2d0 legacy=0x7f9e380b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e367fc640 1 -- 172.21.15.154:0/296110654 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38161d80 con 0x7f9e38160f70 2023-11-27T22:30:13.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.038+0000 7f9e377fe640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e380ce480 0x7f9e380d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:13.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.039+0000 7f9e367fc640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e38160f70 0x7f9e380cdf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0097a0 tx=0x7f9e2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbc0af931f9ed4f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.039+0000 7f9e35ffb640 1 -- 172.21.15.154:0/296110654 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c031830 con 0x7f9e38160f70 2023-11-27T22:30:13.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.039+0000 7f9e35ffb640 1 -- 172.21.15.154:0/296110654 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c031990 con 0x7f9e38160f70 2023-11-27T22:30:13.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.039+0000 7f9e35ffb640 1 -- 172.21.15.154:0/296110654 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c031d20 con 0x7f9e38160f70 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 -- 172.21.15.154:0/296110654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e38160f70 msgr2=0x7f9e380cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e38160f70 0x7f9e380cdf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0097a0 tx=0x7f9e2c02b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 -- 172.21.15.154:0/296110654 shutdown_connections 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e380ce480 0x7f9e380d1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 --2- 172.21.15.154:0/296110654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e38160f70 0x7f9e380cdf40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 -- 172.21.15.154:0/296110654 >> 172.21.15.154:0/296110654 conn(0x7f9e38072230 msgr2=0x7f9e380cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 -- 172.21.15.154:0/296110654 shutdown_connections 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.040+0000 7f9e3da36640 1 -- 172.21.15.154:0/296110654 wait complete. 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.041+0000 7f9e3da36640 1 Processor -- start 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.041+0000 7f9e3da36640 1 -- start start 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e3da36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 0x7f9e38152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e3da36640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e3815d2d0 0x7f9e380c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e3da36640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38160f70 0x7f9e380b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e3da36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381530d0 con 0x7f9e380ce480 2023-11-27T22:30:13.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e3da36640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b3490 con 0x7f9e38160f70 2023-11-27T22:30:13.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e3da36640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3815e9a0 con 0x7f9e3815d2d0 2023-11-27T22:30:13.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 0x7f9e38152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 0x7f9e38152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44216/0 (socket says 172.21.15.154:44216) 2023-11-27T22:30:13.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 -- 172.21.15.154:0/373483076 learned_addr learned my addr 172.21.15.154:0/373483076 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e367fc640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e3815d2d0 0x7f9e380c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e377fe640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38160f70 0x7f9e380b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 -- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e3815d2d0 msgr2=0x7f9e380c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e3815d2d0 0x7f9e380c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 -- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38160f70 msgr2=0x7f9e380b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38160f70 0x7f9e380b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 -- 172.21.15.154:0/373483076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009400 con 0x7f9e380ce480 2023-11-27T22:30:13.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.042+0000 7f9e36ffd640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 0x7f9e38152b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c890 tx=0x7f9e2800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.043+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800a640 con 0x7f9e380ce480 2023-11-27T22:30:13.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.043+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800a7c0 con 0x7f9e380ce480 2023-11-27T22:30:13.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.043+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380b2b60 con 0x7f9e380ce480 2023-11-27T22:30:13.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.043+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800ab70 con 0x7f9e380ce480 2023-11-27T22:30:13.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.043+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e380b3120 con 0x7f9e380ce480 2023-11-27T22:30:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.044+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e38069400 con 0x7f9e380ce480 2023-11-27T22:30:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.044+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9e2800acd0 con 0x7f9e380ce480 2023-11-27T22:30:13.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.044+0000 7f9e1ffff640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9e2406b1f0 0x7f9e2406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.045+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e280891d0 con 0x7f9e380ce480 2023-11-27T22:30:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.045+0000 7f9e367fc640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9e2406b1f0 0x7f9e2406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.045+0000 7f9e367fc640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9e2406b1f0 0x7f9e2406d6b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c036000 tx=0x7f9e2c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.049+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9e28053f90 con 0x7f9e380ce480 2023-11-27T22:30:13.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.215+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e380d0aa0 con 0x7f9e380ce480 2023-11-27T22:30:13.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.216+0000 7f9e1ffff640 1 -- 172.21.15.154:0/373483076 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f9e280575b0 con 0x7f9e380ce480 2023-11-27T22:30:13.218 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:13.218 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9e2406b1f0 msgr2=0x7f9e2406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9e2406b1f0 0x7f9e2406d6b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c036000 tx=0x7f9e2c03c040 comp rx=0 tx=0).stop 2023-11-27T22:30:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 msgr2=0x7f9e38152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 0x7f9e38152b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c890 tx=0x7f9e2800cd50 comp rx=0 tx=0).stop 2023-11-27T22:30:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 shutdown_connections 2023-11-27T22:30:13.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38160f70 0x7f9e380b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9e2406b1f0 0x7f9e2406d6b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e3815d2d0 0x7f9e380c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 --2- 172.21.15.154:0/373483076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e380ce480 0x7f9e38152b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 >> 172.21.15.154:0/373483076 conn(0x7f9e38072230 msgr2=0x7f9e380b7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 shutdown_connections 2023-11-27T22:30:13.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.218+0000 7f9e3da36640 1 -- 172.21.15.154:0/373483076 wait complete. 2023-11-27T22:30:13.232 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:13.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.334+0000 7ff02ff05640 1 Processor -- start 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02ff05640 1 -- start start 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02ff05640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff02815d330 0x7ff0280b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02ff05640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280b2b10 con 0x7ff0280d2d90 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02ff05640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0280d1590 con 0x7ff0280d2910 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02ff05640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280d1870 con 0x7ff02815d330 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02e4a2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7ff0280d2d90 0x7ff0280b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37890/0 (socket says 172.21.15.154:37890) 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.335+0000 7ff02e4a2640 1 -- 172.21.15.154:0/943102262 learned_addr learned my addr 172.21.15.154:0/943102262 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:13.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02dca1640 1 --2- 172.21.15.154:0/943102262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff02815d330 0x7ff0280b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937116048 0 0) 0x7ff0280b2b10 con 0x7ff0280d2d90 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff014003520 con 0x7ff0280d2d90 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419009676 0 0) 0x7ff0280d1590 con 0x7ff0280d2910 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0280b2b10 con 0x7ff0280d2910 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02dca1640 1 -- 172.21.15.154:0/943102262 >> v1:172.21.15.194:6789/0 conn(0x7ff0280d2910 legacy=0x7ff0280d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02dca1640 1 -- 172.21.15.154:0/943102262 >> v1:172.21.15.154:6789/0 conn(0x7ff0280d2d90 legacy=0x7ff0280b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.336+0000 7ff02dca1640 1 -- 172.21.15.154:0/943102262 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280d1b50 con 0x7ff02815d330 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02dca1640 1 --2- 172.21.15.154:0/943102262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff02815d330 0x7ff0280b8b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff020009dc0 tx=0x7ff02002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1042225e8ab5208 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02002cc40 con 0x7ff02815d330 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02002cda0 con 0x7ff02815d330 2023-11-27T22:30:13.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02cc9f640 1 -- 172.21.15.154:0/943102262 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020034640 con 0x7ff02815d330 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02ff05640 1 -- 172.21.15.154:0/943102262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff02815d330 msgr2=0x7ff0280b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02ff05640 1 --2- 172.21.15.154:0/943102262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff02815d330 0x7ff0280b8b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff020009dc0 tx=0x7ff02002be90 comp rx=0 tx=0).stop 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02ff05640 1 -- 172.21.15.154:0/943102262 shutdown_connections 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02ff05640 1 --2- 172.21.15.154:0/943102262 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff02815d330 0x7ff0280b8b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.337+0000 7ff02ff05640 1 -- 172.21.15.154:0/943102262 >> 172.21.15.154:0/943102262 conn(0x7ff028072020 msgr2=0x7ff028072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.338+0000 7ff02ff05640 1 -- 172.21.15.154:0/943102262 shutdown_connections 2023-11-27T22:30:13.342 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.338+0000 7ff02ff05640 1 -- 172.21.15.154:0/943102262 wait complete. 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 Processor -- start 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 -- start start 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0280d2910 0x7ff02815f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0280d2d90 0x7ff028152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 0x7ff0280cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280c7fb0 con 0x7ff02815d330 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0281601d0 con 0x7ff0280d2910 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02ff05640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0281604b0 con 0x7ff0280d2d90 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.339+0000 7ff02e4a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 0x7ff0280cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 0x7ff0280cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44224/0 (socket says 172.21.15.154:44224) 2023-11-27T22:30:13.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 -- 172.21.15.154:0/2067812291 learned_addr learned my addr 172.21.15.154:0/2067812291 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02dca1640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0280d2910 0x7ff02815f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02d4a0640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0280d2d90 0x7ff028152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 -- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0280d2d90 msgr2=0x7ff028152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0280d2d90 0x7ff028152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 -- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0280d2910 msgr2=0x7ff02815f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0280d2910 0x7ff02815f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 -- 172.21.15.154:0/2067812291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020009a70 con 0x7ff02815d330 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02d4a0640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0280d2d90 0x7ff028152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02dca1640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0280d2910 0x7ff02815f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02e4a2640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 0x7ff0280cc920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff02400c420 tx=0x7ff02400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024005ce0 con 0x7ff02815d330 2023-11-27T22:30:13.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff024005e40 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff028160790 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0240072d0 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.340+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02815fec0 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.341+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02806bc00 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.341+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff0240074f0 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.342+0000 7ff01e7fc640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff00c06b1c0 0x7ff00c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.342+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff024088e40 con 0x7ff02815d330 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.342+0000 7ff02dca1640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff00c06b1c0 0x7ff00c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.342+0000 7ff02dca1640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff00c06b1c0 0x7ff00c06d680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff020036000 tx=0x7ff020030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.348 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.346+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff024053d70 con 0x7ff02815d330 2023-11-27T22:30:13.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.511+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff028069400 con 0x7ff02815d330 2023-11-27T22:30:13.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.511+0000 7ff01e7fc640 1 -- 172.21.15.154:0/2067812291 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff024017020 con 0x7ff02815d330 2023-11-27T22:30:13.513 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:13.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff00c06b1c0 msgr2=0x7ff00c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff00c06b1c0 0x7ff00c06d680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff020036000 tx=0x7ff020030000 comp rx=0 tx=0).stop 2023-11-27T22:30:13.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 msgr2=0x7ff0280cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 0x7ff0280cc920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff02400c420 tx=0x7ff02400c8e0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 shutdown_connections 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff00c06b1c0 0x7ff00c06d680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff02815d330 0x7ff0280cc920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff0280d2d90 0x7ff028152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 --2- 172.21.15.154:0/2067812291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0280d2910 0x7ff02815f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 >> 172.21.15.154:0/2067812291 conn(0x7ff028072020 msgr2=0x7ff0280b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 shutdown_connections 2023-11-27T22:30:13.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.513+0000 7ff02ff05640 1 -- 172.21.15.154:0/2067812291 wait complete. 2023-11-27T22:30:13.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.627+0000 7efee64ec640 1 Processor -- start 2023-11-27T22:30:13.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.627+0000 7efee64ec640 1 -- start start 2023-11-27T22:30:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.628+0000 7efee64ec640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efee00d3900 0x7efee00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.628+0000 7efee64ec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00b2b10 con 0x7efee015d330 2023-11-27T22:30:13.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.628+0000 7efee64ec640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00d1590 con 0x7efee00d2910 2023-11-27T22:30:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.628+0000 7efee64ec640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00d1870 con 0x7efee00d3900 2023-11-27T22:30:13.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.628+0000 7efedffff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efee015d330 0x7efee00b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37902/0 (socket says 172.21.15.154:37902) 2023-11-27T22:30:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedffff640 1 -- 172.21.15.154:0/1426877296 learned_addr learned my addr 172.21.15.154:0/1426877296 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428201912 0 0) 0x7efee00b2b10 con 0x7efee015d330 2023-11-27T22:30:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec8003520 con 0x7efee015d330 2023-11-27T22:30:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efee4a89640 1 --2- 172.21.15.154:0/1426877296 >> v2:172.21.15.194:3300/0 conn(0x7efee00d3900 0x7efee00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477401369 0 0) 0x7efec8003520 con 0x7efee015d330 2023-11-27T22:30:13.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 >> v2:172.21.15.194:3300/0 conn(0x7efee00d3900 msgr2=0x7efee00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 --2- 172.21.15.154:0/1426877296 >> v2:172.21.15.194:3300/0 conn(0x7efee00d3900 0x7efee00b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 >> v1:172.21.15.194:6789/0 conn(0x7efee00d2910 legacy=0x7efee00d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00d1b50 con 0x7efee015d330 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7efed0001670 con 0x7efee015d330 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 >> v1:172.21.15.154:6789/0 conn(0x7efee015d330 legacy=0x7efee00b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efec8003970 0x7efec8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efec8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efec8005180 0x7efec800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00d1870 con 0x7efec80047c0 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec800c120 con 0x7efec8005180 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec800c2e0 con 0x7efec8003970 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedf7fe640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efec8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efee4a89640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efec8005180 0x7efec800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.629+0000 7efedffff640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efec8003970 0x7efec8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedf7fe640 1 -- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efec8003970 msgr2=0x7efec8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedf7fe640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efec8003970 0x7efec8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedf7fe640 1 -- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efec8005180 msgr2=0x7efec800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:13.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedf7fe640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efec8005180 0x7efec800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedf7fe640 1 -- 172.21.15.154:0/1426877296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8003520 con 0x7efec80047c0 2023-11-27T22:30:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efee4a89640 1 -- 172.21.15.154:0/1426877296 reap_dead start 2023-11-27T22:30:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedf7fe640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efec8004c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efed4001750 tx=0x7efec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5f61c0ec9bca69 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed40052d0 con 0x7efec80047c0 2023-11-27T22:30:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed402e050 con 0x7efec80047c0 2023-11-27T22:30:13.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.630+0000 7efedeffd640 1 -- 172.21.15.154:0/1426877296 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4003830 con 0x7efec80047c0 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 -- 172.21.15.154:0/1426877296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 msgr2=0x7efec8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efec8004c40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efed4001750 tx=0x7efec80057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 -- 172.21.15.154:0/1426877296 shutdown_connections 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 --2- 172.21.15.154:0/1426877296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efec8004c40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 -- 172.21.15.154:0/1426877296 >> 172.21.15.154:0/1426877296 conn(0x7efee0072020 msgr2=0x7efee0072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 -- 172.21.15.154:0/1426877296 shutdown_connections 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.631+0000 7efee64ec640 1 -- 172.21.15.154:0/1426877296 wait complete. 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.632+0000 7efee64ec640 1 Processor -- start 2023-11-27T22:30:13.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.632+0000 7efee64ec640 1 -- start start 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee64ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efee00aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee64ec640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efee00cc8d0 0x7efee015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee64ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee00ab7e0 0x7efee00abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee64ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00ac1a0 con 0x7efec80047c0 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee64ec640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00ca660 con 0x7efee00cc8d0 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee64ec640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee00ca330 con 0x7efee00ab7e0 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efee00aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efee00aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44234/0 (socket says 172.21.15.154:44234) 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 -- 172.21.15.154:0/830422047 learned_addr learned my addr 172.21.15.154:0/830422047 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedf7fe640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efee00cc8d0 0x7efee015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efee4a89640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee00ab7e0 0x7efee00abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 -- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee00ab7e0 msgr2=0x7efee00abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee00ab7e0 0x7efee00abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 -- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efee00cc8d0 msgr2=0x7efee015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efee00cc8d0 0x7efee015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.633+0000 7efedffff640 1 -- 172.21.15.154:0/830422047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00aab60 con 0x7efec80047c0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.634+0000 7efedffff640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efee00aa620 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efed0007290 tx=0x7efed0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.634+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0001650 con 0x7efec80047c0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.634+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000f9c0 con 0x7efec80047c0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.634+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee00aae00 con 0x7efec80047c0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.634+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000fd50 con 0x7efec80047c0 2023-11-27T22:30:13.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.634+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee00ab3c0 con 0x7efec80047c0 2023-11-27T22:30:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.635+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0069400 con 0x7efec80047c0 2023-11-27T22:30:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.635+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efed001d460 con 0x7efec80047c0 2023-11-27T22:30:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.636+0000 7efedcff9640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efecc06b1f0 0x7efecc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.636+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efed0089920 con 0x7efec80047c0 2023-11-27T22:30:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.636+0000 7efedf7fe640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efecc06b1f0 0x7efecc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.636+0000 7efedf7fe640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efecc06b1f0 0x7efecc06d6b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efed4033000 tx=0x7efed4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.640+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efed0054790 con 0x7efec80047c0 2023-11-27T22:30:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.807+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efee015cb90 con 0x7efec80047c0 2023-11-27T22:30:13.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.808+0000 7efedcff9640 1 -- 172.21.15.154:0/830422047 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efed0057db0 con 0x7efec80047c0 2023-11-27T22:30:13.810 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:13.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efecc06b1f0 msgr2=0x7efecc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efecc06b1f0 0x7efecc06d6b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efed4033000 tx=0x7efed4009030 comp rx=0 tx=0).stop 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 msgr2=0x7efee00aa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efee00aa620 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efed0007290 tx=0x7efed0007750 comp rx=0 tx=0).stop 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 shutdown_connections 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efee00cc8d0 0x7efee015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efecc06b1f0 0x7efecc06d6b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee00ab7e0 0x7efee00abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 --2- 172.21.15.154:0/830422047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efec80047c0 0x7efee00aa620 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 >> 172.21.15.154:0/830422047 conn(0x7efee0072020 msgr2=0x7efee015d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 shutdown_connections 2023-11-27T22:30:13.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.810+0000 7efee64ec640 1 -- 172.21.15.154:0/830422047 wait complete. 2023-11-27T22:30:13.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.925+0000 7fa1586e7640 1 Processor -- start 2023-11-27T22:30:13.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.925+0000 7fa1586e7640 1 -- start start 2023-11-27T22:30:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa1586e7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa150150560 0x7fa1500b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa1586e7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa15015d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.928 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa1586e7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa150150940 0x7fa15015d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa1586e7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500b49f0 con 0x7fa150150940 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa1586e7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1500b3de0 con 0x7fa150150560 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa1586e7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500b40c0 con 0x7fa1500b3390 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa156c84640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa150150940 0x7fa15015d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa156c84640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa150150940 0x7fa15015d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44238/0 (socket says 172.21.15.154:44238) 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.926+0000 7fa156c84640 1 -- 172.21.15.154:0/857600871 learned_addr learned my addr 172.21.15.154:0/857600871 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa155c82640 1 --2- 172.21.15.154:0/857600871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa15015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156483640 1 --2- 172.21.15.154:0/857600871 >> v2:172.21.15.194:3300/0 conn(0x7fa150150560 0x7fa1500b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156c84640 1 -- 172.21.15.154:0/857600871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 msgr2=0x7fa15015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156c84640 1 --2- 172.21.15.154:0/857600871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa15015d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156c84640 1 -- 172.21.15.154:0/857600871 >> v2:172.21.15.194:3300/0 conn(0x7fa150150560 msgr2=0x7fa1500b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:13.929 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156c84640 1 --2- 172.21.15.154:0/857600871 >> v2:172.21.15.194:3300/0 conn(0x7fa150150560 0x7fa1500b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156c84640 1 -- 172.21.15.154:0/857600871 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500b43a0 con 0x7fa150150940 2023-11-27T22:30:13.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.927+0000 7fa156c84640 1 --2- 172.21.15.154:0/857600871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150940 0x7fa15015d740 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa150072840 tx=0x7fa14802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced81c9c611efa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa155481640 1 -- 172.21.15.154:0/857600871 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14802ca70 con 0x7fa150150940 2023-11-27T22:30:13.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa155481640 1 -- 172.21.15.154:0/857600871 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14802cbd0 con 0x7fa150150940 2023-11-27T22:30:13.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa155481640 1 -- 172.21.15.154:0/857600871 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480343f0 con 0x7fa150150940 2023-11-27T22:30:13.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 -- 172.21.15.154:0/857600871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150940 msgr2=0x7fa15015d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 --2- 172.21.15.154:0/857600871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150940 0x7fa15015d740 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa150072840 tx=0x7fa14802bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 -- 172.21.15.154:0/857600871 shutdown_connections 2023-11-27T22:30:13.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 --2- 172.21.15.154:0/857600871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150940 0x7fa15015d740 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 --2- 172.21.15.154:0/857600871 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa15015d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 --2- 172.21.15.154:0/857600871 >> v2:172.21.15.194:3300/0 conn(0x7fa150150560 0x7fa1500b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 -- 172.21.15.154:0/857600871 >> 172.21.15.154:0/857600871 conn(0x7fa15006a4d0 msgr2=0x7fa15006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:13.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 -- 172.21.15.154:0/857600871 shutdown_connections 2023-11-27T22:30:13.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.928+0000 7fa1586e7640 1 -- 172.21.15.154:0/857600871 wait complete. 2023-11-27T22:30:13.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.929+0000 7fa1586e7640 1 Processor -- start 2023-11-27T22:30:13.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.929+0000 7fa1586e7640 1 -- start start 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa1586e7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa1501590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa1586e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 0x7fa15014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa1586e7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa150156570 0x7fa1501535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa1586e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501586b0 con 0x7fa150150560 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa1586e7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15014fdb0 con 0x7fa150156570 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa1586e7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa150153b10 con 0x7fa1500b3390 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 0x7fa15014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 0x7fa15014f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44248/0 (socket says 172.21.15.154:44248) 2023-11-27T22:30:13.936 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 -- 172.21.15.154:0/1435956859 learned_addr learned my addr 172.21.15.154:0/1435956859 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa156483640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa1501590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa156c84640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa150156570 0x7fa1501535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 -- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 msgr2=0x7fa1501590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa1501590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 -- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa150156570 msgr2=0x7fa1501535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.930+0000 7fa155c82640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa150156570 0x7fa1501535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa155c82640 1 -- 172.21.15.154:0/1435956859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009b30 con 0x7fa150150560 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa156c84640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa150156570 0x7fa1501535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa155c82640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 0x7fa15014f870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa14000d800 tx=0x7fa14000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000b6c0 con 0x7fa150150560 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000b820 con 0x7fa150150560 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150157150 con 0x7fa150150560 2023-11-27T22:30:13.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000bbb0 con 0x7fa150150560 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.931+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501588c0 con 0x7fa150150560 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.932+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150069400 con 0x7fa150150560 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.932+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa14000bd10 con 0x7fa150150560 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.933+0000 7fa146ffd640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa13406b1c0 0x7fa13406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.933+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa140089e70 con 0x7fa150150560 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.933+0000 7fa156483640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa13406b1c0 0x7fa13406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.933+0000 7fa156483640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa13406b1c0 0x7fa13406d680 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa14c006fd0 tx=0x7fa14c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:13.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:13.937+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa140054c30 con 0x7fa150150560 2023-11-27T22:30:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.102+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa150153f90 con 0x7fa150150560 2023-11-27T22:30:14.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.103+0000 7fa146ffd640 1 -- 172.21.15.154:0/1435956859 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa140058250 con 0x7fa150150560 2023-11-27T22:30:14.105 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:14.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa13406b1c0 msgr2=0x7fa13406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa13406b1c0 0x7fa13406d680 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa14c006fd0 tx=0x7fa14c008040 comp rx=0 tx=0).stop 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 msgr2=0x7fa15014f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 0x7fa15014f870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa14000d800 tx=0x7fa14000dcc0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 shutdown_connections 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa150156570 0x7fa1501535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa13406b1c0 0x7fa13406d680 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa150150560 0x7fa15014f870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 --2- 172.21.15.154:0/1435956859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1500b3390 0x7fa1501590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.104+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 >> 172.21.15.154:0/1435956859 conn(0x7fa15006a4d0 msgr2=0x7fa15015d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.105+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 shutdown_connections 2023-11-27T22:30:14.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.105+0000 7fa1586e7640 1 -- 172.21.15.154:0/1435956859 wait complete. 2023-11-27T22:30:14.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-27T22:30:14.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.216+0000 7f4d42c56640 1 Processor -- start 2023-11-27T22:30:14.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.216+0000 7f4d42c56640 1 -- start start 2023-11-27T22:30:14.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d42c56640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d3c143490 0x7f4d3c0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d42c56640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c15e730 0x7f4d3c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d42c56640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4d3c15a4e0 0x7f4d3c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d42c56640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c15b520 con 0x7f4d3c143490 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d42c56640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c143870 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d42c56640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c15e2a0 con 0x7f4d3c15e730 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d3c143490 0x7f4d3c0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d3c143490 0x7f4d3c0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44256/0 (socket says 172.21.15.154:44256) 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 -- 172.21.15.154:0/572686841 learned_addr learned my addr 172.21.15.154:0/572686841 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d411f3640 1 --2- 172.21.15.154:0/572686841 >> v2:172.21.15.194:3300/0 conn(0x7f4d3c15a4e0 0x7f4d3c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d3bfff640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c15e730 0x7f4d3c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 -- 172.21.15.154:0/572686841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c15e730 msgr2=0x7f4d3c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c15e730 0x7f4d3c0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 -- 172.21.15.154:0/572686841 >> v2:172.21.15.194:3300/0 conn(0x7f4d3c15a4e0 msgr2=0x7f4d3c15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 --2- 172.21.15.154:0/572686841 >> v2:172.21.15.194:3300/0 conn(0x7f4d3c15a4e0 0x7f4d3c15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d409f2640 1 -- 172.21.15.154:0/572686841 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c15b240 con 0x7f4d3c143490 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.217+0000 7f4d3bfff640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c15e730 0x7f4d3c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.218+0000 7f4d409f2640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c143490 0x7f4d3c0b0cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c15eb90 tx=0x7f4d3002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b132161659caa8f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.218+0000 7f4d3b7fe640 1 -- 172.21.15.154:0/572686841 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30031870 con 0x7f4d3c143490 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.218+0000 7f4d3b7fe640 1 -- 172.21.15.154:0/572686841 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d300319d0 con 0x7f4d3c143490 2023-11-27T22:30:14.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.218+0000 7f4d3b7fe640 1 -- 172.21.15.154:0/572686841 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30031d60 con 0x7f4d3c143490 2023-11-27T22:30:14.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.218+0000 7f4d42c56640 1 -- 172.21.15.154:0/572686841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c143490 msgr2=0x7f4d3c0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.218+0000 7f4d42c56640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c143490 0x7f4d3c0b0cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c15eb90 tx=0x7f4d3002b910 comp rx=0 tx=0).stop 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 -- 172.21.15.154:0/572686841 shutdown_connections 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 --2- 172.21.15.154:0/572686841 >> v2:172.21.15.194:3300/0 conn(0x7f4d3c15a4e0 0x7f4d3c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c15e730 0x7f4d3c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 --2- 172.21.15.154:0/572686841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c143490 0x7f4d3c0b0cf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 -- 172.21.15.154:0/572686841 >> 172.21.15.154:0/572686841 conn(0x7f4d3c06a4d0 msgr2=0x7f4d3c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 -- 172.21.15.154:0/572686841 shutdown_connections 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.219+0000 7f4d42c56640 1 -- 172.21.15.154:0/572686841 wait complete. 2023-11-27T22:30:14.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.220+0000 7f4d42c56640 1 Processor -- start 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.220+0000 7f4d42c56640 1 -- start start 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c143490 0x7f4d3c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 0x7f4d3c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d3c15e730 0x7f4d3c13cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c140800 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c13f940 con 0x7f4d3c15e730 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c13fbf0 con 0x7f4d3c143490 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 0x7f4d3c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 0x7f4d3c15c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44272/0 (socket says 172.21.15.154:44272) 2023-11-27T22:30:14.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 -- 172.21.15.154:0/831005464 learned_addr learned my addr 172.21.15.154:0/831005464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d411f3640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d3c15e730 0x7f4d3c13cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d409f2640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c143490 0x7f4d3c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 -- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c143490 msgr2=0x7f4d3c13f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c143490 0x7f4d3c13f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 -- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d3c15e730 msgr2=0x7f4d3c13cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d3c15e730 0x7f4d3c13cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 -- 172.21.15.154:0/831005464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300094d0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d3bfff640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 0x7f4d3c15c560 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c7f0 tx=0x7f4d2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28007820 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d28007980 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3c13fed0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28007cf0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.221+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c140490 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.223+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c069400 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.228 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.223+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d280113f0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.223+0000 7f4d397fa640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2006b1c0 0x7f4d2006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.223+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d28089cb0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.223+0000 7f4d409f2640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2006b1c0 0x7f4d2006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.224+0000 7f4d409f2640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2006b1c0 0x7f4d2006d680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4d30036000 tx=0x7f4d3003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:14.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.227+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d280549e0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.462+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f4d3c0b2820 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.765+0000 7f4d397fa640 1 -- 172.21.15.154:0/831005464 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v53) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4d2801f0d0 con 0x7f4d3c15a4e0 2023-11-27T22:30:14.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2006b1c0 msgr2=0x7f4d2006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2006b1c0 0x7f4d2006d680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4d30036000 tx=0x7f4d3003c040 comp rx=0 tx=0).stop 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 msgr2=0x7f4d3c15c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 0x7f4d3c15c560 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c7f0 tx=0x7f4d2800ccb0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 shutdown_connections 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d3c15e730 0x7f4d3c13cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.767+0000 7f4d42c56640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2006b1c0 0x7f4d2006d680 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.768+0000 7f4d42c56640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d3c15a4e0 0x7f4d3c15c560 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.768+0000 7f4d42c56640 1 --2- 172.21.15.154:0/831005464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d3c143490 0x7f4d3c13f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.768+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 >> 172.21.15.154:0/831005464 conn(0x7f4d3c06a4d0 msgr2=0x7f4d3c0cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:14.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.768+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 shutdown_connections 2023-11-27T22:30:14.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.768+0000 7f4d42c56640 1 -- 172.21.15.154:0/831005464 wait complete. 2023-11-27T22:30:14.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-27T22:30:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.884+0000 7f9140410640 1 Processor -- start 2023-11-27T22:30:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.884+0000 7f9140410640 1 -- start start 2023-11-27T22:30:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f9140410640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 0x7f91380ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f9140410640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91380b49f0 con 0x7f9138150940 2023-11-27T22:30:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f9140410640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91380b3560 con 0x7f9138150560 2023-11-27T22:30:14.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f9140410640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91380b3de0 con 0x7f913815d910 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d9ab640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9138150940 0x7f913815d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37912/0 (socket says 172.21.15.154:37912) 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d9ab640 1 -- 172.21.15.154:0/244032755 learned_addr learned my addr 172.21.15.154:0/244032755 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165701226 0 0) 0x7f91380b49f0 con 0x7f9138150940 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9124003520 con 0x7f9138150940 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913e9ad640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 0x7f91380ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 496355615 0 0) 0x7f9124003520 con 0x7f9138150940 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 msgr2=0x7f91380ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 0x7f91380ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 >> v1:172.21.15.194:6789/0 conn(0x7f9138150560 legacy=0x7f91380b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380b40c0 con 0x7f9138150940 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f9128001670 con 0x7f9138150940 2023-11-27T22:30:14.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 >> v1:172.21.15.154:6789/0 conn(0x7f9138150940 legacy=0x7f913815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 0x7f91240039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9124003fd0 0x7f91240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124004d00 0x7f9124005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91380b3de0 con 0x7f9124004d00 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912400cc50 con 0x7f9124003fd0 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91240059d0 con 0x7f913815d910 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.885+0000 7f913e9ad640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124004d00 0x7f9124005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e1ac640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 0x7f91240039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913d9ab640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9124003fd0 0x7f91240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e9ad640 1 -- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 msgr2=0x7f91240039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e9ad640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f913815d910 0x7f91240039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e9ad640 1 -- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9124003fd0 msgr2=0x7f91240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e9ad640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9124003fd0 0x7f91240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e9ad640 1 -- 172.21.15.154:0/244032755 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124003520 con 0x7f9124004d00 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.886+0000 7f913e9ad640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124004d00 0x7f9124005180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9130007360 tx=0x7f91240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a1053f5c3d66db server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913002ccd0 con 0x7f9124004d00 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913002ce30 con 0x7f9124004d00 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f913d1aa640 1 -- 172.21.15.154:0/244032755 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130034660 con 0x7f9124004d00 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f9140410640 1 -- 172.21.15.154:0/244032755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124004d00 msgr2=0x7f9124005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f9140410640 1 --2- 172.21.15.154:0/244032755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9124004d00 0x7f9124005180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9130007360 tx=0x7f91240057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f913e9ad640 1 -- 172.21.15.154:0/244032755 reap_dead start 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f9140410640 1 -- 172.21.15.154:0/244032755 shutdown_connections 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f9140410640 1 -- 172.21.15.154:0/244032755 >> 172.21.15.154:0/244032755 conn(0x7f913806a4d0 msgr2=0x7f913806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f9140410640 1 -- 172.21.15.154:0/244032755 shutdown_connections 2023-11-27T22:30:14.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.887+0000 7f9140410640 1 -- 172.21.15.154:0/244032755 wait complete. 2023-11-27T22:30:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.888+0000 7f9140410640 1 Processor -- start 2023-11-27T22:30:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.888+0000 7f9140410640 1 -- start start 2023-11-27T22:30:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f9140410640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9124004d00 0x7f91381586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f9140410640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 0x7f91380afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f9140410640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91381424c0 0x7f9138142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f9140410640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138142e80 con 0x7f9138155220 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f9140410640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138150dd0 con 0x7f91381424c0 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f9140410640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9138158d90 con 0x7f9124004d00 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f913d9ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 0x7f91380afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f913d9ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 0x7f91380afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44298/0 (socket says 172.21.15.154:44298) 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f913d9ab640 1 -- 172.21.15.154:0/1481527488 learned_addr learned my addr 172.21.15.154:0/1481527488 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f913e9ad640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91381424c0 0x7f9138142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.889+0000 7f913e1ac640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9124004d00 0x7f91381586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913d9ab640 1 -- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9124004d00 msgr2=0x7f91381586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913d9ab640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9124004d00 0x7f91381586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913d9ab640 1 -- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91381424c0 msgr2=0x7f9138142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913d9ab640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91381424c0 0x7f9138142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:14.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913d9ab640 1 -- 172.21.15.154:0/1481527488 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138151040 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913e9ad640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91381424c0 0x7f9138142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913e1ac640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9124004d00 0x7f91381586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f913d9ab640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 0x7f91380afb30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91280072c0 tx=0x7f91280076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800fa00 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912800fb80 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91280133f0 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9138151320 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.890+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9138155680 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.891+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9138151560 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.891+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9128013550 con 0x7f9138155220 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.892+0000 7f912effd640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f911c06b1f0 0x7f911c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:14.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.892+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9128089d40 con 0x7f9138155220 2023-11-27T22:30:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.892+0000 7f913e1ac640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f911c06b1f0 0x7f911c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.892+0000 7f913e1ac640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f911c06b1f0 0x7f911c06d6b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91340036b0 tx=0x7f9134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:14.898 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:14.896+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9138151560 con 0x7f9138155220 2023-11-27T22:30:15.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.064+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9138151560 con 0x7f9138155220 2023-11-27T22:30:15.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.067+0000 7f912effd640 1 -- 172.21.15.154:0/1481527488 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9138151560 con 0x7f9138155220 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f911c06b1f0 msgr2=0x7f911c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f911c06b1f0 0x7f911c06d6b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91340036b0 tx=0x7f9134009040 comp rx=0 tx=0).stop 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 msgr2=0x7f91380afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 0x7f91380afb30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f91280072c0 tx=0x7f91280076c0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 shutdown_connections 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91381424c0 0x7f9138142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f911c06b1f0 0x7f911c06d6b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9138155220 0x7f91380afb30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 --2- 172.21.15.154:0/1481527488 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9124004d00 0x7f91381586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 >> 172.21.15.154:0/1481527488 conn(0x7f913806a4d0 msgr2=0x7f913815adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 shutdown_connections 2023-11-27T22:30:15.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.069+0000 7f9140410640 1 -- 172.21.15.154:0/1481527488 wait complete. 2023-11-27T22:30:15.081 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T22:30:15.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T22:30:15.123 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T22:30:15.179 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T22:30:15.179 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:30:15.179 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:15.194 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:30:15.194 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:15.250 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.389+0000 7f3685bf5640 1 Processor -- start 2023-11-27T22:30:15.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.389+0000 7f3685bf5640 1 -- start start 2023-11-27T22:30:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f3685bf5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3680144a00 0x7f368006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f3685bf5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800b2ef0 con 0x7f36801415f0 2023-11-27T22:30:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f3685bf5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36800b31d0 con 0x7f3680144440 2023-11-27T22:30:15.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f3685bf5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36800b3b70 con 0x7f3680144a00 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f36801415f0 0x7f3680141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37914/0 (socket says 172.21.15.154:37914) 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367f7fe640 1 -- 172.21.15.154:0/2903574170 learned_addr learned my addr 172.21.15.154:0/2903574170 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237384474 0 0) 0x7f36800b2ef0 con 0x7f36801415f0 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3668003520 con 0x7f36801415f0 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367effd640 1 --2- 172.21.15.154:0/2903574170 >> v2:172.21.15.194:3300/0 conn(0x7f3680144a00 0x7f368006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119945154 0 0) 0x7f3668003520 con 0x7f36801415f0 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 >> v2:172.21.15.194:3300/0 conn(0x7f3680144a00 msgr2=0x7f368006b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 --2- 172.21.15.154:0/2903574170 >> v2:172.21.15.194:3300/0 conn(0x7f3680144a00 0x7f368006b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 >> v1:172.21.15.194:6789/0 conn(0x7f3680144440 legacy=0x7f36800b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36800b34b0 con 0x7f36801415f0 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f3670001670 con 0x7f36801415f0 2023-11-27T22:30:15.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367effd640 1 --2- 172.21.15.154:0/2903574170 >> v2:172.21.15.194:3300/0 conn(0x7f3680144a00 0x7f368006b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 >> v1:172.21.15.154:6789/0 conn(0x7f36801415f0 legacy=0x7f3680141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3668003970 0x7f3668003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36680047c0 0x7f3668004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3668005180 0x7f366800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36800b3b70 con 0x7f36680047c0 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366800c0d0 con 0x7f3668005180 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.390+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366800c290 con 0x7f3668003970 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367effd640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36680047c0 0x7f3668004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367f7fe640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3668003970 0x7f3668003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367ffff640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3668005180 0x7f366800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367effd640 1 -- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3668003970 msgr2=0x7f3668003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367effd640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3668003970 0x7f3668003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367effd640 1 -- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3668005180 msgr2=0x7f366800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367effd640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3668005180 0x7f366800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367effd640 1 -- 172.21.15.154:0/2903574170 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668003520 con 0x7f36680047c0 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.391+0000 7f367ffff640 1 -- 172.21.15.154:0/2903574170 reap_dead start 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f367effd640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36680047c0 0x7f3668004c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3680144e40 tx=0x7f36680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaa28bb700b2d96 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674004030 con 0x7f36680047c0 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674004190 con 0x7f36680047c0 2023-11-27T22:30:15.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f367e7fc640 1 -- 172.21.15.154:0/2903574170 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674003610 con 0x7f36680047c0 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 -- 172.21.15.154:0/2903574170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36680047c0 msgr2=0x7f3668004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36680047c0 0x7f3668004c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3680144e40 tx=0x7f36680057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 -- 172.21.15.154:0/2903574170 shutdown_connections 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 --2- 172.21.15.154:0/2903574170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f36680047c0 0x7f3668004c40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 -- 172.21.15.154:0/2903574170 >> 172.21.15.154:0/2903574170 conn(0x7f3680070e70 msgr2=0x7f3680071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 -- 172.21.15.154:0/2903574170 shutdown_connections 2023-11-27T22:30:15.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.392+0000 7f3685bf5640 1 -- 172.21.15.154:0/2903574170 wait complete. 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.393+0000 7f3685bf5640 1 Processor -- start 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 -- start start 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36680047c0 0x7f368006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 0x7f3680134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3680154380 0x7f36801345b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368006ea60 con 0x7f3680153f00 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368006e5d0 con 0x7f36680047c0 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f3685bf5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368006d9c0 con 0x7f3680154380 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f367effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 0x7f3680134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.394+0000 7f367effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 0x7f3680134070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44316/0 (socket says 172.21.15.154:44316) 2023-11-27T22:30:15.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 -- 172.21.15.154:0/4237436674 learned_addr learned my addr 172.21.15.154:0/4237436674 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367f7fe640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36680047c0 0x7f368006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367ffff640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3680154380 0x7f36801345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 -- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3680154380 msgr2=0x7f36801345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3680154380 0x7f36801345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 -- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36680047c0 msgr2=0x7f368006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36680047c0 0x7f368006d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 -- 172.21.15.154:0/4237436674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368006dca0 con 0x7f3680153f00 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367f7fe640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36680047c0 0x7f368006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367ffff640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3680154380 0x7f36801345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f367effd640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 0x7f3680134070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3674009990 tx=0x7f3674004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674030600 con 0x7f3680153f00 2023-11-27T22:30:15.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367403e040 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36740309a0 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368006df80 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.395+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368006d5f0 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.396+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3680069400 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.396+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3674030b00 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.397+0000 7f3667fff640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f366c06b1c0 0x7f366c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.397+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36740abe70 con 0x7f3680153f00 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.397+0000 7f367f7fe640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f366c06b1c0 0x7f366c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.397+0000 7f367f7fe640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f366c06b1c0 0x7f366c06d680 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3670007c60 tx=0x7f3670009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.401+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3674076b30 con 0x7f3680153f00 2023-11-27T22:30:15.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.569+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f368006ea60 con 0x7f3680153f00 2023-11-27T22:30:15.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.571+0000 7f3667fff640 1 -- 172.21.15.154:0/4237436674 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f367402d030 con 0x7f3680153f00 2023-11-27T22:30:15.573 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:15.573 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:15.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f366c06b1c0 msgr2=0x7f366c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f366c06b1c0 0x7f366c06d680 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3670007c60 tx=0x7f3670009040 comp rx=0 tx=0).stop 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 msgr2=0x7f3680134070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 0x7f3680134070 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3674009990 tx=0x7f3674004730 comp rx=0 tx=0).stop 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 shutdown_connections 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f366c06b1c0 0x7f366c06d680 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3680154380 0x7f36801345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3680153f00 0x7f3680134070 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 --2- 172.21.15.154:0/4237436674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36680047c0 0x7f368006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 >> 172.21.15.154:0/4237436674 conn(0x7f3680070e70 msgr2=0x7f368015cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 shutdown_connections 2023-11-27T22:30:15.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.573+0000 7f3685bf5640 1 -- 172.21.15.154:0/4237436674 wait complete. 2023-11-27T22:30:15.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:15.586 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:15.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.688+0000 7fd9b1623640 1 Processor -- start 2023-11-27T22:30:15.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.688+0000 7fd9b1623640 1 -- start start 2023-11-27T22:30:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9b1623640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 0x7fd9ac0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9b1623640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9ac0d2910 0x7fd9ac0d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9b1623640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ac0b2b10 con 0x7fd9ac0d2d90 2023-11-27T22:30:15.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9b1623640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d1590 con 0x7fd9ac0d2910 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9b1623640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d1870 con 0x7fd9ac15d330 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9ab7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd9ac0d2d90 0x7fd9ac0b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37930/0 (socket says 172.21.15.154:37930) 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9ab7fe640 1 -- 172.21.15.154:0/2315142009 learned_addr learned my addr 172.21.15.154:0/2315142009 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9aaffd640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 0x7fd9ac0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2315142009 >> v2:172.21.15.194:3300/0 conn(0x7fd9ac0d2910 0x7fd9ac0d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523426308 0 0) 0x7fd9ac0b2b10 con 0x7fd9ac0d2d90 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd994003520 con 0x7fd9ac0d2d90 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395131537 0 0) 0x7fd994003520 con 0x7fd9ac0d2d90 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 msgr2=0x7fd9ac0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 0x7fd9ac0b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 >> v2:172.21.15.194:3300/0 conn(0x7fd9ac0d2910 msgr2=0x7fd9ac0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 --2- 172.21.15.154:0/2315142009 >> v2:172.21.15.194:3300/0 conn(0x7fd9ac0d2910 0x7fd9ac0d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0d1b50 con 0x7fd9ac0d2d90 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fd9a40019f0 con 0x7fd9ac0d2d90 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.689+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 >> v1:172.21.15.154:6789/0 conn(0x7fd9ac0d2d90 legacy=0x7fd9ac0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9a9ffb640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd994003970 0x7fd994003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9a9ffb640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9940047c0 0x7fd994004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9a9ffb640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 0x7fd994005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d1590 con 0x7fd9940047c0 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0d1870 con 0x7fd994003970 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99400b980 con 0x7fd9ac15d330 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9940047c0 0x7fd994004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aaffd640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd994003970 0x7fd994003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9ab7fe640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 0x7fd994005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 msgr2=0x7fd994005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9ac15d330 0x7fd994005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd994003970 msgr2=0x7fd994003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd994003970 0x7fd994003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.690+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2315142009 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd994003520 con 0x7fd9940047c0 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9940047c0 0x7fd994004c40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009af0 tx=0x7fd9940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159d8841dc4380e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a002c710 con 0x7fd9940047c0 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a002c870 con 0x7fd9940047c0 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9a9ffb640 1 -- 172.21.15.154:0/2315142009 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a002cc00 con 0x7fd9940047c0 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9b1623640 1 -- 172.21.15.154:0/2315142009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9940047c0 msgr2=0x7fd994004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2315142009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9940047c0 0x7fd994004c40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009af0 tx=0x7fd9940057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9ab7fe640 1 -- 172.21.15.154:0/2315142009 reap_dead start 2023-11-27T22:30:15.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9b1623640 1 -- 172.21.15.154:0/2315142009 shutdown_connections 2023-11-27T22:30:15.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9b1623640 1 -- 172.21.15.154:0/2315142009 >> 172.21.15.154:0/2315142009 conn(0x7fd9ac072020 msgr2=0x7fd9ac072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:15.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9b1623640 1 -- 172.21.15.154:0/2315142009 shutdown_connections 2023-11-27T22:30:15.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.691+0000 7fd9b1623640 1 -- 172.21.15.154:0/2315142009 wait complete. 2023-11-27T22:30:15.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 Processor -- start 2023-11-27T22:30:15.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 -- start start 2023-11-27T22:30:15.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9940047c0 0x7fd9ac0b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 0x7fd9ac0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9ac0cb8c0 0x7fd9ac0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac0b4900 con 0x7fd9ac0b4480 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac158520 con 0x7fd9ac0cb8c0 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9b1623640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac147540 con 0x7fd9940047c0 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.693+0000 7fd9aa7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 0x7fd9ac0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 0x7fd9ac0cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44344/0 (socket says 172.21.15.154:44344) 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2419120736 learned_addr learned my addr 172.21.15.154:0/2419120736 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aaffd640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9940047c0 0x7fd9ac0b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9ab7fe640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9ac0cb8c0 0x7fd9ac0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9940047c0 msgr2=0x7fd9ac0b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9940047c0 0x7fd9ac0b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9ac0cb8c0 msgr2=0x7fd9ac0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9ac0cb8c0 0x7fd9ac0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 -- 172.21.15.154:0/2419120736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac1587a0 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9ab7fe640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9ac0cb8c0 0x7fd9ac0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9aa7fc640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 0x7fd9ac0cb380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0037040 tx=0x7fd9a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0003810 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a002de90 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0003b70 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac14a300 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.694+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac158d40 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.695+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac158ed0 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.696+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd9a0003cd0 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.696+0000 7fd9937fe640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.696+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9a00ab8e0 con 0x7fd9ac0b4480 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.696+0000 7fd9aaffd640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.696+0000 7fd9aaffd640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0d01a0 tx=0x7fd99c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.700+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd9a00766a0 con 0x7fd9ac0b4480 2023-11-27T22:30:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.866+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9ac069400 con 0x7fd9ac0b4480 2023-11-27T22:30:15.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.867+0000 7fd9937fe640 1 -- 172.21.15.154:0/2419120736 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9a0079cc0 con 0x7fd9ac0b4480 2023-11-27T22:30:15.869 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:15.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 msgr2=0x7fd99806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac0d01a0 tx=0x7fd99c008040 comp rx=0 tx=0).stop 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 msgr2=0x7fd9ac0cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 0x7fd9ac0cb380 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0037040 tx=0x7fd9a0004730 comp rx=0 tx=0).stop 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 shutdown_connections 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9ac0cb8c0 0x7fd9ac0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd99806b1c0 0x7fd99806d680 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9ac0b4480 0x7fd9ac0cb380 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 --2- 172.21.15.154:0/2419120736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9940047c0 0x7fd9ac0b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 >> 172.21.15.154:0/2419120736 conn(0x7fd9ac072020 msgr2=0x7fd9ac15c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 shutdown_connections 2023-11-27T22:30:15.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.869+0000 7fd9b1623640 1 -- 172.21.15.154:0/2419120736 wait complete. 2023-11-27T22:30:15.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.981+0000 7fba3f783640 1 Processor -- start 2023-11-27T22:30:15.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.981+0000 7fba3f783640 1 -- start start 2023-11-27T22:30:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3f783640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba38157a40 0x7fba3806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3f783640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba3806d280 0x7fba3806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3f783640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba3806ba20 0x7fba38161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3f783640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3806beb0 con 0x7fba38157a40 2023-11-27T22:30:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3f783640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3806e150 con 0x7fba3806ba20 2023-11-27T22:30:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3f783640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380ad950 con 0x7fba3806d280 2023-11-27T22:30:15.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba38157a40 0x7fba3806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fba38157a40 0x7fba3806cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44350/0 (socket says 172.21.15.154:44350) 2023-11-27T22:30:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 -- 172.21.15.154:0/786504366 learned_addr learned my addr 172.21.15.154:0/786504366 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3dd20640 1 --2- 172.21.15.154:0/786504366 >> v2:172.21.15.194:3300/0 conn(0x7fba3806ba20 0x7fba38161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3cd1e640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba3806d280 0x7fba3806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 -- 172.21.15.154:0/786504366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba3806d280 msgr2=0x7fba3806b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba3806d280 0x7fba3806b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 -- 172.21.15.154:0/786504366 >> v2:172.21.15.194:3300/0 conn(0x7fba3806ba20 msgr2=0x7fba38161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 --2- 172.21.15.154:0/786504366 >> v2:172.21.15.194:3300/0 conn(0x7fba3806ba20 0x7fba38161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3d51f640 1 -- 172.21.15.154:0/786504366 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380ad640 con 0x7fba38157a40 2023-11-27T22:30:15.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3dd20640 1 --2- 172.21.15.154:0/786504366 >> v2:172.21.15.194:3300/0 conn(0x7fba3806ba20 0x7fba38161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:15.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.982+0000 7fba3cd1e640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba3806d280 0x7fba3806b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:15.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.983+0000 7fba3d51f640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba38157a40 0x7fba3806cd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba3806e7f0 tx=0x7fba3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6eff9bf2e2eff4a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:15.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.983+0000 7fba2bfff640 1 -- 172.21.15.154:0/786504366 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3002ca70 con 0x7fba38157a40 2023-11-27T22:30:15.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.983+0000 7fba2bfff640 1 -- 172.21.15.154:0/786504366 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3002cbd0 con 0x7fba38157a40 2023-11-27T22:30:15.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.983+0000 7fba2bfff640 1 -- 172.21.15.154:0/786504366 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300343f0 con 0x7fba38157a40 2023-11-27T22:30:15.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 -- 172.21.15.154:0/786504366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba38157a40 msgr2=0x7fba3806cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba38157a40 0x7fba3806cd40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fba3806e7f0 tx=0x7fba3002bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 -- 172.21.15.154:0/786504366 shutdown_connections 2023-11-27T22:30:15.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 --2- 172.21.15.154:0/786504366 >> v2:172.21.15.194:3300/0 conn(0x7fba3806ba20 0x7fba38161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba3806d280 0x7fba3806b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 --2- 172.21.15.154:0/786504366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba38157a40 0x7fba3806cd40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:15.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 -- 172.21.15.154:0/786504366 >> 172.21.15.154:0/786504366 conn(0x7fba380b1bc0 msgr2=0x7fba38070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:15.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 -- 172.21.15.154:0/786504366 shutdown_connections 2023-11-27T22:30:15.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.984+0000 7fba3f783640 1 -- 172.21.15.154:0/786504366 wait complete. 2023-11-27T22:30:15.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.985+0000 7fba3f783640 1 Processor -- start 2023-11-27T22:30:15.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.985+0000 7fba3f783640 1 -- start start 2023-11-27T22:30:15.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3f783640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 0x7fba3813e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3f783640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba3806d280 0x7fba381f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3f783640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba38157a40 0x7fba38160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:15.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3f783640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3813e660 con 0x7fba3806ba20 2023-11-27T22:30:15.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3f783640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815fc30 con 0x7fba3806d280 2023-11-27T22:30:15.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3f783640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815ff10 con 0x7fba38157a40 2023-11-27T22:30:15.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 0x7fba3813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 0x7fba3813e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44358/0 (socket says 172.21.15.154:44358) 2023-11-27T22:30:15.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 -- 172.21.15.154:0/1170701802 learned_addr learned my addr 172.21.15.154:0/1170701802 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:15.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3cd1e640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba3806d280 0x7fba381f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3dd20640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba38157a40 0x7fba38160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:15.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 -- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba38157a40 msgr2=0x7fba38160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:15.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba38157a40 0x7fba38160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 -- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba3806d280 msgr2=0x7fba381f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba3806d280 0x7fba381f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.986+0000 7fba3d51f640 1 -- 172.21.15.154:0/1170701802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30009b30 con 0x7fba3806ba20 2023-11-27T22:30:16.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.987+0000 7fba3d51f640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 0x7fba3813e120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba30000f80 tx=0x7fba30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.987+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30009510 con 0x7fba3806ba20 2023-11-27T22:30:16.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.987+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3003e450 con 0x7fba3806ba20 2023-11-27T22:30:16.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.987+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3003e800 con 0x7fba3806ba20 2023-11-27T22:30:16.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.987+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba381601f0 con 0x7fba3806ba20 2023-11-27T22:30:16.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.987+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba381607b0 con 0x7fba3806ba20 2023-11-27T22:30:16.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.988+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba38067420 con 0x7fba3806ba20 2023-11-27T22:30:16.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.988+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fba3003e960 con 0x7fba3806ba20 2023-11-27T22:30:16.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.989+0000 7fba29ffb640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fba1c06b1f0 0x7fba1c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.989+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba300ac380 con 0x7fba3806ba20 2023-11-27T22:30:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.989+0000 7fba3cd1e640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fba1c06b1f0 0x7fba1c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.989+0000 7fba3cd1e640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fba1c06b1f0 0x7fba1c06d6b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba3814f920 tx=0x7fba2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:15.993+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fba300771f0 con 0x7fba3806ba20 2023-11-27T22:30:16.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.157+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba38161ea0 con 0x7fba3806ba20 2023-11-27T22:30:16.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.157+0000 7fba29ffb640 1 -- 172.21.15.154:0/1170701802 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba3007a810 con 0x7fba3806ba20 2023-11-27T22:30:16.160 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fba1c06b1f0 msgr2=0x7fba1c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fba1c06b1f0 0x7fba1c06d6b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba3814f920 tx=0x7fba2c008040 comp rx=0 tx=0).stop 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 msgr2=0x7fba3813e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 0x7fba3813e120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fba30000f80 tx=0x7fba30004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 shutdown_connections 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba3806d280 0x7fba381f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fba1c06b1f0 0x7fba1c06d6b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba38157a40 0x7fba38160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 --2- 172.21.15.154:0/1170701802 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba3806ba20 0x7fba3813e120 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 >> 172.21.15.154:0/1170701802 conn(0x7fba380b1bc0 msgr2=0x7fba380cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:16.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 shutdown_connections 2023-11-27T22:30:16.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.159+0000 7fba3f783640 1 -- 172.21.15.154:0/1170701802 wait complete. 2023-11-27T22:30:16.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.274+0000 7f0a7c41e640 1 Processor -- start 2023-11-27T22:30:16.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.275+0000 7f0a7c41e640 1 -- start start 2023-11-27T22:30:16.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.275+0000 7f0a7c41e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a7415b130 0x7f0a740d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.275+0000 7f0a7c41e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0a7415f760 0x7f0a740cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.275+0000 7f0a7c41e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740cf560 con 0x7f0a740cf150 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.275+0000 7f0a7c41e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7415fd20 con 0x7f0a7415b130 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.275+0000 7f0a7c41e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740d0730 con 0x7f0a7415f760 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a1ba640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a7415b130 0x7f0a740d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a9bb640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0a740cf150 0x7f0a7406ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37936/0 (socket says 172.21.15.154:37936) 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a1ba640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0a7415b130 0x7f0a740d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44368/0 (socket says 172.21.15.154:44368) 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a9bb640 1 -- 172.21.15.154:0/526418581 learned_addr learned my addr 172.21.15.154:0/526418581 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a799b9640 1 --2- 172.21.15.154:0/526418581 >> v2:172.21.15.194:3300/0 conn(0x7f0a7415f760 0x7f0a740cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a1ba640 1 -- 172.21.15.154:0/526418581 >> v2:172.21.15.194:3300/0 conn(0x7f0a7415f760 msgr2=0x7f0a740cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a1ba640 1 --2- 172.21.15.154:0/526418581 >> v2:172.21.15.194:3300/0 conn(0x7f0a7415f760 0x7f0a740cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a1ba640 1 -- 172.21.15.154:0/526418581 >> v1:172.21.15.154:6789/0 conn(0x7f0a740cf150 legacy=0x7f0a7406ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a791b8640 1 -- 172.21.15.154:0/526418581 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541267107 0 0) 0x7f0a740cf560 con 0x7f0a740cf150 2023-11-27T22:30:16.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.276+0000 7f0a7a1ba640 1 -- 172.21.15.154:0/526418581 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740b3f10 con 0x7f0a7415b130 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7a1ba640 1 --2- 172.21.15.154:0/526418581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415b130 0x7f0a740d01f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b71b0 tx=0x7f0a6c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7de33891ab5063 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a791b8640 1 -- 172.21.15.154:0/526418581 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c02cbd0 con 0x7f0a7415b130 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a791b8640 1 -- 172.21.15.154:0/526418581 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c02cd30 con 0x7f0a7415b130 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a791b8640 1 -- 172.21.15.154:0/526418581 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c02cea0 con 0x7f0a7415b130 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 -- 172.21.15.154:0/526418581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415b130 msgr2=0x7f0a740d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/526418581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415b130 0x7f0a740d01f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0a740b71b0 tx=0x7f0a6c02be20 comp rx=0 tx=0).stop 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 -- 172.21.15.154:0/526418581 shutdown_connections 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/526418581 >> v2:172.21.15.194:3300/0 conn(0x7f0a7415f760 0x7f0a740cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.281 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/526418581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415b130 0x7f0a740d01f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 -- 172.21.15.154:0/526418581 >> 172.21.15.154:0/526418581 conn(0x7f0a740b2c10 msgr2=0x7f0a740b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 -- 172.21.15.154:0/526418581 shutdown_connections 2023-11-27T22:30:16.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.277+0000 7f0a7c41e640 1 -- 172.21.15.154:0/526418581 wait complete. 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 Processor -- start 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 -- start start 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a740cf150 0x7f0a740afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a7415b130 0x7f0a741581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 0x7f0a74155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740cadc0 con 0x7f0a7415f760 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740ca1f0 con 0x7f0a7415b130 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7c41e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740ca490 con 0x7f0a740cf150 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7a9bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 0x7f0a74155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7a9bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 0x7f0a74155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44370/0 (socket says 172.21.15.154:44370) 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.279+0000 7f0a7a9bb640 1 -- 172.21.15.154:0/4139237552 learned_addr learned my addr 172.21.15.154:0/4139237552 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7a9bb640 1 -- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a740cf150 msgr2=0x7f0a740afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7a9bb640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a740cf150 0x7f0a740afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7a9bb640 1 -- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a7415b130 msgr2=0x7f0a741581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a799b9640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a7415b130 0x7f0a741581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7a9bb640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a7415b130 0x7f0a741581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7a9bb640 1 -- 172.21.15.154:0/4139237552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c009a70 con 0x7f0a7415f760 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7a9bb640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 0x7f0a74155f00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c450 tx=0x7f0a7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a700074e0 con 0x7f0a7415f760 2023-11-27T22:30:16.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a70007660 con 0x7f0a7415f760 2023-11-27T22:30:16.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a740ca770 con 0x7f0a7415f760 2023-11-27T22:30:16.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70004a20 con 0x7f0a7415f760 2023-11-27T22:30:16.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.280+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a740b0530 con 0x7f0a7415f760 2023-11-27T22:30:16.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.281+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74067fc0 con 0x7f0a7415f760 2023-11-27T22:30:16.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.281+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0a70004b80 con 0x7f0a7415f760 2023-11-27T22:30:16.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.282+0000 7f0a6affd640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0a5806b1f0 0x7f0a5806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.282+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a70088e80 con 0x7f0a7415f760 2023-11-27T22:30:16.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.282+0000 7f0a7a1ba640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0a5806b1f0 0x7f0a5806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.282+0000 7f0a7a1ba640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0a5806b1f0 0x7f0a5806d6b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c036000 tx=0x7f0a6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.289 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.286+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0a70053c70 con 0x7f0a7415f760 2023-11-27T22:30:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.453+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a740caf00 con 0x7f0a7415f760 2023-11-27T22:30:16.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.453+0000 7f0a6affd640 1 -- 172.21.15.154:0/4139237552 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a740caf00 con 0x7f0a7415f760 2023-11-27T22:30:16.456 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:16.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0a5806b1f0 msgr2=0x7f0a5806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.458 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0a5806b1f0 0x7f0a5806d6b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c036000 tx=0x7f0a6c02e000 comp rx=0 tx=0).stop 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 msgr2=0x7f0a74155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 0x7f0a74155f00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000c450 tx=0x7f0a7000c910 comp rx=0 tx=0).stop 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 shutdown_connections 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a7415b130 0x7f0a741581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0a5806b1f0 0x7f0a5806d6b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a7415f760 0x7f0a74155f00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 --2- 172.21.15.154:0/4139237552 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a740cf150 0x7f0a740afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.455+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 >> 172.21.15.154:0/4139237552 conn(0x7f0a740b2c10 msgr2=0x7f0a740b6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.456+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 shutdown_connections 2023-11-27T22:30:16.459 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.456+0000 7f0a7c41e640 1 -- 172.21.15.154:0/4139237552 wait complete. 2023-11-27T22:30:16.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.568+0000 7f925d997640 1 Processor -- start 2023-11-27T22:30:16.571 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.568+0000 7f925d997640 1 -- start start 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.569+0000 7f925d997640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 0x7f925815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.569+0000 7f925d997640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f925806e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.569+0000 7f925d997640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925806db80 con 0x7f92580b2720 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.569+0000 7f925d997640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580b3860 con 0x7f92581543c0 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.569+0000 7f925d997640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925815e830 con 0x7f925806bbf0 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92577fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f925806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f9256ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 0x7f925815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92567fc640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f92580b2720 0x7f925806b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:45202/0 (socket says 172.21.15.154:45202) 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92577fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f925806e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:52770/0 (socket says 172.21.15.154:52770) 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f9256ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 0x7f925815e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:38088/0 (socket says 172.21.15.154:38088) 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92567fc640 1 -- 172.21.15.154:0/1247162212 learned_addr learned my addr 172.21.15.154:0/1247162212 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92577fe640 1 -- 172.21.15.154:0/1247162212 >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 msgr2=0x7f925815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92577fe640 1 --2- 172.21.15.154:0/1247162212 >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 0x7f925815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92577fe640 1 -- 172.21.15.154:0/1247162212 >> v1:172.21.15.194:6789/0 conn(0x7f92580b2720 legacy=0x7f925806b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f92577fe640 1 -- 172.21.15.154:0/1247162212 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92581547a0 con 0x7f925806bbf0 2023-11-27T22:30:16.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.570+0000 7f9256ffd640 1 --2- 172.21.15.154:0/1247162212 >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 0x7f925815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.571+0000 7f92577fe640 1 --2- 172.21.15.154:0/1247162212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f925806e020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92500097a0 tx=0x7f925002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da71be82d9618b6d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.571+0000 7f9255ffb640 1 -- 172.21.15.154:0/1247162212 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925002f050 con 0x7f925806bbf0 2023-11-27T22:30:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.571+0000 7f9255ffb640 1 -- 172.21.15.154:0/1247162212 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250031700 con 0x7f925806bbf0 2023-11-27T22:30:16.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.571+0000 7f9255ffb640 1 -- 172.21.15.154:0/1247162212 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250031a90 con 0x7f925806bbf0 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.571+0000 7f925d997640 1 -- 172.21.15.154:0/1247162212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 msgr2=0x7f925806e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.571+0000 7f925d997640 1 --2- 172.21.15.154:0/1247162212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f925806e020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f92500097a0 tx=0x7f925002b7a0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.572+0000 7f925d997640 1 -- 172.21.15.154:0/1247162212 shutdown_connections 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.572+0000 7f925d997640 1 --2- 172.21.15.154:0/1247162212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f925806e020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.572+0000 7f925d997640 1 --2- 172.21.15.154:0/1247162212 >> v2:172.21.15.194:3300/0 conn(0x7f92581543c0 0x7f925815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.572+0000 7f925d997640 1 -- 172.21.15.154:0/1247162212 >> 172.21.15.154:0/1247162212 conn(0x7f9258070ec0 msgr2=0x7f92580712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.572+0000 7f925d997640 1 -- 172.21.15.154:0/1247162212 shutdown_connections 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.572+0000 7f925d997640 1 -- 172.21.15.154:0/1247162212 wait complete. 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.573+0000 7f925d997640 1 Processor -- start 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.573+0000 7f925d997640 1 -- start start 2023-11-27T22:30:16.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f925d997640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f9258160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f925d997640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92580b2720 0x7f9258152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f925d997640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 0x7f925814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f925d997640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92581e7af0 con 0x7f92581543c0 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f925d997640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92581e7530 con 0x7f92580b2720 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f925d997640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92581e7810 con 0x7f925806bbf0 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 0x7f925814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 0x7f925814a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44372/0 (socket says 172.21.15.154:44372) 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 -- 172.21.15.154:0/584384018 learned_addr learned my addr 172.21.15.154:0/584384018 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:16.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f9256ffd640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f9258160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92567fc640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92580b2720 0x7f9258152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 -- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 msgr2=0x7f9258160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f9258160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 -- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92580b2720 msgr2=0x7f9258152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92580b2720 0x7f9258152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 -- 172.21.15.154:0/584384018 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248009a70 con 0x7f92581543c0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f92577fe640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 0x7f925814a370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f925002b7e0 tx=0x7f92500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.574+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250006e10 con 0x7f92581543c0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.575+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500339b0 con 0x7f92581543c0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.575+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9250009400 con 0x7f92581543c0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.575+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250033d60 con 0x7f92581543c0 2023-11-27T22:30:16.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.575+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925815fef0 con 0x7f92581543c0 2023-11-27T22:30:16.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.575+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9258067420 con 0x7f92581543c0 2023-11-27T22:30:16.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.576+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f925003a050 con 0x7f92581543c0 2023-11-27T22:30:16.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.576+0000 7f923ffff640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f924406b1f0 0x7f924406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.576+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92500ab490 con 0x7f92581543c0 2023-11-27T22:30:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.576+0000 7f9256ffd640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f924406b1f0 0x7f924406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.577+0000 7f9256ffd640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f924406b1f0 0x7f924406d6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9248007560 tx=0x7f924800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.580+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9250076250 con 0x7f92581543c0 2023-11-27T22:30:16.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.761+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92580b3df0 con 0x7f92581543c0 2023-11-27T22:30:16.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.761+0000 7f923ffff640 1 -- 172.21.15.154:0/584384018 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9250079870 con 0x7f92581543c0 2023-11-27T22:30:16.764 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f924406b1f0 msgr2=0x7f924406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f924406b1f0 0x7f924406d6b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9248007560 tx=0x7f924800b040 comp rx=0 tx=0).stop 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 msgr2=0x7f925814a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 0x7f925814a370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f925002b7e0 tx=0x7f92500046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 shutdown_connections 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92580b2720 0x7f9258152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f924406b1f0 0x7f924406d6b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92581543c0 0x7f925814a370 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 --2- 172.21.15.154:0/584384018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f925806bbf0 0x7f9258160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 >> 172.21.15.154:0/584384018 conn(0x7f9258070ec0 msgr2=0x7f92580712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 shutdown_connections 2023-11-27T22:30:16.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.763+0000 7f925d997640 1 -- 172.21.15.154:0/584384018 wait complete. 2023-11-27T22:30:16.776 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:30:16.777 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:16.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:16.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.929+0000 7f2735a4f640 1 Processor -- start 2023-11-27T22:30:16.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.929+0000 7f2735a4f640 1 -- start start 2023-11-27T22:30:16.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f2735a4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f27300cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f2735a4f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273006d580 con 0x7f27300cdd10 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f2735a4f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300d0c40 con 0x7f273015d270 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f2735a4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300ce1a0 con 0x7f27300709c0 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f272f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f27300cdd10 0x7f27300cc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37952/0 (socket says 172.21.15.154:37952) 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f272f7fe640 1 -- 172.21.15.154:0/4123414149 learned_addr learned my addr 172.21.15.154:0/4123414149 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f272e7fc640 1 --2- 172.21.15.154:0/4123414149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f27300cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.930+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630295530 0 0) 0x7f273006d580 con 0x7f27300cdd10 2023-11-27T22:30:16.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2718003520 con 0x7f27300cdd10 2023-11-27T22:30:16.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948925626 0 0) 0x7f27300d0c40 con 0x7f273015d270 2023-11-27T22:30:16.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273006d580 con 0x7f273015d270 2023-11-27T22:30:16.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3860587138 0 0) 0x7f2718003520 con 0x7f27300cdd10 2023-11-27T22:30:16.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272e7fc640 1 -- 172.21.15.154:0/4123414149 >> v1:172.21.15.194:6789/0 conn(0x7f273015d270 legacy=0x7f273006ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272e7fc640 1 -- 172.21.15.154:0/4123414149 >> v1:172.21.15.154:6789/0 conn(0x7f27300cdd10 legacy=0x7f27300cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.931+0000 7f272e7fc640 1 -- 172.21.15.154:0/4123414149 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300ced90 con 0x7f27300709c0 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f272e7fc640 1 --2- 172.21.15.154:0/4123414149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f27300cd7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27240097d0 tx=0x7f272402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b7b5969906932d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728001670 con 0x7f27300709c0 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272402e050 con 0x7f27300709c0 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f272dffb640 1 -- 172.21.15.154:0/4123414149 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724030730 con 0x7f27300709c0 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 -- 172.21.15.154:0/4123414149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 msgr2=0x7f27300cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 --2- 172.21.15.154:0/4123414149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f27300cd7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27240097d0 tx=0x7f272402b770 comp rx=0 tx=0).stop 2023-11-27T22:30:16.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 -- 172.21.15.154:0/4123414149 shutdown_connections 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 --2- 172.21.15.154:0/4123414149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f27300cd7d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 -- 172.21.15.154:0/4123414149 >> 172.21.15.154:0/4123414149 conn(0x7f27300b2c10 msgr2=0x7f27300b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 -- 172.21.15.154:0/4123414149 shutdown_connections 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.932+0000 7f2735a4f640 1 -- 172.21.15.154:0/4123414149 wait complete. 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.933+0000 7f2735a4f640 1 Processor -- start 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 -- start start 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f273014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 0x7f27300c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015d270 0x7f273014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273014f020 con 0x7f27300cdd10 2023-11-27T22:30:16.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273015f1e0 con 0x7f273015d270 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f2735a4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273015e840 con 0x7f27300709c0 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f272e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 0x7f27300c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f272e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 0x7f27300c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44378/0 (socket says 172.21.15.154:44378) 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.934+0000 7f272e7fc640 1 -- 172.21.15.154:0/1093109107 learned_addr learned my addr 172.21.15.154:0/1093109107 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272f7fe640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015d270 0x7f273014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272effd640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f273014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272e7fc640 1 -- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 msgr2=0x7f273014bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272e7fc640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f273014bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272e7fc640 1 -- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015d270 msgr2=0x7f273014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272e7fc640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015d270 0x7f273014b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272e7fc640 1 -- 172.21.15.154:0/1093109107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009400 con 0x7f27300cdd10 2023-11-27T22:30:16.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f272e7fc640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 0x7f27300c7090 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2724000c00 tx=0x7f27240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724004230 con 0x7f27300cdd10 2023-11-27T22:30:16.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273015eb20 con 0x7f27300cdd10 2023-11-27T22:30:16.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27240043b0 con 0x7f27300cdd10 2023-11-27T22:30:16.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724004520 con 0x7f27300cdd10 2023-11-27T22:30:16.941 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.935+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273014c530 con 0x7f27300cdd10 2023-11-27T22:30:16.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.936+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2730067fc0 con 0x7f27300cdd10 2023-11-27T22:30:16.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.937+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2724039040 con 0x7f27300cdd10 2023-11-27T22:30:16.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.937+0000 7f2717fff640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f271c06b1c0 0x7f271c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:16.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.937+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27240aaf50 con 0x7f27300cdd10 2023-11-27T22:30:16.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.937+0000 7f272effd640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f271c06b1c0 0x7f271c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:16.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.938+0000 7f272effd640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f271c06b1c0 0x7f271c06d680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2720001560 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:16.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:16.942+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2724075dd0 con 0x7f27300cdd10 2023-11-27T22:30:17.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.109+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f273015f320 con 0x7f27300cdd10 2023-11-27T22:30:17.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.110+0000 7f2717fff640 1 -- 172.21.15.154:0/1093109107 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7f2724037070 con 0x7f27300cdd10 2023-11-27T22:30:17.113 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:17.113 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f271c06b1c0 msgr2=0x7f271c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f271c06b1c0 0x7f271c06d680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2720001560 tx=0x7f2720009040 comp rx=0 tx=0).stop 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 msgr2=0x7f27300c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 0x7f27300c7090 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2724000c00 tx=0x7f27240046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 shutdown_connections 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f273015d270 0x7f273014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f271c06b1c0 0x7f271c06d680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27300cdd10 0x7f27300c7090 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 --2- 172.21.15.154:0/1093109107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27300709c0 0x7f273014bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 >> 172.21.15.154:0/1093109107 conn(0x7f27300b2c10 msgr2=0x7f27300cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:17.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 shutdown_connections 2023-11-27T22:30:17.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.112+0000 7f2735a4f640 1 -- 172.21.15.154:0/1093109107 wait complete. 2023-11-27T22:30:17.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:17.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:17.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.227+0000 7f5f9589b640 1 Processor -- start 2023-11-27T22:30:17.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.227+0000 7f5f9589b640 1 -- start start 2023-11-27T22:30:17.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f9589b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f90144980 0x7f5f9015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f9589b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f900ceb70 0x7f5f900cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f9589b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f90071770 con 0x7f5f900b4370 2023-11-27T22:30:17.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f9589b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900ccdc0 con 0x7f5f90144980 2023-11-27T22:30:17.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f9589b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f900cd0a0 con 0x7f5f900ceb70 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f8effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f90144980 0x7f5f9015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f8effd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5f90144980 0x7f5f9015c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44380/0 (socket says 172.21.15.154:44380) 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.228+0000 7f5f8effd640 1 -- 172.21.15.154:0/2006753792 learned_addr learned my addr 172.21.15.154:0/2006753792 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.229+0000 7f5f8e7fc640 1 --2- 172.21.15.154:0/2006753792 >> v2:172.21.15.194:3300/0 conn(0x7f5f900ceb70 0x7f5f900cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.229+0000 7f5f8effd640 1 -- 172.21.15.154:0/2006753792 >> v2:172.21.15.194:3300/0 conn(0x7f5f900ceb70 msgr2=0x7f5f900cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.229+0000 7f5f8effd640 1 --2- 172.21.15.154:0/2006753792 >> v2:172.21.15.194:3300/0 conn(0x7f5f900ceb70 0x7f5f900cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.229+0000 7f5f8effd640 1 -- 172.21.15.154:0/2006753792 >> v1:172.21.15.194:6789/0 conn(0x7f5f900b4370 legacy=0x7f5f90071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:17.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.229+0000 7f5f8effd640 1 -- 172.21.15.154:0/2006753792 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f900cd380 con 0x7f5f90144980 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.229+0000 7f5f8effd640 1 --2- 172.21.15.154:0/2006753792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f9015c7c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f9015b600 tx=0x7f5f8002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd76a6a5fb95ed84 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f8dffb640 1 -- 172.21.15.154:0/2006753792 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8002cb20 con 0x7f5f90144980 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f8dffb640 1 -- 172.21.15.154:0/2006753792 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8002cc80 con 0x7f5f90144980 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f8dffb640 1 -- 172.21.15.154:0/2006753792 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800343f0 con 0x7f5f90144980 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 -- 172.21.15.154:0/2006753792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 msgr2=0x7f5f9015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2006753792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f9015c7c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5f9015b600 tx=0x7f5f8002bf80 comp rx=0 tx=0).stop 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 -- 172.21.15.154:0/2006753792 shutdown_connections 2023-11-27T22:30:17.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2006753792 >> v2:172.21.15.194:3300/0 conn(0x7f5f900ceb70 0x7f5f900cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2006753792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f9015c7c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 -- 172.21.15.154:0/2006753792 >> 172.21.15.154:0/2006753792 conn(0x7f5f9006a4d0 msgr2=0x7f5f9006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:17.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 -- 172.21.15.154:0/2006753792 shutdown_connections 2023-11-27T22:30:17.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.230+0000 7f5f9589b640 1 -- 172.21.15.154:0/2006753792 wait complete. 2023-11-27T22:30:17.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.231+0000 7f5f9589b640 1 Processor -- start 2023-11-27T22:30:17.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 -- start start 2023-11-27T22:30:17.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f900b4370 0x7f5f90155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f900ceb70 0x7f5f90132450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f901428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f90133b90 con 0x7f5f90144980 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f901559c0 con 0x7f5f900ceb70 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f9589b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c9610 con 0x7f5f900b4370 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f8f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f901428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f8f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f901428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44392/0 (socket says 172.21.15.154:44392) 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f8f7fe640 1 -- 172.21.15.154:0/2578836215 learned_addr learned my addr 172.21.15.154:0/2578836215 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f8effd640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f900b4370 0x7f5f90155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.232+0000 7f5f8e7fc640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f900ceb70 0x7f5f90132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f8f7fe640 1 -- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f900b4370 msgr2=0x7f5f90155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f8f7fe640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f900b4370 0x7f5f90155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f8f7fe640 1 -- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f900ceb70 msgr2=0x7f5f90132450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f8f7fe640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f900ceb70 0x7f5f90132450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f8f7fe640 1 -- 172.21.15.154:0/2578836215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009b30 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f8f7fe640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f901428a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c400 tx=0x7f5f8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f880052d0 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88005430 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f90132f10 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88003810 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.233+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f901334d0 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.234+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f90133cd0 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.234+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5f88003970 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.235+0000 7f5f77fff640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5f7c06b1f0 0x7f5f7c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.235+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f88088f70 con 0x7f5f90144980 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.235+0000 7f5f8effd640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5f7c06b1f0 0x7f5f7c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.235+0000 7f5f8effd640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5f7c06b1f0 0x7f5f7c06d6b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f80035000 tx=0x7f5f80030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.239+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5f880bbe90 con 0x7f5f90144980 2023-11-27T22:30:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.405+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f90069400 con 0x7f5f90144980 2023-11-27T22:30:17.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.406+0000 7f5f77fff640 1 -- 172.21.15.154:0/2578836215 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f90133cd0 con 0x7f5f90144980 2023-11-27T22:30:17.409 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5f7c06b1f0 msgr2=0x7f5f7c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5f7c06b1f0 0x7f5f7c06d6b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f80035000 tx=0x7f5f80030000 comp rx=0 tx=0).stop 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 msgr2=0x7f5f901428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f901428a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800c400 tx=0x7f5f8800c8c0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 shutdown_connections 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f900ceb70 0x7f5f90132450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5f7c06b1f0 0x7f5f7c06d6b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.411 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5f90144980 0x7f5f901428a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 --2- 172.21.15.154:0/2578836215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f900b4370 0x7f5f90155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 >> 172.21.15.154:0/2578836215 conn(0x7f5f9006a4d0 msgr2=0x7f5f901594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 shutdown_connections 2023-11-27T22:30:17.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.408+0000 7f5f9589b640 1 -- 172.21.15.154:0/2578836215 wait complete. 2023-11-27T22:30:17.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:17.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.523+0000 7fde6ecc2640 1 Processor -- start 2023-11-27T22:30:17.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.523+0000 7fde6ecc2640 1 -- start start 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde6ecc2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde68160fb0 0x7fde68161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde6ecc2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde680d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde6ecc2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde68161d20 con 0x7fde6806ea50 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde6ecc2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6815e760 con 0x7fde68160fb0 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde6ecc2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6815d9a0 con 0x7fde680d0ed0 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde68160fb0 0x7fde68161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde68160fb0 0x7fde68161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44394/0 (socket says 172.21.15.154:44394) 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 -- 172.21.15.154:0/1322422797 learned_addr learned my addr 172.21.15.154:0/1322422797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:17.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde6d25f640 1 --2- 172.21.15.154:0/1322422797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde680d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 -- 172.21.15.154:0/1322422797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 msgr2=0x7fde680d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:17.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 --2- 172.21.15.154:0/1322422797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde680d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 -- 172.21.15.154:0/1322422797 >> v1:172.21.15.194:6789/0 conn(0x7fde6806ea50 legacy=0x7fde6806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.524+0000 7fde67fff640 1 -- 172.21.15.154:0/1322422797 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6815dc80 con 0x7fde68160fb0 2023-11-27T22:30:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.525+0000 7fde67fff640 1 --2- 172.21.15.154:0/1322422797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde68160fb0 0x7fde68161440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde54009870 tx=0x7fde5402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ba24e0bcb043a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.525+0000 7fde677fe640 1 -- 172.21.15.154:0/1322422797 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54030840 con 0x7fde68160fb0 2023-11-27T22:30:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.525+0000 7fde677fe640 1 -- 172.21.15.154:0/1322422797 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde540309a0 con 0x7fde68160fb0 2023-11-27T22:30:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.525+0000 7fde677fe640 1 -- 172.21.15.154:0/1322422797 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54030d30 con 0x7fde68160fb0 2023-11-27T22:30:17.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.525+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1322422797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde68160fb0 msgr2=0x7fde68161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.525+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1322422797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde68160fb0 0x7fde68161440 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fde54009870 tx=0x7fde5402b980 comp rx=0 tx=0).stop 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.526+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1322422797 shutdown_connections 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.526+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1322422797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde680d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.526+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1322422797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde68160fb0 0x7fde68161440 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.526+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1322422797 >> 172.21.15.154:0/1322422797 conn(0x7fde6806a6b0 msgr2=0x7fde6806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.526+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1322422797 shutdown_connections 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.526+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1322422797 wait complete. 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.527+0000 7fde6ecc2640 1 Processor -- start 2023-11-27T22:30:17.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.527+0000 7fde6ecc2640 1 -- start start 2023-11-27T22:30:17.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 0x7fde681567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde681e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde68160fb0 0x7fde680b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde680b3840 con 0x7fde6806ea50 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde681e7ed0 con 0x7fde68160fb0 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde681e81b0 con 0x7fde680d0ed0 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 0x7fde681567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 0x7fde681567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44408/0 (socket says 172.21.15.154:44408) 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 -- 172.21.15.154:0/1680132863 learned_addr learned my addr 172.21.15.154:0/1680132863 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 -- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 msgr2=0x7fde681e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde681e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 -- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde68160fb0 msgr2=0x7fde680b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6d25f640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde68160fb0 0x7fde680b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde68160fb0 0x7fde680b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 -- 172.21.15.154:0/1680132863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540094d0 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ca5e640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 0x7fde681567d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00c3c0 tx=0x7fde5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0052d0 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c005430 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde681e8490 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c007260 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.528+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde681570f0 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.529+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde680b5bd0 con 0x7fde6806ea50 2023-11-27T22:30:17.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.530+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fde5c0073c0 con 0x7fde6806ea50 2023-11-27T22:30:17.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.530+0000 7fde657fa640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde4c06b1c0 0x7fde4c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.530+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde5c088d60 con 0x7fde6806ea50 2023-11-27T22:30:17.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.530+0000 7fde67fff640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde4c06b1c0 0x7fde4c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.531+0000 7fde67fff640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde4c06b1c0 0x7fde4c06d680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde54036000 tx=0x7fde5403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.535+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fde5c053b20 con 0x7fde6806ea50 2023-11-27T22:30:17.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.699+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde68069400 con 0x7fde6806ea50 2023-11-27T22:30:17.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.700+0000 7fde657fa640 1 -- 172.21.15.154:0/1680132863 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde5c057140 con 0x7fde6806ea50 2023-11-27T22:30:17.703 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:17.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde4c06b1c0 msgr2=0x7fde4c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde4c06b1c0 0x7fde4c06d680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde54036000 tx=0x7fde5403b040 comp rx=0 tx=0).stop 2023-11-27T22:30:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 msgr2=0x7fde681567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 0x7fde681567d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00c3c0 tx=0x7fde5c00c880 comp rx=0 tx=0).stop 2023-11-27T22:30:17.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 shutdown_connections 2023-11-27T22:30:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde68160fb0 0x7fde680b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde4c06b1c0 0x7fde4c06d680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde680d0ed0 0x7fde681e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 --2- 172.21.15.154:0/1680132863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde6806ea50 0x7fde681567d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 >> 172.21.15.154:0/1680132863 conn(0x7fde6806a6b0 msgr2=0x7fde6806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 shutdown_connections 2023-11-27T22:30:17.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.702+0000 7fde6ecc2640 1 -- 172.21.15.154:0/1680132863 wait complete. 2023-11-27T22:30:17.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:17.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.817+0000 7f5ed2664640 1 Processor -- start 2023-11-27T22:30:17.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.817+0000 7f5ed2664640 1 -- start start 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed2664640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5ecc15d1d0 0x7f5ecc06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed2664640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5ecc0aeb80 0x7f5ecc06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed2664640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0adae0 con 0x7f5ecc0ad640 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed2664640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0addc0 con 0x7f5ecc0aeb80 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed2664640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0ae0a0 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ecb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5ecc0ad640 0x7f5ecc160ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37960/0 (socket says 172.21.15.154:37960) 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ecb7fe640 1 -- 172.21.15.154:0/820613560 learned_addr learned my addr 172.21.15.154:0/820613560 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed0c01640 1 --2- 172.21.15.154:0/820613560 >> v2:172.21.15.154:3300/0 conn(0x7f5ecc0aeb80 0x7f5ecc06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ecbfff640 1 --2- 172.21.15.154:0/820613560 >> v2:172.21.15.194:3300/0 conn(0x7f5ecc15d1d0 0x7f5ecc06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ecaffd640 1 -- 172.21.15.154:0/820613560 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190440516 0 0) 0x7f5ecc0adae0 con 0x7f5ecc0ad640 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ecaffd640 1 -- 172.21.15.154:0/820613560 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb4003520 con 0x7f5ecc0ad640 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed0c01640 1 -- 172.21.15.154:0/820613560 >> v2:172.21.15.194:3300/0 conn(0x7f5ecc15d1d0 msgr2=0x7f5ecc06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed0c01640 1 --2- 172.21.15.154:0/820613560 >> v2:172.21.15.194:3300/0 conn(0x7f5ecc15d1d0 0x7f5ecc06b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed0c01640 1 -- 172.21.15.154:0/820613560 >> v1:172.21.15.154:6789/0 conn(0x7f5ecc0ad640 legacy=0x7f5ecc160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.818+0000 7f5ed0c01640 1 -- 172.21.15.154:0/820613560 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0ae380 con 0x7f5ecc0aeb80 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.819+0000 7f5ed0c01640 1 --2- 172.21.15.154:0/820613560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc0aeb80 0x7f5ecc06ba20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc072310 tx=0x7f5ec402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923bf2d5f29a1567 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.819+0000 7f5ecaffd640 1 -- 172.21.15.154:0/820613560 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec402cc80 con 0x7f5ecc0aeb80 2023-11-27T22:30:17.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.819+0000 7f5ecaffd640 1 -- 172.21.15.154:0/820613560 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec402cde0 con 0x7f5ecc0aeb80 2023-11-27T22:30:17.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.819+0000 7f5ecaffd640 1 -- 172.21.15.154:0/820613560 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4034660 con 0x7f5ecc0aeb80 2023-11-27T22:30:17.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 -- 172.21.15.154:0/820613560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc0aeb80 msgr2=0x7f5ecc06ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 --2- 172.21.15.154:0/820613560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc0aeb80 0x7f5ecc06ba20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc072310 tx=0x7f5ec402bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 -- 172.21.15.154:0/820613560 shutdown_connections 2023-11-27T22:30:17.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 --2- 172.21.15.154:0/820613560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc0aeb80 0x7f5ecc06ba20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 --2- 172.21.15.154:0/820613560 >> v2:172.21.15.194:3300/0 conn(0x7f5ecc15d1d0 0x7f5ecc06b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 -- 172.21.15.154:0/820613560 >> 172.21.15.154:0/820613560 conn(0x7f5ecc070e70 msgr2=0x7f5ecc071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:17.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 -- 172.21.15.154:0/820613560 shutdown_connections 2023-11-27T22:30:17.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.820+0000 7f5ed2664640 1 -- 172.21.15.154:0/820613560 wait complete. 2023-11-27T22:30:17.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.821+0000 7f5ed2664640 1 Processor -- start 2023-11-27T22:30:17.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.821+0000 7f5ed2664640 1 -- start start 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed2664640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ecc0ad640 0x7f5ecc150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed2664640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ecc0aeb80 0x7f5ecc157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed2664640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 0x7f5ecc15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed2664640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1584a0 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed2664640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc158780 con 0x7f5ecc0ad640 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed2664640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc158a60 con 0x7f5ecc0aeb80 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 0x7f5ecc15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 0x7f5ecc15fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44432/0 (socket says 172.21.15.154:44432) 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 -- 172.21.15.154:0/4011029795 learned_addr learned my addr 172.21.15.154:0/4011029795 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ecb7fe640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ecc0aeb80 0x7f5ecc157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ecbfff640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ecc0ad640 0x7f5ecc150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 -- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ecc0aeb80 msgr2=0x7f5ecc157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ecc0aeb80 0x7f5ecc157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 -- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ecc0ad640 msgr2=0x7f5ecc150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ecc0ad640 0x7f5ecc150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.822+0000 7f5ed0c01640 1 -- 172.21.15.154:0/4011029795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009a70 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.823+0000 7f5ed0c01640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 0x7f5ecc15fba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009e80 tx=0x7f5ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.823+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4040650 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.823+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec40407b0 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.823+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc158d40 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.823+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4040b60 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.823+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc158190 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.824+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc0cd630 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.824+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5ec4040cc0 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.824+0000 7f5ec8ff9640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5eb806b1f0 0x7f5eb806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.825+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ec40ac490 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.825+0000 7f5ecbfff640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5eb806b1f0 0x7f5eb806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.825+0000 7f5ecbfff640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5eb806b1f0 0x7f5eb806d6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc006fd0 tx=0x7f5ebc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:17.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.829+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5ecc0cd630 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.994+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ecc0cda10 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.994+0000 7f5ec8ff9640 1 -- 172.21.15.154:0/4011029795 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ecc0cda10 con 0x7f5ecc15d1d0 2023-11-27T22:30:17.997 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:17.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5eb806b1f0 msgr2=0x7f5eb806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:17.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5eb806b1f0 0x7f5eb806d6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc006fd0 tx=0x7f5ebc008040 comp rx=0 tx=0).stop 2023-11-27T22:30:17.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 msgr2=0x7f5ecc15fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 0x7f5ecc15fba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009e80 tx=0x7f5ec4004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 shutdown_connections 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5eb806b1f0 0x7f5eb806d6b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ecc15d1d0 0x7f5ecc15fba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ecc0aeb80 0x7f5ecc157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 --2- 172.21.15.154:0/4011029795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ecc0ad640 0x7f5ecc150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 >> 172.21.15.154:0/4011029795 conn(0x7f5ecc070e70 msgr2=0x7f5ecc0b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:18.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 shutdown_connections 2023-11-27T22:30:18.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:17.996+0000 7f5ed2664640 1 -- 172.21.15.154:0/4011029795 wait complete. 2023-11-27T22:30:18.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:18.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.108+0000 7f46ca036640 1 Processor -- start 2023-11-27T22:30:18.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.108+0000 7f46ca036640 1 -- start start 2023-11-27T22:30:18.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46ca036640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46c415e730 0x7f46c415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46ca036640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c415e2a0 con 0x7f46c40b1400 2023-11-27T22:30:18.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46ca036640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c415b240 con 0x7f46c4143490 2023-11-27T22:30:18.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46ca036640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c415b520 con 0x7f46c415e730 2023-11-27T22:30:18.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46c3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46c415e730 0x7f46c415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46c2ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f46c40b1400 0x7f46c415a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:37976/0 (socket says 172.21.15.154:37976) 2023-11-27T22:30:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.109+0000 7f46c2ffd640 1 -- 172.21.15.154:0/715300367 learned_addr learned my addr 172.21.15.154:0/715300367 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.110+0000 7f46c3fff640 1 -- 172.21.15.154:0/715300367 >> v1:172.21.15.194:6789/0 conn(0x7f46c4143490 legacy=0x7f46c40b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.110+0000 7f46c3fff640 1 -- 172.21.15.154:0/715300367 >> v1:172.21.15.154:6789/0 conn(0x7f46c40b1400 legacy=0x7f46c415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.110+0000 7f46c27fc640 1 -- 172.21.15.154:0/715300367 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791913040 0 0) 0x7f46c415e2a0 con 0x7f46c40b1400 2023-11-27T22:30:18.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.110+0000 7f46c3fff640 1 -- 172.21.15.154:0/715300367 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c415dc50 con 0x7f46c415e730 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.110+0000 7f46c3fff640 1 --2- 172.21.15.154:0/715300367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c415abf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4741f5a159c3b33a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46c27fc640 1 -- 172.21.15.154:0/715300367 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc02cd00 con 0x7f46c415e730 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46c27fc640 1 -- 172.21.15.154:0/715300367 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc02ce60 con 0x7f46c415e730 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46c27fc640 1 -- 172.21.15.154:0/715300367 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc034660 con 0x7f46c415e730 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 -- 172.21.15.154:0/715300367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 msgr2=0x7f46c415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 --2- 172.21.15.154:0/715300367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c415abf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc02bf50 comp rx=0 tx=0).stop 2023-11-27T22:30:18.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 -- 172.21.15.154:0/715300367 shutdown_connections 2023-11-27T22:30:18.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 --2- 172.21.15.154:0/715300367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c415abf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 -- 172.21.15.154:0/715300367 >> 172.21.15.154:0/715300367 conn(0x7f46c406a4d0 msgr2=0x7f46c406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:18.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 -- 172.21.15.154:0/715300367 shutdown_connections 2023-11-27T22:30:18.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.111+0000 7f46ca036640 1 -- 172.21.15.154:0/715300367 wait complete. 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.112+0000 7f46ca036640 1 Processor -- start 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.112+0000 7f46ca036640 1 -- start start 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46ca036640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c40b1400 0x7f46c4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46ca036640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c4143490 0x7f46c41556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46ca036640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46ca036640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c413ff90 con 0x7f46c415e730 2023-11-27T22:30:18.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46ca036640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c413b170 con 0x7f46c4143490 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46ca036640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c413f9d0 con 0x7f46c40b1400 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46c3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c413efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44446/0 (socket says 172.21.15.154:44446) 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46c3fff640 1 -- 172.21.15.154:0/1540190935 learned_addr learned my addr 172.21.15.154:0/1540190935 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46c2ffd640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c4143490 0x7f46c41556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.113+0000 7f46c37fe640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c40b1400 0x7f46c4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c3fff640 1 -- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c40b1400 msgr2=0x7f46c4151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c3fff640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c40b1400 0x7f46c4151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c3fff640 1 -- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c4143490 msgr2=0x7f46c41556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c3fff640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c4143490 0x7f46c41556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c3fff640 1 -- 172.21.15.154:0/1540190935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc009a70 con 0x7f46c415e730 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c37fe640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c40b1400 0x7f46c4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c2ffd640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c4143490 0x7f46c41556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46c3fff640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c413efa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc003b90 con 0x7f46c415e730 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc003cf0 con 0x7f46c415e730 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c413fcb0 con 0x7f46c415e730 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc004230 con 0x7f46c415e730 2023-11-27T22:30:18.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.114+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4151dd0 con 0x7f46c415e730 2023-11-27T22:30:18.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.115+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c413afd0 con 0x7f46c415e730 2023-11-27T22:30:18.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.115+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f46bc03b050 con 0x7f46c415e730 2023-11-27T22:30:18.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.116+0000 7f46abfff640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f46b006b1c0 0x7f46b006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.116+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46bc0ac420 con 0x7f46c415e730 2023-11-27T22:30:18.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.116+0000 7f46c37fe640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f46b006b1c0 0x7f46b006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.116+0000 7f46c37fe640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f46b006b1c0 0x7f46b006d680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f46b4007fd0 tx=0x7f46b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.120+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f46c413afd0 con 0x7f46c415e730 2023-11-27T22:30:18.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.297+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f46c413b650 con 0x7f46c415e730 2023-11-27T22:30:18.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.298+0000 7f46abfff640 1 -- 172.21.15.154:0/1540190935 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f46c413b650 con 0x7f46c415e730 2023-11-27T22:30:18.300 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:18.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.299+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f46b006b1c0 msgr2=0x7f46b006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.299+0000 7f46ca036640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f46b006b1c0 0x7f46b006d680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f46b4007fd0 tx=0x7f46b4009040 comp rx=0 tx=0).stop 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.299+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 msgr2=0x7f46c413efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.299+0000 7f46ca036640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c413efa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009d90 tx=0x7f46bc004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 shutdown_connections 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46c4143490 0x7f46c41556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f46b006b1c0 0x7f46b006d680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46c415e730 0x7f46c413efa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 --2- 172.21.15.154:0/1540190935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46c40b1400 0x7f46c4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 >> 172.21.15.154:0/1540190935 conn(0x7f46c406a4d0 msgr2=0x7f46c40b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 shutdown_connections 2023-11-27T22:30:18.303 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.300+0000 7f46ca036640 1 -- 172.21.15.154:0/1540190935 wait complete. 2023-11-27T22:30:18.313 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2023-11-27T22:30:18.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:18.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:18.342 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:18.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:30:18.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:18.343 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T22:30:18.431 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:30:18.431 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:18.451 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:30:18.451 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:18.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:18.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.607+0000 7fd08ba96640 1 Processor -- start 2023-11-27T22:30:18.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.607+0000 7fd08ba96640 1 -- start start 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd08ba96640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd0840b1400 0x7fd08415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd08ba96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 0x7fd08415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd08ba96640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08415e2a0 con 0x7fd084143490 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd08ba96640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08415b520 con 0x7fd0840b1400 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd08ba96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd084143870 con 0x7fd08415e730 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd089832640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd084143490 0x7fd0840b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60106/0 (socket says 172.21.15.154:60106) 2023-11-27T22:30:18.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.608+0000 7fd089832640 1 -- 172.21.15.154:0/3067538942 learned_addr learned my addr 172.21.15.154:0/3067538942 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd089031640 1 --2- 172.21.15.154:0/3067538942 >> v2:172.21.15.194:3300/0 conn(0x7fd0840b1400 0x7fd08415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450015603 0 0) 0x7fd08415e2a0 con 0x7fd084143490 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 0x7fd08415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd070003520 con 0x7fd084143490 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1981326609 0 0) 0x7fd070003520 con 0x7fd084143490 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 msgr2=0x7fd08415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:18.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 0x7fd08415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 >> v2:172.21.15.194:3300/0 conn(0x7fd0840b1400 msgr2=0x7fd08415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 --2- 172.21.15.154:0/3067538942 >> v2:172.21.15.194:3300/0 conn(0x7fd0840b1400 0x7fd08415a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08415b240 con 0x7fd084143490 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fd080001670 con 0x7fd084143490 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 >> v1:172.21.15.154:6789/0 conn(0x7fd084143490 legacy=0x7fd0840b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd070003970 0x7fd070003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 0x7fd0700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415b520 con 0x7fd070004d00 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd084143870 con 0x7fd070003970 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07000b980 con 0x7fd08415e730 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd089832640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd070003970 0x7fd070003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd089031640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 0x7fd0700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 -- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 msgr2=0x7fd0700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd08415e730 0x7fd0700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 -- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd070003970 msgr2=0x7fd070003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd070003970 0x7fd070003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.609+0000 7fd08a033640 1 -- 172.21.15.154:0/3067538942 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070003520 con 0x7fd070004d00 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.610+0000 7fd08a033640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd070005180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd07c010350 tx=0x7fd0700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f0935a90f3abf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.610+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c02ee20 con 0x7fd070004d00 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.610+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c011040 con 0x7fd070004d00 2023-11-27T22:30:18.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.610+0000 7fd088830640 1 -- 172.21.15.154:0/3067538942 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c00b310 con 0x7fd070004d00 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08ba96640 1 -- 172.21.15.154:0/3067538942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 msgr2=0x7fd070005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08ba96640 1 --2- 172.21.15.154:0/3067538942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd070005180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd07c010350 tx=0x7fd0700057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08a033640 1 -- 172.21.15.154:0/3067538942 reap_dead start 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08ba96640 1 -- 172.21.15.154:0/3067538942 shutdown_connections 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08ba96640 1 -- 172.21.15.154:0/3067538942 >> 172.21.15.154:0/3067538942 conn(0x7fd08406a4d0 msgr2=0x7fd08406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08ba96640 1 -- 172.21.15.154:0/3067538942 shutdown_connections 2023-11-27T22:30:18.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.611+0000 7fd08ba96640 1 -- 172.21.15.154:0/3067538942 wait complete. 2023-11-27T22:30:18.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.612+0000 7fd08ba96640 1 Processor -- start 2023-11-27T22:30:18.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.612+0000 7fd08ba96640 1 -- start start 2023-11-27T22:30:18.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd084159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0840acfe0 0x7fd0840ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0840ab060 0x7fd0840ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08415a030 con 0x7fd070004d00 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840acd10 con 0x7fd0840acfe0 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0840a9830 con 0x7fd0840ab060 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd084159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd084159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:33990/0 (socket says 172.21.15.154:33990) 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 -- 172.21.15.154:0/2896752250 learned_addr learned my addr 172.21.15.154:0/2896752250 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08a033640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0840ab060 0x7fd0840ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089031640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0840acfe0 0x7fd0840ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 -- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0840ab060 msgr2=0x7fd0840ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0840ab060 0x7fd0840ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 -- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0840acfe0 msgr2=0x7fd0840ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0840acfe0 0x7fd0840ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 -- 172.21.15.154:0/2896752250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840ad980 con 0x7fd070004d00 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089031640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0840acfe0 0x7fd0840ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08a033640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0840ab060 0x7fd0840ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd089832640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd084159af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd080007340 tx=0x7fd080007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000f940 con 0x7fd070004d00 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08000fac0 con 0x7fd070004d00 2023-11-27T22:30:18.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000fe70 con 0x7fd070004d00 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840aba20 con 0x7fd070004d00 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.613+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0840abf50 con 0x7fd070004d00 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.614+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd084069400 con 0x7fd070004d00 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.615+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd08001d460 con 0x7fd070004d00 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.615+0000 7fd07a7fc640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd06806b1f0 0x7fd06806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.615+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd080089c90 con 0x7fd070004d00 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.615+0000 7fd089031640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd06806b1f0 0x7fd06806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.616+0000 7fd089031640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd06806b1f0 0x7fd06806d6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd0840c47e0 tx=0x7fd074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.619+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd080054930 con 0x7fd070004d00 2023-11-27T22:30:18.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.791+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd084070610 con 0x7fd070004d00 2023-11-27T22:30:18.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.792+0000 7fd07a7fc640 1 -- 172.21.15.154:0/2896752250 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16530 (secure 0 0 0) 0x7fd080057f50 con 0x7fd070004d00 2023-11-27T22:30:18.795 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:18.795 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":20,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:29:40.632543+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:18.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd06806b1f0 msgr2=0x7fd06806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd06806b1f0 0x7fd06806d6b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd0840c47e0 tx=0x7fd074008040 comp rx=0 tx=0).stop 2023-11-27T22:30:18.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 msgr2=0x7fd084159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd084159af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd080007340 tx=0x7fd080007800 comp rx=0 tx=0).stop 2023-11-27T22:30:18.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 shutdown_connections 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0840acfe0 0x7fd0840ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd06806b1f0 0x7fd06806d6b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0840ab060 0x7fd0840ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 --2- 172.21.15.154:0/2896752250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd070004d00 0x7fd084159af0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 >> 172.21.15.154:0/2896752250 conn(0x7fd08406a4d0 msgr2=0x7fd0840b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 shutdown_connections 2023-11-27T22:30:18.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.794+0000 7fd08ba96640 1 -- 172.21.15.154:0/2896752250 wait complete. 2023-11-27T22:30:18.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:18.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:18.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.910+0000 7f1084ba0640 1 Processor -- start 2023-11-27T22:30:18.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.910+0000 7f1084ba0640 1 -- start start 2023-11-27T22:30:18.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.910+0000 7f1084ba0640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f10800d0d50 0x7f10800d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.910+0000 7f1084ba0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10800cdee0 0x7f1080167e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.910+0000 7f1084ba0640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800af730 con 0x7f10800d1130 2023-11-27T22:30:18.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f1084ba0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800cf1f0 con 0x7f10800cdee0 2023-11-27T22:30:18.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f1084ba0640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800afbc0 con 0x7f10800d0d50 2023-11-27T22:30:18.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10800cdee0 0x7f1080167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107effd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f10800d1130 0x7f10800cd7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60120/0 (socket says 172.21.15.154:60120) 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f10800cdee0 0x7f1080167e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34000/0 (socket says 172.21.15.154:34000) 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107effd640 1 -- 172.21.15.154:0/3448699463 learned_addr learned my addr 172.21.15.154:0/3448699463 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107f7fe640 1 --2- 172.21.15.154:0/3448699463 >> v2:172.21.15.194:3300/0 conn(0x7f10800d0d50 0x7f10800d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107ffff640 1 -- 172.21.15.154:0/3448699463 >> v2:172.21.15.194:3300/0 conn(0x7f10800d0d50 msgr2=0x7f10800d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107ffff640 1 --2- 172.21.15.154:0/3448699463 >> v2:172.21.15.194:3300/0 conn(0x7f10800d0d50 0x7f10800d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107ffff640 1 -- 172.21.15.154:0/3448699463 >> v1:172.21.15.154:6789/0 conn(0x7f10800d1130 legacy=0x7f10800cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107e7fc640 1 -- 172.21.15.154:0/3448699463 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172104245 0 0) 0x7f10800af730 con 0x7f10800d1130 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.911+0000 7f107ffff640 1 -- 172.21.15.154:0/3448699463 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800d0af0 con 0x7f10800cdee0 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f107ffff640 1 --2- 172.21.15.154:0/3448699463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800cdee0 0x7f1080167e60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f108006dd50 tx=0x7f107802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affde7ba4cfc2d20 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f107e7fc640 1 -- 172.21.15.154:0/3448699463 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107802cc60 con 0x7f10800cdee0 2023-11-27T22:30:18.916 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f107e7fc640 1 -- 172.21.15.154:0/3448699463 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107802cdc0 con 0x7f10800cdee0 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f107e7fc640 1 -- 172.21.15.154:0/3448699463 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078034660 con 0x7f10800cdee0 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 -- 172.21.15.154:0/3448699463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800cdee0 msgr2=0x7f1080167e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 --2- 172.21.15.154:0/3448699463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800cdee0 0x7f1080167e60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f108006dd50 tx=0x7f107802beb0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 -- 172.21.15.154:0/3448699463 shutdown_connections 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 --2- 172.21.15.154:0/3448699463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800cdee0 0x7f1080167e60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 --2- 172.21.15.154:0/3448699463 >> v2:172.21.15.194:3300/0 conn(0x7f10800d0d50 0x7f10800d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 -- 172.21.15.154:0/3448699463 >> 172.21.15.154:0/3448699463 conn(0x7f10800b64b0 msgr2=0x7f1080099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 -- 172.21.15.154:0/3448699463 shutdown_connections 2023-11-27T22:30:18.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.912+0000 7f1084ba0640 1 -- 172.21.15.154:0/3448699463 wait complete. 2023-11-27T22:30:18.919 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 Processor -- start 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 -- start start 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10800cdee0 0x7f108009bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 0x7f108015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10800d1130 0x7f108015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108015ec70 con 0x7f10800d0d50 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108009c470 con 0x7f10800d1130 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.914+0000 7f1084ba0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108015e990 con 0x7f10800cdee0 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 0x7f108015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 0x7f108015bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34010/0 (socket says 172.21.15.154:34010) 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 -- 172.21.15.154:0/2790832097 learned_addr learned my addr 172.21.15.154:0/2790832097 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:18.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107ffff640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10800d1130 0x7f108015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107f7fe640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10800cdee0 0x7f108009bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 -- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10800cdee0 msgr2=0x7f108009bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10800cdee0 0x7f108009bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 -- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10800d1130 msgr2=0x7f108015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10800d1130 0x7f108015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 -- 172.21.15.154:0/2790832097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078009a70 con 0x7f10800d0d50 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107ffff640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10800d1130 0x7f108015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f107effd640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 0x7f108015bed0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f107400c430 tx=0x7f107400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740074e0 con 0x7f10800d0d50 2023-11-27T22:30:18.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1074007660 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10800ca290 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074004a20 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.915+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10800ca850 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.916+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10800ca0f0 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.917+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1074004b80 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.917+0000 7f1067fff640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f106c06b1c0 0x7f106c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.917+0000 7f107f7fe640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f106c06b1c0 0x7f106c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.917+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10740898b0 con 0x7f10800d0d50 2023-11-27T22:30:18.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.918+0000 7f107f7fe640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f106c06b1c0 0x7f106c06d680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1070006fd0 tx=0x7f1070008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:18.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:18.921+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f10800ca0f0 con 0x7f10800d0d50 2023-11-27T22:30:19.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.090+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10800ca0f0 con 0x7f10800d0d50 2023-11-27T22:30:19.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.090+0000 7f1067fff640 1 -- 172.21.15.154:0/2790832097 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10800ca0f0 con 0x7f10800d0d50 2023-11-27T22:30:19.093 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f106c06b1c0 msgr2=0x7f106c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f106c06b1c0 0x7f106c06d680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1070006fd0 tx=0x7f1070008040 comp rx=0 tx=0).stop 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 msgr2=0x7f108015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 0x7f108015bed0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f107400c430 tx=0x7f107400c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 shutdown_connections 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10800d1130 0x7f108015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f106c06b1c0 0x7f106c06d680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10800d0d50 0x7f108015bed0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 --2- 172.21.15.154:0/2790832097 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10800cdee0 0x7f108009bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 >> 172.21.15.154:0/2790832097 conn(0x7f10800b64b0 msgr2=0x7f10800cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 shutdown_connections 2023-11-27T22:30:19.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.092+0000 7f1084ba0640 1 -- 172.21.15.154:0/2790832097 wait complete. 2023-11-27T22:30:19.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.206+0000 7f960e2d3640 1 Processor -- start 2023-11-27T22:30:19.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.207+0000 7f960e2d3640 1 -- start start 2023-11-27T22:30:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.207+0000 7f960e2d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f96080b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.207+0000 7f960e2d3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960815e2a0 con 0x7f960815e730 2023-11-27T22:30:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.207+0000 7f960e2d3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960815b240 con 0x7f960815abf0 2023-11-27T22:30:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.207+0000 7f960e2d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960815b520 con 0x7f9608143490 2023-11-27T22:30:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f96077fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f960815e730 0x7f960815a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60126/0 (socket says 172.21.15.154:60126) 2023-11-27T22:30:19.213 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f96077fe640 1 -- 172.21.15.154:0/2271214114 learned_addr learned my addr 172.21.15.154:0/2271214114 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:19.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624053267 0 0) 0x7f960815e2a0 con 0x7f960815e730 2023-11-27T22:30:19.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f0003520 con 0x7f960815e730 2023-11-27T22:30:19.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9607fff640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f96080b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1311034809 0 0) 0x7f95f0003520 con 0x7f960815e730 2023-11-27T22:30:19.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 msgr2=0x7f96080b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f96080b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 >> v1:172.21.15.194:6789/0 conn(0x7f960815abf0 legacy=0x7f96080b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960815dc50 con 0x7f960815e730 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f95fc001670 con 0x7f960815e730 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 >> v1:172.21.15.154:6789/0 conn(0x7f960815e730 legacy=0x7f960815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f95f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960815b520 con 0x7f95f00039a0 2023-11-27T22:30:19.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f000dc40 con 0x7f95f00047c0 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f000de00 con 0x7f9608143490 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f9607fff640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f96077fe640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.208+0000 7f960c870640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f95f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9607fff640 1 -- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 msgr2=0x7f95f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9607fff640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f95f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9607fff640 1 -- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f00047c0 msgr2=0x7f95f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9607fff640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9607fff640 1 -- 172.21.15.154:0/2271214114 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0003520 con 0x7f95f00039a0 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f960c870640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9608143490 0x7f95f0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:19.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9607fff640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009a90 tx=0x7f95f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee972e42547edfa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f802c680 con 0x7f95f00039a0 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f802c7e0 con 0x7f95f00039a0 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.209+0000 7f9606ffd640 1 -- 172.21.15.154:0/2271214114 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f802cb70 con 0x7f95f00039a0 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960e2d3640 1 -- 172.21.15.154:0/2271214114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95f00039a0 msgr2=0x7f95f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960e2d3640 1 --2- 172.21.15.154:0/2271214114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009a90 tx=0x7f95f00057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960c870640 1 -- 172.21.15.154:0/2271214114 reap_dead start 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960e2d3640 1 -- 172.21.15.154:0/2271214114 shutdown_connections 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960e2d3640 1 -- 172.21.15.154:0/2271214114 >> 172.21.15.154:0/2271214114 conn(0x7f960806a4d0 msgr2=0x7f960806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960e2d3640 1 -- 172.21.15.154:0/2271214114 shutdown_connections 2023-11-27T22:30:19.218 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.210+0000 7f960e2d3640 1 -- 172.21.15.154:0/2271214114 wait complete. 2023-11-27T22:30:19.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.211+0000 7f960e2d3640 1 Processor -- start 2023-11-27T22:30:19.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.211+0000 7f960e2d3640 1 -- start start 2023-11-27T22:30:19.221 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960e2d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f00039a0 0x7f96080aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960e2d3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080aabd0 0x7f96081327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960e2d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 0x7f96081422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960e2d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96080aa780 con 0x7f960812f470 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960e2d3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9608132d10 con 0x7f96080aabd0 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960e2d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960812fe40 con 0x7f95f00039a0 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 0x7f96081422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 0x7f96081422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34028/0 (socket says 172.21.15.154:34028) 2023-11-27T22:30:19.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 -- 172.21.15.154:0/414293178 learned_addr learned my addr 172.21.15.154:0/414293178 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:19.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f96077fe640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080aabd0 0x7f96081327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f9607fff640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f00039a0 0x7f96080aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 -- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f00039a0 msgr2=0x7f96080aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f00039a0 0x7f96080aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 -- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080aabd0 msgr2=0x7f96081327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080aabd0 0x7f96081327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.212+0000 7f960c870640 1 -- 172.21.15.154:0/414293178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608130120 con 0x7f960812f470 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.213+0000 7f960c870640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 0x7f96081422c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9600000f80 tx=0x7f960000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.213+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600017070 con 0x7f960812f470 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.213+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600003b80 con 0x7f960812f470 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.213+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9608130400 con 0x7f960812f470 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.213+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600003d30 con 0x7f960812f470 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.213+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960812f900 con 0x7f960812f470 2023-11-27T22:30:19.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.214+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9608130920 con 0x7f960812f470 2023-11-27T22:30:19.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.214+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f96000050d0 con 0x7f960812f470 2023-11-27T22:30:19.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.215+0000 7f9604ff9640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f95f406b1f0 0x7f95f406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.215+0000 7f9607fff640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f95f406b1f0 0x7f95f406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.215+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9600088dc0 con 0x7f960812f470 2023-11-27T22:30:19.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.215+0000 7f9607fff640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f95f406b1f0 0x7f95f406d6b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95f8036000 tx=0x7f95f8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.219+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9608130920 con 0x7f960812f470 2023-11-27T22:30:19.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.385+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9608130920 con 0x7f960812f470 2023-11-27T22:30:19.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.385+0000 7f9604ff9640 1 -- 172.21.15.154:0/414293178 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9608130920 con 0x7f960812f470 2023-11-27T22:30:19.388 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f95f406b1f0 msgr2=0x7f95f406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f95f406b1f0 0x7f95f406d6b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95f8036000 tx=0x7f95f8030000 comp rx=0 tx=0).stop 2023-11-27T22:30:19.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 msgr2=0x7f96081422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 0x7f96081422c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9600000f80 tx=0x7f960000ead0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 shutdown_connections 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080aabd0 0x7f96081327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f95f406b1f0 0x7f95f406d6b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f960812f470 0x7f96081422c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 --2- 172.21.15.154:0/414293178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f00039a0 0x7f96080aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 >> 172.21.15.154:0/414293178 conn(0x7f960806a4d0 msgr2=0x7f960806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 shutdown_connections 2023-11-27T22:30:19.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.387+0000 7f960e2d3640 1 -- 172.21.15.154:0/414293178 wait complete. 2023-11-27T22:30:19.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:19.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.503+0000 7efdaf91d640 1 Processor -- start 2023-11-27T22:30:19.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.504+0000 7efdaf91d640 1 -- start start 2023-11-27T22:30:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.504+0000 7efdaf91d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efda80d3900 0x7efda80b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.504+0000 7efdaf91d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80b2b10 con 0x7efda80d2910 2023-11-27T22:30:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.504+0000 7efdaf91d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80d1590 con 0x7efda815d330 2023-11-27T22:30:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.504+0000 7efdaf91d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda80d1870 con 0x7efda80d3900 2023-11-27T22:30:19.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdaceb8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efda80d2910 0x7efda80d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60140/0 (socket says 172.21.15.154:60140) 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdaceb8640 1 -- 172.21.15.154:0/935901247 learned_addr learned my addr 172.21.15.154:0/935901247 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdadeba640 1 --2- 172.21.15.154:0/935901247 >> v2:172.21.15.194:3300/0 conn(0x7efda80d3900 0x7efda80b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899912519 0 0) 0x7efda80b2b10 con 0x7efda80d2910 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd94003520 con 0x7efda80d2910 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338537993 0 0) 0x7efd94003520 con 0x7efda80d2910 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 >> v2:172.21.15.194:3300/0 conn(0x7efda80d3900 msgr2=0x7efda80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 --2- 172.21.15.154:0/935901247 >> v2:172.21.15.194:3300/0 conn(0x7efda80d3900 0x7efda80b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 >> v1:172.21.15.194:6789/0 conn(0x7efda815d330 legacy=0x7efda80b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80d1b50 con 0x7efda80d2910 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7efda4001670 con 0x7efda80d2910 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdadeba640 1 --2- 172.21.15.154:0/935901247 >> v2:172.21.15.194:3300/0 conn(0x7efda80d3900 0x7efda80b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:19.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 >> v1:172.21.15.154:6789/0 conn(0x7efda80d2910 legacy=0x7efda80d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94003970 0x7efd94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940047c0 0x7efd94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd94005180 0x7efd9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80d1870 con 0x7efd94005180 2023-11-27T22:30:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400c120 con 0x7efd940047c0 2023-11-27T22:30:19.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400c2e0 con 0x7efd94003970 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdadeba640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd94005180 0x7efd9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdad6b9640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94003970 0x7efd94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.505+0000 7efdaceb8640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940047c0 0x7efd94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 -- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94003970 msgr2=0x7efd94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94003970 0x7efd94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 -- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940047c0 msgr2=0x7efd94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940047c0 0x7efd94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 -- 172.21.15.154:0/935901247 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94003520 con 0x7efd94005180 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 -- 172.21.15.154:0/935901247 reap_dead start 2023-11-27T22:30:19.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.506+0000 7efdadeba640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd94005180 0x7efd9400b980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efda000e320 tx=0x7efd940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715f2da1f9ded35d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda002cde0 con 0x7efd94005180 2023-11-27T22:30:19.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda000f040 con 0x7efd94005180 2023-11-27T22:30:19.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efd9ffff640 1 -- 172.21.15.154:0/935901247 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0003bd0 con 0x7efd94005180 2023-11-27T22:30:19.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 -- 172.21.15.154:0/935901247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd94005180 msgr2=0x7efd9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd94005180 0x7efd9400b980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efda000e320 tx=0x7efd940057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 -- 172.21.15.154:0/935901247 shutdown_connections 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 --2- 172.21.15.154:0/935901247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd94005180 0x7efd9400b980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 -- 172.21.15.154:0/935901247 >> 172.21.15.154:0/935901247 conn(0x7efda8072020 msgr2=0x7efda8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 -- 172.21.15.154:0/935901247 shutdown_connections 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.507+0000 7efdaf91d640 1 -- 172.21.15.154:0/935901247 wait complete. 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.508+0000 7efdaf91d640 1 Processor -- start 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.508+0000 7efdaf91d640 1 -- start start 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaf91d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94005180 0x7efda8155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaf91d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 0x7efda80c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaf91d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda815fd50 0x7efda81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaf91d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda814cf40 con 0x7efda8156520 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaf91d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda80c8e20 con 0x7efda815fd50 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaf91d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda815e9d0 con 0x7efd94005180 2023-11-27T22:30:19.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 0x7efda80c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 0x7efda80c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34036/0 (socket says 172.21.15.154:34036) 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 -- 172.21.15.154:0/1559320419 learned_addr learned my addr 172.21.15.154:0/1559320419 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdad6b9640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94005180 0x7efda8155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdadeba640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda815fd50 0x7efda81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 -- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94005180 msgr2=0x7efda8155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94005180 0x7efda8155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 -- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda815fd50 msgr2=0x7efda81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda815fd50 0x7efda81534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdaceb8640 1 -- 172.21.15.154:0/1559320419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda815ecb0 con 0x7efda8156520 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdadeba640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda815fd50 0x7efda81534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.509+0000 7efdad6b9640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94005180 0x7efda8155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.510+0000 7efdaceb8640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 0x7efda80c88e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efda4007290 tx=0x7efda4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.510+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4004ea0 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.510+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda400f9c0 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.510+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda400fd90 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.510+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda815ef90 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.510+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda815f550 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.511+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8069400 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.511+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efda401d460 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.512+0000 7efd9dffb640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd8c06b1c0 0x7efd8c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.512+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efda4089b60 con 0x7efda8156520 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.512+0000 7efdad6b9640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd8c06b1c0 0x7efd8c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.512+0000 7efdad6b9640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd8c06b1c0 0x7efd8c06d680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd98000c00 tx=0x7efd98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.516+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efda4054890 con 0x7efda8156520 2023-11-27T22:30:19.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.686+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efda80b23a0 con 0x7efda8156520 2023-11-27T22:30:19.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.686+0000 7efd9dffb640 1 -- 172.21.15.154:0/1559320419 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7efda4057eb0 con 0x7efda8156520 2023-11-27T22:30:19.689 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:19.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd8c06b1c0 msgr2=0x7efd8c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd8c06b1c0 0x7efd8c06d680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efd98000c00 tx=0x7efd98009040 comp rx=0 tx=0).stop 2023-11-27T22:30:19.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 msgr2=0x7efda80c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 0x7efda80c88e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efda4007290 tx=0x7efda4007750 comp rx=0 tx=0).stop 2023-11-27T22:30:19.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 shutdown_connections 2023-11-27T22:30:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efda815fd50 0x7efda81534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd8c06b1c0 0x7efd8c06d680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efda8156520 0x7efda80c88e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 --2- 172.21.15.154:0/1559320419 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd94005180 0x7efda8155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 >> 172.21.15.154:0/1559320419 conn(0x7efda8072020 msgr2=0x7efda80b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 shutdown_connections 2023-11-27T22:30:19.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.688+0000 7efdaf91d640 1 -- 172.21.15.154:0/1559320419 wait complete. 2023-11-27T22:30:19.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:19.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.806+0000 7f8c3dd97640 1 Processor -- start 2023-11-27T22:30:19.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.806+0000 7f8c3dd97640 1 -- start start 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c3dd97640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c3815c2f0 0x7f8c3806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c3dd97640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3815ba40 con 0x7f8c38140f10 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c3dd97640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3806f4a0 con 0x7f8c3806f040 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c3dd97640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3815c6d0 con 0x7f8c3815c2f0 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c377fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c3815c2f0 0x7f8c3806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c37fff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8c38140f10 0x7f8c3813f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60152/0 (socket says 172.21.15.154:60152) 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c37fff640 1 -- 172.21.15.154:0/2497266653 learned_addr learned my addr 172.21.15.154:0/2497266653 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c377fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8c3815c2f0 0x7f8c3806eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34044/0 (socket says 172.21.15.154:34044) 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c377fe640 1 -- 172.21.15.154:0/2497266653 >> v1:172.21.15.194:6789/0 conn(0x7f8c3806f040 legacy=0x7f8c38140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c377fe640 1 -- 172.21.15.154:0/2497266653 >> v1:172.21.15.154:6789/0 conn(0x7f8c38140f10 legacy=0x7f8c3813f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c377fe640 1 -- 172.21.15.154:0/2497266653 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c381416e0 con 0x7f8c3815c2f0 2023-11-27T22:30:19.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.807+0000 7f8c36ffd640 1 -- 172.21.15.154:0/2497266653 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688201991 0 0) 0x7f8c3815ba40 con 0x7f8c38140f10 2023-11-27T22:30:19.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.808+0000 7f8c377fe640 1 --2- 172.21.15.154:0/2497266653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c3806eb00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097a0 tx=0x7f8c2802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f77a20550b56c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.808+0000 7f8c36ffd640 1 -- 172.21.15.154:0/2497266653 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28031830 con 0x7f8c3815c2f0 2023-11-27T22:30:19.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.808+0000 7f8c36ffd640 1 -- 172.21.15.154:0/2497266653 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28031990 con 0x7f8c3815c2f0 2023-11-27T22:30:19.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.808+0000 7f8c36ffd640 1 -- 172.21.15.154:0/2497266653 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28031d20 con 0x7f8c3815c2f0 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 -- 172.21.15.154:0/2497266653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 msgr2=0x7f8c3806eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/2497266653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c3806eb00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097a0 tx=0x7f8c2802b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 -- 172.21.15.154:0/2497266653 shutdown_connections 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/2497266653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c3806eb00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 -- 172.21.15.154:0/2497266653 >> 172.21.15.154:0/2497266653 conn(0x7f8c3806a6b0 msgr2=0x7f8c3806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 -- 172.21.15.154:0/2497266653 shutdown_connections 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.809+0000 7f8c3dd97640 1 -- 172.21.15.154:0/2497266653 wait complete. 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.810+0000 7f8c3dd97640 1 Processor -- start 2023-11-27T22:30:19.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.810+0000 7f8c3dd97640 1 -- start start 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c3dd97640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c3806f040 0x7f8c38136db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c3dd97640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c38140f10 0x7f8c38151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c3dd97640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c38154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c3dd97640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381372f0 con 0x7f8c3815c2f0 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c3dd97640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38151890 con 0x7f8c38140f10 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c3dd97640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38136010 con 0x7f8c3806f040 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c38154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c38154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34046/0 (socket says 172.21.15.154:34046) 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 -- 172.21.15.154:0/3511820166 learned_addr learned my addr 172.21.15.154:0/3511820166 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c2effd640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c38140f10 0x7f8c38151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c377fe640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c3806f040 0x7f8c38136db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 -- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c3806f040 msgr2=0x7f8c38136db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c3806f040 0x7f8c38136db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 -- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c38140f10 msgr2=0x7f8c38151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c38140f10 0x7f8c38151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 -- 172.21.15.154:0/3511820166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009400 con 0x7f8c3815c2f0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c377fe640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c3806f040 0x7f8c38136db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c2effd640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c38140f10 0x7f8c38151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.811+0000 7f8c37fff640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c38154ed0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8c30002230 tx=0x7f8c3000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.812+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000ce30 con 0x7f8c3815c2f0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.812+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000a640 con 0x7f8c3815c2f0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.812+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c381362d0 con 0x7f8c3815c2f0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.812+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000a9f0 con 0x7f8c3815c2f0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.812+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c38136890 con 0x7f8c3815c2f0 2023-11-27T22:30:19.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.812+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3815e330 con 0x7f8c3815c2f0 2023-11-27T22:30:19.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.813+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8c3000ab50 con 0x7f8c3815c2f0 2023-11-27T22:30:19.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.813+0000 7f8c34ff9640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8c1806b1c0 0x7f8c1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:19.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.813+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f8c30089260 con 0x7f8c3815c2f0 2023-11-27T22:30:19.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.813+0000 7f8c377fe640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8c1806b1c0 0x7f8c1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:19.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.814+0000 7f8c377fe640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8c1806b1c0 0x7f8c1806d680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c28036000 tx=0x7f8c28008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:19.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:19.818+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8c30053e80 con 0x7f8c3815c2f0 2023-11-27T22:30:20.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.000+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8c38070640 con 0x7f8c3815c2f0 2023-11-27T22:30:20.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.000+0000 7f8c34ff9640 1 -- 172.21.15.154:0/3511820166 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8c300574a0 con 0x7f8c3815c2f0 2023-11-27T22:30:20.003 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8c1806b1c0 msgr2=0x7f8c1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8c1806b1c0 0x7f8c1806d680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c28036000 tx=0x7f8c28008030 comp rx=0 tx=0).stop 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 msgr2=0x7f8c38154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c38154ed0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8c30002230 tx=0x7f8c3000cbe0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 shutdown_connections 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c38140f10 0x7f8c38151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8c1806b1c0 0x7f8c1806d680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c3815c2f0 0x7f8c38154ed0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 --2- 172.21.15.154:0/3511820166 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8c3806f040 0x7f8c38136db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 >> 172.21.15.154:0/3511820166 conn(0x7f8c3806a6b0 msgr2=0x7f8c380b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 shutdown_connections 2023-11-27T22:30:20.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.003+0000 7f8c3dd97640 1 -- 172.21.15.154:0/3511820166 wait complete. 2023-11-27T22:30:20.016 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:30:20.016 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:20.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:20.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.136+0000 7efd64a01640 1 Processor -- start 2023-11-27T22:30:20.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd64a01640 1 -- start start 2023-11-27T22:30:20.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd64a01640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd6006c700 0x7efd600cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd64a01640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600d0b30 con 0x7efd600cded0 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd64a01640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600d0220 con 0x7efd6006b7f0 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd64a01640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600d0500 con 0x7efd6006c700 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd5ed9d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efd600cded0 0x7efd6006bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60156/0 (socket says 172.21.15.154:60156) 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.137+0000 7efd5ed9d640 1 -- 172.21.15.154:0/3579425984 learned_addr learned my addr 172.21.15.154:0/3579425984 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd57fff640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd6006c700 0x7efd600cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354538084 0 0) 0x7efd600d0b30 con 0x7efd600cded0 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd4c003520 con 0x7efd600cded0 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2989205629 0 0) 0x7efd4c003520 con 0x7efd600cded0 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd6006c700 msgr2=0x7efd600cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd6006c700 0x7efd600cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 >> v1:172.21.15.194:6789/0 conn(0x7efd6006b7f0 legacy=0x7efd6015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600b0420 con 0x7efd600cded0 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7efd50001670 con 0x7efd600cded0 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 >> v1:172.21.15.154:6789/0 conn(0x7efd600cded0 legacy=0x7efd6006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c0039a0 0x7efd4c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0047c0 0x7efd4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd4c005180 0x7efd4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c00c050 con 0x7efd4c0039a0 2023-11-27T22:30:20.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c00c190 con 0x7efd4c005180 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c00c350 con 0x7efd4c0047c0 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd57fff640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd6006c700 0x7efd600cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c0039a0 0x7efd4c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5f59e640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd4c005180 0x7efd4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd57fff640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0047c0 0x7efd4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5ed9d640 1 -- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0047c0 msgr2=0x7efd4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0047c0 0x7efd4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5ed9d640 1 -- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd4c005180 msgr2=0x7efd4c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.138+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd4c005180 0x7efd4c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.139+0000 7efd5ed9d640 1 -- 172.21.15.154:0/3579425984 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c003520 con 0x7efd4c0039a0 2023-11-27T22:30:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.139+0000 7efd57fff640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0047c0 0x7efd4c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:20.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.139+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c0039a0 0x7efd4c003dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c240 tx=0x7efd4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5e0c8abf9c2479 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.139+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50005ad0 con 0x7efd4c0039a0 2023-11-27T22:30:20.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.139+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50005c30 con 0x7efd4c0039a0 2023-11-27T22:30:20.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.139+0000 7efd5e59c640 1 -- 172.21.15.154:0/3579425984 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5002c8b0 con 0x7efd4c0039a0 2023-11-27T22:30:20.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd64a01640 1 -- 172.21.15.154:0/3579425984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c0039a0 msgr2=0x7efd4c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd64a01640 1 --2- 172.21.15.154:0/3579425984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd4c0039a0 0x7efd4c003dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c240 tx=0x7efd4c0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd5f59e640 1 -- 172.21.15.154:0/3579425984 reap_dead start 2023-11-27T22:30:20.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd64a01640 1 -- 172.21.15.154:0/3579425984 shutdown_connections 2023-11-27T22:30:20.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd64a01640 1 -- 172.21.15.154:0/3579425984 >> 172.21.15.154:0/3579425984 conn(0x7efd600d0d50 msgr2=0x7efd600d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd64a01640 1 -- 172.21.15.154:0/3579425984 shutdown_connections 2023-11-27T22:30:20.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.140+0000 7efd64a01640 1 -- 172.21.15.154:0/3579425984 wait complete. 2023-11-27T22:30:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.141+0000 7efd64a01640 1 Processor -- start 2023-11-27T22:30:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.141+0000 7efd64a01640 1 -- start start 2023-11-27T22:30:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd64a01640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0039a0 0x7efd601f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd64a01640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd600af220 0x7efd600af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd64a01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 0x7efd600c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd64a01640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600afbe0 con 0x7efd600c62e0 2023-11-27T22:30:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd64a01640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd600c7870 con 0x7efd600af220 2023-11-27T22:30:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd64a01640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600c6fd0 con 0x7efd4c0039a0 2023-11-27T22:30:20.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 0x7efd600c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 0x7efd600c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34054/0 (socket says 172.21.15.154:34054) 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 -- 172.21.15.154:0/3964963448 learned_addr learned my addr 172.21.15.154:0/3964963448 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd57fff640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd600af220 0x7efd600af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0039a0 0x7efd601f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 -- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0039a0 msgr2=0x7efd601f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0039a0 0x7efd601f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 -- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd600af220 msgr2=0x7efd600af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd600af220 0x7efd600af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.142+0000 7efd5f59e640 1 -- 172.21.15.154:0/3964963448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600c72b0 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.143+0000 7efd5f59e640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 0x7efd600c6760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd60071f60 tx=0x7efd5800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.143+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800fed0 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.143+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd58003b80 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.143+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd580050d0 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.143+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd600c7590 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.143+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd600c6ca0 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.144+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd60067420 con 0x7efd600c62e0 2023-11-27T22:30:20.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.144+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efd58005230 con 0x7efd600c62e0 2023-11-27T22:30:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.145+0000 7efd577fe640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd4006b1f0 0x7efd4006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.145+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5970+0+0 (secure 0 0 0) 0x7efd58089930 con 0x7efd600c62e0 2023-11-27T22:30:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.145+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd4006b1f0 0x7efd4006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.145+0000 7efd5ed9d640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd4006b1f0 0x7efd4006d6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c240 tx=0x7efd50009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.149+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efd580545e0 con 0x7efd600c62e0 2023-11-27T22:30:20.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.314+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd600d1420 con 0x7efd600c62e0 2023-11-27T22:30:20.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.316+0000 7efd577fe640 1 -- 172.21.15.154:0/3964963448 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17014 (secure 0 0 0) 0x7efd58089070 con 0x7efd600c62e0 2023-11-27T22:30:20.319 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:20.319 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":21,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:19.779983+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:20.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd4006b1f0 msgr2=0x7efd4006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd4006b1f0 0x7efd4006d6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c240 tx=0x7efd50009030 comp rx=0 tx=0).stop 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 msgr2=0x7efd600c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 0x7efd600c6760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efd60071f60 tx=0x7efd5800fc80 comp rx=0 tx=0).stop 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 shutdown_connections 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd600af220 0x7efd600af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efd4006b1f0 0x7efd4006d6b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd600c62e0 0x7efd600c6760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 --2- 172.21.15.154:0/3964963448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd4c0039a0 0x7efd601f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 >> 172.21.15.154:0/3964963448 conn(0x7efd600d0d50 msgr2=0x7efd600cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 shutdown_connections 2023-11-27T22:30:20.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.318+0000 7efd64a01640 1 -- 172.21.15.154:0/3964963448 wait complete. 2023-11-27T22:30:20.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:20.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:20.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 Processor -- start 2023-11-27T22:30:20.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 -- start start 2023-11-27T22:30:20.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae8140310 0x7f8ae81618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8ae81409d0 0x7f8ae806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ae81428d0 0x7f8ae806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae8161e20 con 0x7f8ae81428d0 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae81406f0 con 0x7f8ae81409d0 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.432+0000 7f8aeda75640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8143960 con 0x7f8ae8140310 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ae81428d0 0x7f8ae806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ae81428d0 0x7f8ae806aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34070/0 (socket says 172.21.15.154:34070) 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 -- 172.21.15.154:0/1376990309 learned_addr learned my addr 172.21.15.154:0/1376990309 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae6ffd640 1 --2- 172.21.15.154:0/1376990309 >> v2:172.21.15.194:3300/0 conn(0x7f8ae81409d0 0x7f8ae806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae77fe640 1 --2- 172.21.15.154:0/1376990309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae8140310 0x7f8ae81618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 -- 172.21.15.154:0/1376990309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae8140310 msgr2=0x7f8ae81618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 --2- 172.21.15.154:0/1376990309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae8140310 0x7f8ae81618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 -- 172.21.15.154:0/1376990309 >> v2:172.21.15.194:3300/0 conn(0x7f8ae81409d0 msgr2=0x7f8ae806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 --2- 172.21.15.154:0/1376990309 >> v2:172.21.15.194:3300/0 conn(0x7f8ae81409d0 0x7f8ae806a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.433+0000 7f8ae7fff640 1 -- 172.21.15.154:0/1376990309 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8142de0 con 0x7f8ae81428d0 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8ae7fff640 1 --2- 172.21.15.154:0/1376990309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81428d0 0x7f8ae806aa10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ae806e630 tx=0x7f8ae002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3f7b5e9a7e68dd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8ae67fc640 1 -- 172.21.15.154:0/1376990309 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae002c9e0 con 0x7f8ae81428d0 2023-11-27T22:30:20.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8ae67fc640 1 -- 172.21.15.154:0/1376990309 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae002cb40 con 0x7f8ae81428d0 2023-11-27T22:30:20.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8ae67fc640 1 -- 172.21.15.154:0/1376990309 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00343f0 con 0x7f8ae81428d0 2023-11-27T22:30:20.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 -- 172.21.15.154:0/1376990309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81428d0 msgr2=0x7f8ae806aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 --2- 172.21.15.154:0/1376990309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81428d0 0x7f8ae806aa10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8ae806e630 tx=0x7f8ae002be40 comp rx=0 tx=0).stop 2023-11-27T22:30:20.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 -- 172.21.15.154:0/1376990309 shutdown_connections 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 --2- 172.21.15.154:0/1376990309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81428d0 0x7f8ae806aa10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 --2- 172.21.15.154:0/1376990309 >> v2:172.21.15.194:3300/0 conn(0x7f8ae81409d0 0x7f8ae806a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 --2- 172.21.15.154:0/1376990309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae8140310 0x7f8ae81618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 -- 172.21.15.154:0/1376990309 >> 172.21.15.154:0/1376990309 conn(0x7f8ae80b1e50 msgr2=0x7f8ae80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 -- 172.21.15.154:0/1376990309 shutdown_connections 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.434+0000 7f8aeda75640 1 -- 172.21.15.154:0/1376990309 wait complete. 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 Processor -- start 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 -- start start 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae8140310 0x7f8ae8131390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 0x7f8ae80714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae81428d0 0x7f8ae80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae812f860 con 0x7f8ae81409d0 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8132310 con 0x7f8ae8140310 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.436+0000 7f8aeda75640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae8131d50 con 0x7f8ae81428d0 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 0x7f8ae80714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 0x7f8ae80714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34078/0 (socket says 172.21.15.154:34078) 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 -- 172.21.15.154:0/624779149 learned_addr learned my addr 172.21.15.154:0/624779149 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae77fe640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae8140310 0x7f8ae8131390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae7fff640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae81428d0 0x7f8ae80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 -- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae81428d0 msgr2=0x7f8ae80719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae81428d0 0x7f8ae80719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 -- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae8140310 msgr2=0x7f8ae8131390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae8140310 0x7f8ae8131390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 -- 172.21.15.154:0/624779149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009b30 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae77fe640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae8140310 0x7f8ae8131390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8ae6ffd640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 0x7f8ae80714a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00d5f0 tx=0x7f8adc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0125f0 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc012750 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc012b00 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae8132030 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.437+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae81318d0 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.438+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae8069400 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.439+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8adc012c60 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.439+0000 7f8acffff640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ad406b1c0 0x7f8ad406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.439+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f8adc089f50 con 0x7f8ae81409d0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.439+0000 7f8ae77fe640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ad406b1c0 0x7f8ad406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.440+0000 7f8ae77fe640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ad406b1c0 0x7f8ad406d680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8006fd0 tx=0x7f8ad8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.444+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8adc054c00 con 0x7f8ae81409d0 2023-11-27T22:30:20.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.611+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ae8131a90 con 0x7f8ae81409d0 2023-11-27T22:30:20.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.612+0000 7f8acffff640 1 -- 172.21.15.154:0/624779149 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8adc058220 con 0x7f8ae81409d0 2023-11-27T22:30:20.615 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:20.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ad406b1c0 msgr2=0x7f8ad406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ad406b1c0 0x7f8ad406d680 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8006fd0 tx=0x7f8ad8008040 comp rx=0 tx=0).stop 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 msgr2=0x7f8ae80714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 0x7f8ae80714a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00d5f0 tx=0x7f8adc00dab0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 shutdown_connections 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ad406b1c0 0x7f8ad406d680 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae81428d0 0x7f8ae80719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae81409d0 0x7f8ae80714a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 --2- 172.21.15.154:0/624779149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae8140310 0x7f8ae8131390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 >> 172.21.15.154:0/624779149 conn(0x7f8ae80b1e50 msgr2=0x7f8ae815dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 shutdown_connections 2023-11-27T22:30:20.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.614+0000 7f8aeda75640 1 -- 172.21.15.154:0/624779149 wait complete. 2023-11-27T22:30:20.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.729+0000 7fee19b8a640 1 Processor -- start 2023-11-27T22:30:20.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee19b8a640 1 -- start start 2023-11-27T22:30:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee19b8a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fee140d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee19b8a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee140b2b10 con 0x7fee1415d330 2023-11-27T22:30:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee19b8a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee140d3b50 con 0x7fee140d3730 2023-11-27T22:30:20.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee19b8a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee140d1590 con 0x7fee140d2910 2023-11-27T22:30:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee137fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fee1415d330 0x7fee140b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60168/0 (socket says 172.21.15.154:60168) 2023-11-27T22:30:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.730+0000 7fee137fe640 1 -- 172.21.15.154:0/4118601029 learned_addr learned my addr 172.21.15.154:0/4118601029 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504885707 0 0) 0x7fee140b2b10 con 0x7fee1415d330 2023-11-27T22:30:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee12ffd640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fee140d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedfc003520 con 0x7fee1415d330 2023-11-27T22:30:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2299152843 0 0) 0x7fedfc003520 con 0x7fee1415d330 2023-11-27T22:30:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 msgr2=0x7fee140d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fee140d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 >> v1:172.21.15.194:6789/0 conn(0x7fee140d3730 legacy=0x7fee140b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140d1870 con 0x7fee1415d330 2023-11-27T22:30:20.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fee04001670 con 0x7fee1415d330 2023-11-27T22:30:20.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 >> v1:172.21.15.154:6789/0 conn(0x7fee1415d330 legacy=0x7fee140b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc0039a0 0x7fedfc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedfc0047c0 0x7fedfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fedfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee140d1590 con 0x7fedfc0039a0 2023-11-27T22:30:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc00bae0 con 0x7fedfc0047c0 2023-11-27T22:30:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc00bca0 con 0x7fee140d2910 2023-11-27T22:30:20.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee137fe640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc0039a0 0x7fedfc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee12ffd640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedfc0047c0 0x7fedfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee13fff640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fedfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee137fe640 1 -- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 msgr2=0x7fedfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee137fe640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fedfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee137fe640 1 -- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedfc0047c0 msgr2=0x7fedfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee137fe640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedfc0047c0 0x7fedfc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee137fe640 1 -- 172.21.15.154:0/4118601029 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc003520 con 0x7fedfc0039a0 2023-11-27T22:30:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.731+0000 7fee13fff640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee140d2910 0x7fedfc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:20.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.732+0000 7fee137fe640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc0039a0 0x7fedfc003dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fee0400c240 tx=0x7fedfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcf7b09bdf0c5b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.732+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04005ad0 con 0x7fedfc0039a0 2023-11-27T22:30:20.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.732+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04005c30 con 0x7fedfc0039a0 2023-11-27T22:30:20.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.732+0000 7fee127fc640 1 -- 172.21.15.154:0/4118601029 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0402c8b0 con 0x7fedfc0039a0 2023-11-27T22:30:20.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee19b8a640 1 -- 172.21.15.154:0/4118601029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc0039a0 msgr2=0x7fedfc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee19b8a640 1 --2- 172.21.15.154:0/4118601029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fedfc0039a0 0x7fedfc003dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fee0400c240 tx=0x7fedfc0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee13fff640 1 -- 172.21.15.154:0/4118601029 reap_dead start 2023-11-27T22:30:20.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee19b8a640 1 -- 172.21.15.154:0/4118601029 shutdown_connections 2023-11-27T22:30:20.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee19b8a640 1 -- 172.21.15.154:0/4118601029 >> 172.21.15.154:0/4118601029 conn(0x7fee14072020 msgr2=0x7fee14072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee19b8a640 1 -- 172.21.15.154:0/4118601029 shutdown_connections 2023-11-27T22:30:20.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.733+0000 7fee19b8a640 1 -- 172.21.15.154:0/4118601029 wait complete. 2023-11-27T22:30:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.734+0000 7fee19b8a640 1 Processor -- start 2023-11-27T22:30:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.734+0000 7fee19b8a640 1 -- start start 2023-11-27T22:30:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee19b8a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedfc0039a0 0x7fee140c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee19b8a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cbb90 0x7fee140ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee19b8a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 0x7fee140cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee19b8a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee140ca870 con 0x7fee1415b180 2023-11-27T22:30:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee19b8a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee140caaf0 con 0x7fee140cbb90 2023-11-27T22:30:20.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee19b8a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee140cadd0 con 0x7fedfc0039a0 2023-11-27T22:30:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 0x7fee140cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 0x7fee140cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34104/0 (socket says 172.21.15.154:34104) 2023-11-27T22:30:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 -- 172.21.15.154:0/522964727 learned_addr learned my addr 172.21.15.154:0/522964727 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee137fe640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedfc0039a0 0x7fee140c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee12ffd640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cbb90 0x7fee140ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 -- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedfc0039a0 msgr2=0x7fee140c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedfc0039a0 0x7fee140c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 -- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cbb90 msgr2=0x7fee140ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cbb90 0x7fee140ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.735+0000 7fee13fff640 1 -- 172.21.15.154:0/522964727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140cb0b0 con 0x7fee1415b180 2023-11-27T22:30:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.736+0000 7fee13fff640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 0x7fee140cc410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee0c000f80 tx=0x7fee0c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.736+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c017070 con 0x7fee1415b180 2023-11-27T22:30:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.736+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c006b50 con 0x7fee1415b180 2023-11-27T22:30:20.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.736+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c006d00 con 0x7fee1415b180 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.736+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee140cb390 con 0x7fee1415b180 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.736+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee140cc010 con 0x7fee1415b180 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.737+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee140cb8b0 con 0x7fee1415b180 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.737+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fee0c003970 con 0x7fee1415b180 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.738+0000 7fedfbfff640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee0006b1c0 0x7fee0006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.738+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fee0c089250 con 0x7fee1415b180 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.738+0000 7fee137fe640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee0006b1c0 0x7fee0006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.738+0000 7fee137fe640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee0006b1c0 0x7fee0006d680 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee04034000 tx=0x7fee04009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:20.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.742+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fee140cb8b0 con 0x7fee1415b180 2023-11-27T22:30:20.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.915+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee140cb8b0 con 0x7fee1415b180 2023-11-27T22:30:20.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.915+0000 7fedfbfff640 1 -- 172.21.15.154:0/522964727 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee140cb8b0 con 0x7fee1415b180 2023-11-27T22:30:20.918 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee0006b1c0 msgr2=0x7fee0006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee0006b1c0 0x7fee0006d680 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee04034000 tx=0x7fee04009030 comp rx=0 tx=0).stop 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 msgr2=0x7fee140cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 0x7fee140cc410 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee0c000f80 tx=0x7fee0c00eb90 comp rx=0 tx=0).stop 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 shutdown_connections 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee140cbb90 0x7fee140ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee0006b1c0 0x7fee0006d680 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee1415b180 0x7fee140cc410 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.920 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 --2- 172.21.15.154:0/522964727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedfc0039a0 0x7fee140c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 >> 172.21.15.154:0/522964727 conn(0x7fee14072020 msgr2=0x7fee1415f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 shutdown_connections 2023-11-27T22:30:20.921 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:20.917+0000 7fee19b8a640 1 -- 172.21.15.154:0/522964727 wait complete. 2023-11-27T22:30:20.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.031+0000 7f7a8f705640 1 Processor -- start 2023-11-27T22:30:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.031+0000 7f7a8f705640 1 -- start start 2023-11-27T22:30:21.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8f705640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7a880b1400 0x7f7a8815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8f705640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 0x7f7a8815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8f705640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8815e2a0 con 0x7f7a88143490 2023-11-27T22:30:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8f705640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8815b520 con 0x7f7a880b1400 2023-11-27T22:30:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8f705640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88143870 con 0x7f7a8815e730 2023-11-27T22:30:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8d4a1640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7a88143490 0x7f7a880b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60176/0 (socket says 172.21.15.154:60176) 2023-11-27T22:30:21.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8d4a1640 1 -- 172.21.15.154:0/3335490434 learned_addr learned my addr 172.21.15.154:0/3335490434 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415683927 0 0) 0x7f7a8815e2a0 con 0x7f7a88143490 2023-11-27T22:30:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8cca0640 1 --2- 172.21.15.154:0/3335490434 >> v2:172.21.15.194:3300/0 conn(0x7f7a880b1400 0x7f7a8815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a74003520 con 0x7f7a88143490 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.032+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 0x7f7a8815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514234786 0 0) 0x7f7a74003520 con 0x7f7a88143490 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 msgr2=0x7f7a8815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 0x7f7a8815aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 >> v2:172.21.15.194:3300/0 conn(0x7f7a880b1400 msgr2=0x7f7a8815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 --2- 172.21.15.154:0/3335490434 >> v2:172.21.15.194:3300/0 conn(0x7f7a880b1400 0x7f7a8815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8815b240 con 0x7f7a88143490 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f7a840019f0 con 0x7f7a88143490 2023-11-27T22:30:21.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 >> v1:172.21.15.154:6789/0 conn(0x7f7a88143490 legacy=0x7f7a880b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a74003970 0x7f7a74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 0x7f7a740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815b520 con 0x7f7a74004d00 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88143870 con 0x7f7a74003970 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7400b980 con 0x7f7a8815e730 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8cca0640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 0x7f7a740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8d4a1640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a74003970 0x7f7a74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8dca2640 1 -- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 msgr2=0x7f7a740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815e730 0x7f7a740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8dca2640 1 -- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a74003970 msgr2=0x7f7a74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:21.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a74003970 0x7f7a74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.033+0000 7f7a8dca2640 1 -- 172.21.15.154:0/3335490434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74003520 con 0x7f7a74004d00 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.034+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a74005180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009ac0 tx=0x7f7a740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f632dca3319ebd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.034+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8002c6b0 con 0x7f7a74004d00 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.034+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8002c810 con 0x7f7a74004d00 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.034+0000 7f7a7ffff640 1 -- 172.21.15.154:0/3335490434 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8002cba0 con 0x7f7a74004d00 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8f705640 1 -- 172.21.15.154:0/3335490434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 msgr2=0x7f7a74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3335490434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a74005180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009ac0 tx=0x7f7a740057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8dca2640 1 -- 172.21.15.154:0/3335490434 reap_dead start 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8f705640 1 -- 172.21.15.154:0/3335490434 shutdown_connections 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8f705640 1 -- 172.21.15.154:0/3335490434 >> 172.21.15.154:0/3335490434 conn(0x7f7a8806a4d0 msgr2=0x7f7a8806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:21.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8f705640 1 -- 172.21.15.154:0/3335490434 shutdown_connections 2023-11-27T22:30:21.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.035+0000 7f7a8f705640 1 -- 172.21.15.154:0/3335490434 wait complete. 2023-11-27T22:30:21.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.036+0000 7f7a8f705640 1 Processor -- start 2023-11-27T22:30:21.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.036+0000 7f7a8f705640 1 -- start start 2023-11-27T22:30:21.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a88159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815ba20 0x7f7a8815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a880ac640 0x7f7a880acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8815c3e0 con 0x7f7a74004d00 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88159fa0 con 0x7f7a880ac640 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880a8670 con 0x7f7a8815ba20 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a88159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a88159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34118/0 (socket says 172.21.15.154:34118) 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 -- 172.21.15.154:0/3756727733 learned_addr learned my addr 172.21.15.154:0/3756727733 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a880ac640 0x7f7a880acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8cca0640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815ba20 0x7f7a8815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 -- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815ba20 msgr2=0x7f7a8815bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815ba20 0x7f7a8815bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 -- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a880ac640 msgr2=0x7f7a880acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a880ac640 0x7f7a880acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 -- 172.21.15.154:0/3756727733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880a8950 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8dca2640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a880ac640 0x7f7a880acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8cca0640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815ba20 0x7f7a8815bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8d4a1640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a88159a60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007970 tx=0x7f7a8400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a84001840 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a840133f0 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a880a8c30 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.037+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840137c0 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.038+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a880a91f0 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.039+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a88069400 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.039+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7a84013b30 con 0x7f7a74004d00 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.039+0000 7f7a7dffb640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7a6c06b1f0 0x7f7a6c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.039+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f7a8408aa50 con 0x7f7a74004d00 2023-11-27T22:30:21.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.039+0000 7f7a8cca0640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7a6c06b1f0 0x7f7a6c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.040+0000 7f7a8cca0640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7a6c06b1f0 0x7f7a6c06d6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a881f3fb0 tx=0x7f7a78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.044+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7a84055700 con 0x7f7a74004d00 2023-11-27T22:30:21.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.212+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a880b2820 con 0x7f7a74004d00 2023-11-27T22:30:21.215 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.212+0000 7f7a7dffb640 1 -- 172.21.15.154:0/3756727733 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a84017070 con 0x7f7a74004d00 2023-11-27T22:30:21.215 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:21.216 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7a6c06b1f0 msgr2=0x7f7a6c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7a6c06b1f0 0x7f7a6c06d6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7a881f3fb0 tx=0x7f7a78008040 comp rx=0 tx=0).stop 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 msgr2=0x7f7a88159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a88159a60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7a84007970 tx=0x7f7a8400a730 comp rx=0 tx=0).stop 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 shutdown_connections 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a880ac640 0x7f7a880acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7a6c06b1f0 0x7f7a6c06d6b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a8815ba20 0x7f7a8815bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 --2- 172.21.15.154:0/3756727733 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a74004d00 0x7f7a88159a60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 >> 172.21.15.154:0/3756727733 conn(0x7f7a8806a4d0 msgr2=0x7f7a880cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 shutdown_connections 2023-11-27T22:30:21.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.214+0000 7f7a8f705640 1 -- 172.21.15.154:0/3756727733 wait complete. 2023-11-27T22:30:21.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.327+0000 7f21ff023640 1 Processor -- start 2023-11-27T22:30:21.330 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.327+0000 7f21ff023640 1 -- start start 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21ff023640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21f806abe0 0x7f21f815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21ff023640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8155b70 con 0x7f21f8155790 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21ff023640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f806f3b0 con 0x7f21f815b5e0 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21ff023640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f806ee30 con 0x7f21f806abe0 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fd5c0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21f806abe0 0x7f21f815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fd5c0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21f806abe0 0x7f21f815ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34122/0 (socket says 172.21.15.154:34122) 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fcdbf640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f21f8155790 0x7f21f806f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60184/0 (socket says 172.21.15.154:60184) 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fd5c0640 1 -- 172.21.15.154:0/3049086720 learned_addr learned my addr 172.21.15.154:0/3049086720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:21.331 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fd5c0640 1 -- 172.21.15.154:0/3049086720 >> v1:172.21.15.194:6789/0 conn(0x7f21f815b5e0 legacy=0x7f21f806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fd5c0640 1 -- 172.21.15.154:0/3049086720 >> v1:172.21.15.154:6789/0 conn(0x7f21f8155790 legacy=0x7f21f806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21f77fe640 1 -- 172.21.15.154:0/3049086720 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448249402 0 0) 0x7f21f8155b70 con 0x7f21f8155790 2023-11-27T22:30:21.332 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.328+0000 7f21fd5c0640 1 -- 172.21.15.154:0/3049086720 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f815c170 con 0x7f21f806abe0 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.329+0000 7f21fd5c0640 1 --2- 172.21.15.154:0/3049086720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f806abe0 0x7f21f815ba90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e50 tx=0x7f21f002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a0cdfb33e44a99 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.329+0000 7f21f77fe640 1 -- 172.21.15.154:0/3049086720 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f002cbb0 con 0x7f21f806abe0 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.329+0000 7f21f77fe640 1 -- 172.21.15.154:0/3049086720 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f002cd10 con 0x7f21f806abe0 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.329+0000 7f21f77fe640 1 -- 172.21.15.154:0/3049086720 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0034610 con 0x7f21f806abe0 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 -- 172.21.15.154:0/3049086720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f806abe0 msgr2=0x7f21f815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 --2- 172.21.15.154:0/3049086720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f806abe0 0x7f21f815ba90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e50 tx=0x7f21f002c010 comp rx=0 tx=0).stop 2023-11-27T22:30:21.333 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 -- 172.21.15.154:0/3049086720 shutdown_connections 2023-11-27T22:30:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 --2- 172.21.15.154:0/3049086720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f806abe0 0x7f21f815ba90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 -- 172.21.15.154:0/3049086720 >> 172.21.15.154:0/3049086720 conn(0x7f21f80b1e50 msgr2=0x7f21f80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 -- 172.21.15.154:0/3049086720 shutdown_connections 2023-11-27T22:30:21.334 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.330+0000 7f21ff023640 1 -- 172.21.15.154:0/3049086720 wait complete. 2023-11-27T22:30:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.331+0000 7f21ff023640 1 Processor -- start 2023-11-27T22:30:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.331+0000 7f21ff023640 1 -- start start 2023-11-27T22:30:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21ff023640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f806abe0 0x7f21f814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21ff023640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21f8155790 0x7f21f80b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.336 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21ff023640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 0x7f21f815a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21ff023640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cbd80 con 0x7f21f815b5e0 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21ff023640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cb1d0 con 0x7f21f806abe0 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21ff023640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cb3e0 con 0x7f21f8155790 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 0x7f21f815a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 0x7f21f815a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34136/0 (socket says 172.21.15.154:34136) 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 -- 172.21.15.154:0/2575651294 learned_addr learned my addr 172.21.15.154:0/2575651294 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fcdbf640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f806abe0 0x7f21f814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21f7fff640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21f8155790 0x7f21f80b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 -- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21f8155790 msgr2=0x7f21f80b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21f8155790 0x7f21f80b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 -- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f806abe0 msgr2=0x7f21f814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.337 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f806abe0 0x7f21f814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 -- 172.21.15.154:0/2575651294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009b30 con 0x7f21f815b5e0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.332+0000 7f21fd5c0640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 0x7f21f815a730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f21f0036040 tx=0x7f21f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.333+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0003990 con 0x7f21f815b5e0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.333+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0003af0 con 0x7f21f815b5e0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.333+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0003c80 con 0x7f21f815b5e0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.333+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80cb6c0 con 0x7f21f815b5e0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.333+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f814be50 con 0x7f21f815b5e0 2023-11-27T22:30:21.338 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.334+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f80cbec0 con 0x7f21f815b5e0 2023-11-27T22:30:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.334+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f21f0048460 con 0x7f21f815b5e0 2023-11-27T22:30:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.334+0000 7f21f57fa640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f21dc06b1c0 0x7f21dc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.334+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f21f00ac030 con 0x7f21f815b5e0 2023-11-27T22:30:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.334+0000 7f21fcdbf640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f21dc06b1c0 0x7f21dc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.335+0000 7f21fcdbf640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f21dc06b1c0 0x7f21dc06d680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007f70 tx=0x7f21ec007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.339+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f21f80cbec0 con 0x7f21f815b5e0 2023-11-27T22:30:21.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.520+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21f80cbec0 con 0x7f21f815b5e0 2023-11-27T22:30:21.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.520+0000 7f21f57fa640 1 -- 172.21.15.154:0/2575651294 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21f80cbec0 con 0x7f21f815b5e0 2023-11-27T22:30:21.523 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f21dc06b1c0 msgr2=0x7f21dc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f21dc06b1c0 0x7f21dc06d680 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007f70 tx=0x7f21ec007f00 comp rx=0 tx=0).stop 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 msgr2=0x7f21f815a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 0x7f21f815a730 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f21f0036040 tx=0x7f21f0004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 shutdown_connections 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f21dc06b1c0 0x7f21dc06d680 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21f815b5e0 0x7f21f815a730 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21f8155790 0x7f21f80b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 --2- 172.21.15.154:0/2575651294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21f806abe0 0x7f21f814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 >> 172.21.15.154:0/2575651294 conn(0x7f21f80b1e50 msgr2=0x7f21f8071870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 shutdown_connections 2023-11-27T22:30:21.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.522+0000 7f21ff023640 1 -- 172.21.15.154:0/2575651294 wait complete. 2023-11-27T22:30:21.536 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi194.front.sepia.ceph.com... 2023-11-27T22:30:21.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:21.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-27T22:30:21.569 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:21.570 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:30:21.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:21.570 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-27T22:30:21.636 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:30:21.636 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:21.651 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:30:21.651 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:21.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:21.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.844+0000 7fb7cf475640 1 Processor -- start 2023-11-27T22:30:21.847 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.844+0000 7fb7cf475640 1 -- start start 2023-11-27T22:30:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cf475640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c806abe0 0x7fb7c815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cf475640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c8143680 0x7fb7c81409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cf475640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c806e960 con 0x7fb7c81432a0 2023-11-27T22:30:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cf475640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c815dec0 con 0x7fb7c806abe0 2023-11-27T22:30:21.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cf475640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815e1a0 con 0x7fb7c8143680 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cca10640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb7c806abe0 0x7fb7c815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cd211640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb7c81432a0 0x7fb7c806a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60198/0 (socket says 172.21.15.154:60198) 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.845+0000 7fb7cd211640 1 -- 172.21.15.154:0/1456410907 learned_addr learned my addr 172.21.15.154:0/1456410907 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7cda12640 1 --2- 172.21.15.154:0/1456410907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c8143680 0x7fb7c81409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7bffff640 1 -- 172.21.15.154:0/1456410907 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165929148 0 0) 0x7fb7c806e960 con 0x7fb7c81432a0 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7bffff640 1 -- 172.21.15.154:0/1456410907 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b4003520 con 0x7fb7c81432a0 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7cca10640 1 -- 172.21.15.154:0/1456410907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c8143680 msgr2=0x7fb7c81409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:21.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7cca10640 1 --2- 172.21.15.154:0/1456410907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c8143680 0x7fb7c81409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7cca10640 1 -- 172.21.15.154:0/1456410907 >> v1:172.21.15.154:6789/0 conn(0x7fb7c81432a0 legacy=0x7fb7c806a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.846+0000 7fb7cca10640 1 -- 172.21.15.154:0/1456410907 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c815e480 con 0x7fb7c806abe0 2023-11-27T22:30:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cca10640 1 --2- 172.21.15.154:0/1456410907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c806abe0 0x7fb7c815d8e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80097a0 tx=0x7fb7b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d34bef24ef7a5fc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7bffff640 1 -- 172.21.15.154:0/1456410907 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8031830 con 0x7fb7c806abe0 2023-11-27T22:30:21.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7bffff640 1 -- 172.21.15.154:0/1456410907 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b8031990 con 0x7fb7c806abe0 2023-11-27T22:30:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7bffff640 1 -- 172.21.15.154:0/1456410907 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8031d00 con 0x7fb7c806abe0 2023-11-27T22:30:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 -- 172.21.15.154:0/1456410907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c806abe0 msgr2=0x7fb7c815d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 --2- 172.21.15.154:0/1456410907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c806abe0 0x7fb7c815d8e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80097a0 tx=0x7fb7b802b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 -- 172.21.15.154:0/1456410907 shutdown_connections 2023-11-27T22:30:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 --2- 172.21.15.154:0/1456410907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c8143680 0x7fb7c81409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 --2- 172.21.15.154:0/1456410907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c806abe0 0x7fb7c815d8e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 -- 172.21.15.154:0/1456410907 >> 172.21.15.154:0/1456410907 conn(0x7fb7c80b1de0 msgr2=0x7fb7c80b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:21.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 -- 172.21.15.154:0/1456410907 shutdown_connections 2023-11-27T22:30:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.847+0000 7fb7cf475640 1 -- 172.21.15.154:0/1456410907 wait complete. 2023-11-27T22:30:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.848+0000 7fb7cf475640 1 Processor -- start 2023-11-27T22:30:21.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 -- start start 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c806abe0 0x7fb7c813db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 0x7fb7c8140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7c8143680 0x7fb7c81427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c813e050 con 0x7fb7c81432a0 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8141740 con 0x7fb7c8143680 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cf475640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8141a20 con 0x7fb7c806abe0 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cca10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 0x7fb7c8140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cca10640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 0x7fb7c8140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34166/0 (socket says 172.21.15.154:34166) 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.849+0000 7fb7cca10640 1 -- 172.21.15.154:0/2262634013 learned_addr learned my addr 172.21.15.154:0/2262634013 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cd211640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c806abe0 0x7fb7c813db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cda12640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7c8143680 0x7fb7c81427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cca10640 1 -- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c806abe0 msgr2=0x7fb7c813db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cca10640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c806abe0 0x7fb7c813db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cca10640 1 -- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7c8143680 msgr2=0x7fb7c81427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cca10640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7c8143680 0x7fb7c81427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cca10640 1 -- 172.21.15.154:0/2262634013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8009400 con 0x7fb7c81432a0 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cda12640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7c8143680 0x7fb7c81427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cca10640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 0x7fb7c8140dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80098c0 tx=0x7fb7b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b803a630 con 0x7fb7c81432a0 2023-11-27T22:30:21.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b803a790 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c8141d00 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b803ab40 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.850+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c81422c0 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.851+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c8067420 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.852+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb7b803aca0 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.852+0000 7fb7bdffb640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb7ac06b1c0 0x7fb7ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.852+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fb7b80ab4c0 con 0x7fb7c81432a0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.852+0000 7fb7cd211640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb7ac06b1c0 0x7fb7ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.852+0000 7fb7cd211640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb7ac06b1c0 0x7fb7ac06d680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4005c00 tx=0x7fb7c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:21.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:21.856+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb7b80760e0 con 0x7fb7c81432a0 2023-11-27T22:30:22.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.023+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7c81424e0 con 0x7fb7c81432a0 2023-11-27T22:30:22.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.024+0000 7fb7bdffb640 1 -- 172.21.15.154:0/2262634013 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7fb7b8079700 con 0x7fb7c81432a0 2023-11-27T22:30:22.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:22.027 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb7ac06b1c0 msgr2=0x7fb7ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb7ac06b1c0 0x7fb7ac06d680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4005c00 tx=0x7fb7c4009040 comp rx=0 tx=0).stop 2023-11-27T22:30:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 msgr2=0x7fb7c8140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 0x7fb7c8140dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80098c0 tx=0x7fb7b80046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 shutdown_connections 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7c8143680 0x7fb7c81427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb7ac06b1c0 0x7fb7ac06d680 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7c81432a0 0x7fb7c8140dd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 --2- 172.21.15.154:0/2262634013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7c806abe0 0x7fb7c813db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 >> 172.21.15.154:0/2262634013 conn(0x7fb7c80b1de0 msgr2=0x7fb7c815f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 shutdown_connections 2023-11-27T22:30:22.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.026+0000 7fb7cf475640 1 -- 172.21.15.154:0/2262634013 wait complete. 2023-11-27T22:30:22.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:22.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:22.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.143+0000 7f567412c640 1 Processor -- start 2023-11-27T22:30:22.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.143+0000 7f567412c640 1 -- start start 2023-11-27T22:30:22.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f567412c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f566c0ad640 0x7f566c06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f567412c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0adae0 con 0x7f566c15d1d0 2023-11-27T22:30:22.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f567412c640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566c0addc0 con 0x7f566c06bbf0 2023-11-27T22:30:22.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f567412c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566c0ae0a0 con 0x7f566c0ad640 2023-11-27T22:30:22.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f5671ec8640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f566c15d1d0 0x7f566c06b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60208/0 (socket says 172.21.15.154:60208) 2023-11-27T22:30:22.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f5671ec8640 1 -- 172.21.15.154:0/457277171 learned_addr learned my addr 172.21.15.154:0/457277171 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:22.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409465783 0 0) 0x7f566c0adae0 con 0x7f566c15d1d0 2023-11-27T22:30:22.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f56716c7640 1 --2- 172.21.15.154:0/457277171 >> v2:172.21.15.194:3300/0 conn(0x7f566c0ad640 0x7f566c06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5658003520 con 0x7f566c15d1d0 2023-11-27T22:30:22.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.144+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 365246318 0 0) 0x7f5658003520 con 0x7f566c15d1d0 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 >> v2:172.21.15.194:3300/0 conn(0x7f566c0ad640 msgr2=0x7f566c06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 --2- 172.21.15.154:0/457277171 >> v2:172.21.15.194:3300/0 conn(0x7f566c0ad640 0x7f566c06d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 >> v1:172.21.15.194:6789/0 conn(0x7f566c06bbf0 legacy=0x7f566c06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0ae380 con 0x7f566c15d1d0 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f5668001670 con 0x7f566c15d1d0 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 >> v1:172.21.15.154:6789/0 conn(0x7f566c15d1d0 legacy=0x7f566c06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5658003970 0x7f5658003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56580047c0 0x7f5658004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5658005180 0x7f565800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ae0a0 con 0x7f56580047c0 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565800c020 con 0x7f5658003970 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565800c1e0 con 0x7f5658005180 2023-11-27T22:30:22.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56716c7640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56580047c0 0x7f5658004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f5671ec8640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5658003970 0x7f5658003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56726c9640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5658005180 0x7f565800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56716c7640 1 -- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5658005180 msgr2=0x7f565800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56716c7640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5658005180 0x7f565800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56716c7640 1 -- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5658003970 msgr2=0x7f5658003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56716c7640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5658003970 0x7f5658003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56716c7640 1 -- 172.21.15.154:0/457277171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658003520 con 0x7f56580047c0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.145+0000 7f56726c9640 1 -- 172.21.15.154:0/457277171 reap_dead start 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f56716c7640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56580047c0 0x7f5658004c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f565c009ac0 tx=0x7f56580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf3250cf642304e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c02c6b0 con 0x7f56580047c0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c02c810 con 0x7f56580047c0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f5670ec6640 1 -- 172.21.15.154:0/457277171 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c02cba0 con 0x7f56580047c0 2023-11-27T22:30:22.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f567412c640 1 -- 172.21.15.154:0/457277171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56580047c0 msgr2=0x7f5658004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f567412c640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56580047c0 0x7f5658004c40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f565c009ac0 tx=0x7f56580057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f567412c640 1 -- 172.21.15.154:0/457277171 shutdown_connections 2023-11-27T22:30:22.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f567412c640 1 --2- 172.21.15.154:0/457277171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56580047c0 0x7f5658004c40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.146+0000 7f567412c640 1 -- 172.21.15.154:0/457277171 >> 172.21.15.154:0/457277171 conn(0x7f566c070e70 msgr2=0x7f566c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.147+0000 7f567412c640 1 -- 172.21.15.154:0/457277171 shutdown_connections 2023-11-27T22:30:22.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.147+0000 7f567412c640 1 -- 172.21.15.154:0/457277171 wait complete. 2023-11-27T22:30:22.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 Processor -- start 2023-11-27T22:30:22.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 -- start start 2023-11-27T22:30:22.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56580047c0 0x7f566c15e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f566c1512c0 0x7f566c0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 0x7f566c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0ceab0 con 0x7f566c06a4d0 2023-11-27T22:30:22.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c06ae90 con 0x7f566c1512c0 2023-11-27T22:30:22.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f567412c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c151700 con 0x7f56580047c0 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f56726c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 0x7f566c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f56726c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 0x7f566c06a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34182/0 (socket says 172.21.15.154:34182) 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.148+0000 7f56726c9640 1 -- 172.21.15.154:0/1175562181 learned_addr learned my addr 172.21.15.154:0/1175562181 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56716c7640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f566c1512c0 0x7f566c0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f5671ec8640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56580047c0 0x7f566c15e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56726c9640 1 -- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56580047c0 msgr2=0x7f566c15e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56726c9640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56580047c0 0x7f566c15e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56726c9640 1 -- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f566c1512c0 msgr2=0x7f566c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56726c9640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f566c1512c0 0x7f566c0ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56726c9640 1 -- 172.21.15.154:0/1175562181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c15e9f0 con 0x7f566c06a4d0 2023-11-27T22:30:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f5671ec8640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56580047c0 0x7f566c15e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56726c9640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 0x7f566c06a950 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5664007fd0 tx=0x7f566400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566400eed0 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664003970 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c15ecd0 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664003d40 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.149+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c15f290 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.150+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c069400 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.151+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f56640050d0 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.151+0000 7f56627fc640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f565006b1f0 0x7f565006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.151+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f5664089810 con 0x7f566c06a4d0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.151+0000 7f5671ec8640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f565006b1f0 0x7f565006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.151+0000 7f5671ec8640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f565006b1f0 0x7f565006d6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5668007c60 tx=0x7f5668009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.155+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5664054430 con 0x7f566c06a4d0 2023-11-27T22:30:22.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.321+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f566c159320 con 0x7f566c06a4d0 2023-11-27T22:30:22.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.322+0000 7f56627fc640 1 -- 172.21.15.154:0/1175562181 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5664057a50 con 0x7f566c06a4d0 2023-11-27T22:30:22.325 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:22.327 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.323+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f565006b1f0 msgr2=0x7f565006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.323+0000 7f567412c640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f565006b1f0 0x7f565006d6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5668007c60 tx=0x7f5668009040 comp rx=0 tx=0).stop 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.323+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 msgr2=0x7f566c06a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.323+0000 7f567412c640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 0x7f566c06a950 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5664007fd0 tx=0x7f566400eb90 comp rx=0 tx=0).stop 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 shutdown_connections 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f566c1512c0 0x7f566c0ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f565006b1f0 0x7f565006d6b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566c06a4d0 0x7f566c06a950 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 --2- 172.21.15.154:0/1175562181 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f56580047c0 0x7f566c15e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 >> 172.21.15.154:0/1175562181 conn(0x7f566c070e70 msgr2=0x7f566c06e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 shutdown_connections 2023-11-27T22:30:22.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.324+0000 7f567412c640 1 -- 172.21.15.154:0/1175562181 wait complete. 2023-11-27T22:30:22.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:22.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.439+0000 7fa3b589b640 1 Processor -- start 2023-11-27T22:30:22.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.439+0000 7fa3b589b640 1 -- start start 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3b589b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3b015d330 0x7fa3b00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3b589b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa3b00d3900 0x7fa3b00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3b589b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00b2b10 con 0x7fa3b00d2910 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3b589b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00d1590 con 0x7fa3b015d330 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3b589b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00d1870 con 0x7fa3b00d3900 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3b015d330 0x7fa3b00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa3b015d330 0x7fa3b00b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34194/0 (socket says 172.21.15.154:34194) 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 -- 172.21.15.154:0/1078421815 learned_addr learned my addr 172.21.15.154:0/1078421815 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:22.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3af7fe640 1 --2- 172.21.15.154:0/1078421815 >> v2:172.21.15.194:3300/0 conn(0x7fa3b00d3900 0x7fa3b00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 -- 172.21.15.154:0/1078421815 >> v2:172.21.15.194:3300/0 conn(0x7fa3b00d3900 msgr2=0x7fa3b00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:22.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 --2- 172.21.15.154:0/1078421815 >> v2:172.21.15.194:3300/0 conn(0x7fa3b00d3900 0x7fa3b00b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 -- 172.21.15.154:0/1078421815 >> v1:172.21.15.194:6789/0 conn(0x7fa3b00d2910 legacy=0x7fa3b00d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:22.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.440+0000 7fa3aeffd640 1 -- 172.21.15.154:0/1078421815 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00d1b50 con 0x7fa3b015d330 2023-11-27T22:30:22.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3aeffd640 1 --2- 172.21.15.154:0/1078421815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b015d330 0x7fa3b00b8b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3b006c500 tx=0x7fa3a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce938b9e371b9a0e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3adffb640 1 -- 172.21.15.154:0/1078421815 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a00317e0 con 0x7fa3b015d330 2023-11-27T22:30:22.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3adffb640 1 -- 172.21.15.154:0/1078421815 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0031940 con 0x7fa3b015d330 2023-11-27T22:30:22.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3adffb640 1 -- 172.21.15.154:0/1078421815 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0031cd0 con 0x7fa3b015d330 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 -- 172.21.15.154:0/1078421815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b015d330 msgr2=0x7fa3b00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 --2- 172.21.15.154:0/1078421815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b015d330 0x7fa3b00b8b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3b006c500 tx=0x7fa3a002b880 comp rx=0 tx=0).stop 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 -- 172.21.15.154:0/1078421815 shutdown_connections 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 --2- 172.21.15.154:0/1078421815 >> v2:172.21.15.194:3300/0 conn(0x7fa3b00d3900 0x7fa3b00b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 --2- 172.21.15.154:0/1078421815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b015d330 0x7fa3b00b8b80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 -- 172.21.15.154:0/1078421815 >> 172.21.15.154:0/1078421815 conn(0x7fa3b0072020 msgr2=0x7fa3b0072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 -- 172.21.15.154:0/1078421815 shutdown_connections 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.441+0000 7fa3b589b640 1 -- 172.21.15.154:0/1078421815 wait complete. 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.442+0000 7fa3b589b640 1 Processor -- start 2023-11-27T22:30:22.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 -- start start 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3b00d2910 0x7fa3b01f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 0x7fa3b01f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3b015d330 0x7fa3b015ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00cd320 con 0x7fa3b00d3900 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00cd040 con 0x7fa3b015d330 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3b589b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00c6d40 con 0x7fa3b00d2910 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.443+0000 7fa3ae7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 0x7fa3b01f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 0x7fa3b01f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34206/0 (socket says 172.21.15.154:34206) 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 -- 172.21.15.154:0/3165427143 learned_addr learned my addr 172.21.15.154:0/3165427143 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3aeffd640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3b00d2910 0x7fa3b01f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3af7fe640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3b015d330 0x7fa3b015ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 -- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3b00d2910 msgr2=0x7fa3b01f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3b00d2910 0x7fa3b01f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 -- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3b015d330 msgr2=0x7fa3b015ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3b015d330 0x7fa3b015ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 -- 172.21.15.154:0/3165427143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00094d0 con 0x7fa3b00d3900 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3aeffd640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3b00d2910 0x7fa3b01f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3af7fe640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3b015d330 0x7fa3b015ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3ae7fc640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 0x7fa3b01f6100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400b3f0 tx=0x7fa3a400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011830 con 0x7fa3b00d3900 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4011990 con 0x7fa3b00d3900 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b00c7020 con 0x7fa3b00d3900 2023-11-27T22:30:22.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011d40 con 0x7fa3b00d3900 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.444+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b01f6640 con 0x7fa3b00d3900 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.445+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b00c6ba0 con 0x7fa3b00d3900 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.445+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa3a401a400 con 0x7fa3b00d3900 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.446+0000 7fa397fff640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa39c06b1c0 0x7fa39c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.446+0000 7fa3aeffd640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa39c06b1c0 0x7fa39c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.446+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fa3a4089950 con 0x7fa3b00d3900 2023-11-27T22:30:22.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.446+0000 7fa3aeffd640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa39c06b1c0 0x7fa39c06d680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0036000 tx=0x7fa3a003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.450+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa3b00c6ba0 con 0x7fa3b00d3900 2023-11-27T22:30:22.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.615+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3b00c7540 con 0x7fa3b00d3900 2023-11-27T22:30:22.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.615+0000 7fa397fff640 1 -- 172.21.15.154:0/3165427143 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3a4015020 con 0x7fa3b00d3900 2023-11-27T22:30:22.624 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa39c06b1c0 msgr2=0x7fa39c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa39c06b1c0 0x7fa39c06d680 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0036000 tx=0x7fa3a003d040 comp rx=0 tx=0).stop 2023-11-27T22:30:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 msgr2=0x7fa3b01f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 0x7fa3b01f6100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400b3f0 tx=0x7fa3a400b8b0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 shutdown_connections 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3b015d330 0x7fa3b015ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa39c06b1c0 0x7fa39c06d680 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3b00d3900 0x7fa3b01f6100 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 --2- 172.21.15.154:0/3165427143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3b00d2910 0x7fa3b01f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 >> 172.21.15.154:0/3165427143 conn(0x7fa3b0072020 msgr2=0x7fa3b00b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 shutdown_connections 2023-11-27T22:30:22.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.617+0000 7fa3b589b640 1 -- 172.21.15.154:0/3165427143 wait complete. 2023-11-27T22:30:22.631 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:22.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.730+0000 7f26e2505640 1 Processor -- start 2023-11-27T22:30:22.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26e2505640 1 -- start start 2023-11-27T22:30:22.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26e2505640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26dc143490 0x7f26dc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26e2505640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26e2505640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc15e2a0 con 0x7f26dc15a4e0 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26e2505640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc15b520 con 0x7f26dc143490 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26e2505640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc143870 con 0x7f26dc15e730 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.731+0000 7f26dbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26dc143490 0x7f26dc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26dbfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26dc143490 0x7f26dc0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34218/0 (socket says 172.21.15.154:34218) 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26dbfff640 1 -- 172.21.15.154:0/1338551540 learned_addr learned my addr 172.21.15.154:0/1338551540 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26db7fe640 1 --2- 172.21.15.154:0/1338551540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26dbfff640 1 -- 172.21.15.154:0/1338551540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 msgr2=0x7f26dc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26dbfff640 1 --2- 172.21.15.154:0/1338551540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26dbfff640 1 -- 172.21.15.154:0/1338551540 >> v1:172.21.15.194:6789/0 conn(0x7f26dc15a4e0 legacy=0x7f26dc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.732+0000 7f26dbfff640 1 -- 172.21.15.154:0/1338551540 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc15b240 con 0x7f26dc143490 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26dbfff640 1 --2- 172.21.15.154:0/1338551540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0b0cf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009870 tx=0x7f26cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6288063e1769b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26daffd640 1 -- 172.21.15.154:0/1338551540 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc030840 con 0x7f26dc143490 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26daffd640 1 -- 172.21.15.154:0/1338551540 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0309a0 con 0x7f26dc143490 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26daffd640 1 -- 172.21.15.154:0/1338551540 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc030d30 con 0x7f26dc143490 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 -- 172.21.15.154:0/1338551540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 msgr2=0x7f26dc0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 --2- 172.21.15.154:0/1338551540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0b0cf0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009870 tx=0x7f26cc02b980 comp rx=0 tx=0).stop 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 -- 172.21.15.154:0/1338551540 shutdown_connections 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 --2- 172.21.15.154:0/1338551540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 --2- 172.21.15.154:0/1338551540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0b0cf0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 -- 172.21.15.154:0/1338551540 >> 172.21.15.154:0/1338551540 conn(0x7f26dc06a4d0 msgr2=0x7f26dc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 -- 172.21.15.154:0/1338551540 shutdown_connections 2023-11-27T22:30:22.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.733+0000 7f26e2505640 1 -- 172.21.15.154:0/1338551540 wait complete. 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 Processor -- start 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 -- start start 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc15a4e0 0x7f26dc1323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc13ede0 con 0x7f26dc143490 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc132900 con 0x7f26dc15a4e0 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.735+0000 7f26e2505640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc12fe70 con 0x7f26dc15e730 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34230/0 (socket says 172.21.15.154:34230) 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 -- 172.21.15.154:0/167253333 learned_addr learned my addr 172.21.15.154:0/167253333 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26db7fe640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc15a4e0 0x7f26dc1323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26e0aa2640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 -- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 msgr2=0x7f26dc0ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0ab240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 -- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc15a4e0 msgr2=0x7f26dc1323c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc15a4e0 0x7f26dc1323c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 -- 172.21.15.154:0/167253333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0094d0 con 0x7f26dc143490 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26dbfff640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0cb440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009870 tx=0x7f26cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc039c90 con 0x7f26dc143490 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc039df0 con 0x7f26dc143490 2023-11-27T22:30:22.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc130150 con 0x7f26dc143490 2023-11-27T22:30:22.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc043640 con 0x7f26dc143490 2023-11-27T22:30:22.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.736+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc130710 con 0x7f26dc143490 2023-11-27T22:30:22.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.737+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc0b4380 con 0x7f26dc143490 2023-11-27T22:30:22.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.738+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f26cc0437a0 con 0x7f26dc143490 2023-11-27T22:30:22.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.738+0000 7f26d8ff9640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f26bc06b1c0 0x7f26bc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:22.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.738+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f26cc03e070 con 0x7f26dc143490 2023-11-27T22:30:22.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.738+0000 7f26db7fe640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f26bc06b1c0 0x7f26bc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:22.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.739+0000 7f26db7fe640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f26bc06b1c0 0x7f26bc06d680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f26dc13e9e0 tx=0x7f26c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:22.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.742+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f26cc0777a0 con 0x7f26dc143490 2023-11-27T22:30:22.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.911+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26dc069400 con 0x7f26dc143490 2023-11-27T22:30:22.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.912+0000 7f26d8ff9640 1 -- 172.21.15.154:0/167253333 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26cc034020 con 0x7f26dc143490 2023-11-27T22:30:22.915 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f26bc06b1c0 msgr2=0x7f26bc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f26bc06b1c0 0x7f26bc06d680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f26dc13e9e0 tx=0x7f26c4008040 comp rx=0 tx=0).stop 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 msgr2=0x7f26dc0cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0cb440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009870 tx=0x7f26cc004730 comp rx=0 tx=0).stop 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 shutdown_connections 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26dc15a4e0 0x7f26dc1323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.917 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f26bc06b1c0 0x7f26bc06d680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26dc15e730 0x7f26dc0ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 --2- 172.21.15.154:0/167253333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26dc143490 0x7f26dc0cb440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:22.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 >> 172.21.15.154:0/167253333 conn(0x7f26dc06a4d0 msgr2=0x7f26dc0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:22.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 shutdown_connections 2023-11-27T22:30:22.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:22.914+0000 7f26e2505640 1 -- 172.21.15.154:0/167253333 wait complete. 2023-11-27T22:30:22.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:23.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.027+0000 7fc2b9836640 1 Processor -- start 2023-11-27T22:30:23.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.027+0000 7fc2b9836640 1 -- start start 2023-11-27T22:30:23.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.027+0000 7fc2b9836640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc2b415d330 0x7fc2b40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.027+0000 7fc2b9836640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b9836640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b40b2b10 con 0x7fc2b40d3730 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b9836640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40d3b50 con 0x7fc2b415d330 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b9836640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40d1590 con 0x7fc2b40d2910 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b27fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b2ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc2b415d330 0x7fc2b40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b37fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc2b40d3730 0x7fc2b40b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:33460/0 (socket says 172.21.15.154:33460) 2023-11-27T22:30:23.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b37fe640 1 -- 172.21.15.154:0/434496233 learned_addr learned my addr 172.21.15.154:0/434496233 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b1ffb640 1 -- 172.21.15.154:0/434496233 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053306279 0 0) 0x7fc2b40b2b10 con 0x7fc2b40d3730 2023-11-27T22:30:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b1ffb640 1 -- 172.21.15.154:0/434496233 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29c003520 con 0x7fc2b40d3730 2023-11-27T22:30:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b2ffd640 1 -- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 msgr2=0x7fc2b40d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b2ffd640 1 --2- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b2ffd640 1 -- 172.21.15.154:0/434496233 >> v1:172.21.15.194:6789/0 conn(0x7fc2b40d3730 legacy=0x7fc2b40b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b2ffd640 1 -- 172.21.15.154:0/434496233 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b40d1870 con 0x7fc2b415d330 2023-11-27T22:30:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.028+0000 7fc2b27fc640 1 --2- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.029+0000 7fc2b2ffd640 1 --2- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b415d330 0x7fc2b40b8b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40097a0 tx=0x7fc2a402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d0093f3ade0ffef server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.029+0000 7fc2b1ffb640 1 -- 172.21.15.154:0/434496233 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a402e070 con 0x7fc2b415d330 2023-11-27T22:30:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.029+0000 7fc2b1ffb640 1 -- 172.21.15.154:0/434496233 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a40315a0 con 0x7fc2b415d330 2023-11-27T22:30:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.029+0000 7fc2b1ffb640 1 -- 172.21.15.154:0/434496233 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4031910 con 0x7fc2b415d330 2023-11-27T22:30:23.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 -- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b415d330 msgr2=0x7fc2b40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 --2- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b415d330 0x7fc2b40b8b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40097a0 tx=0x7fc2a402b840 comp rx=0 tx=0).stop 2023-11-27T22:30:23.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 -- 172.21.15.154:0/434496233 shutdown_connections 2023-11-27T22:30:23.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 --2- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 --2- 172.21.15.154:0/434496233 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b415d330 0x7fc2b40b8b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 -- 172.21.15.154:0/434496233 >> 172.21.15.154:0/434496233 conn(0x7fc2b4072020 msgr2=0x7fc2b4072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 -- 172.21.15.154:0/434496233 shutdown_connections 2023-11-27T22:30:23.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.030+0000 7fc2b9836640 1 -- 172.21.15.154:0/434496233 wait complete. 2023-11-27T22:30:23.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.031+0000 7fc2b9836640 1 Processor -- start 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.031+0000 7fc2b9836640 1 -- start start 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b9836640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b9836640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b40d3730 0x7fc2b40cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b9836640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 0x7fc2b40cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b9836640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40b1b90 con 0x7fc2b415d330 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b9836640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40cb220 con 0x7fc2b40d3730 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b9836640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40ca330 con 0x7fc2b40d2910 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 0x7fc2b40cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 0x7fc2b40cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34238/0 (socket says 172.21.15.154:34238) 2023-11-27T22:30:23.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b37fe640 1 -- 172.21.15.154:0/704471981 learned_addr learned my addr 172.21.15.154:0/704471981 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b2ffd640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.032+0000 7fc2b27fc640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b40d3730 0x7fc2b40cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b37fe640 1 -- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 msgr2=0x7fc2b40c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b37fe640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b37fe640 1 -- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b40d3730 msgr2=0x7fc2b40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b37fe640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b40d3730 0x7fc2b40cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b37fe640 1 -- 172.21.15.154:0/704471981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8009400 con 0x7fc2b415d330 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b37fe640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 0x7fc2b40cb6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00cb40 tx=0x7fc2ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00aca0 con 0x7fc2b415d330 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00ae00 con 0x7fc2b415d330 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a4009400 con 0x7fc2b415d330 2023-11-27T22:30:23.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac012620 con 0x7fc2b415d330 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.033+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b40ca8f0 con 0x7fc2b415d330 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.034+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40cb3d0 con 0x7fc2b415d330 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.034+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc2ac007070 con 0x7fc2b415d330 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.035+0000 7fc29bfff640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc2a006b1c0 0x7fc2a006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.035+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fc2ac089a80 con 0x7fc2b415d330 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.035+0000 7fc2b2ffd640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc2a006b1c0 0x7fc2a006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.035+0000 7fc2b2ffd640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc2a006b1c0 0x7fc2a006d680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4036000 tx=0x7fc2a403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.039+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc2ac054750 con 0x7fc2b415d330 2023-11-27T22:30:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.220+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2b4069400 con 0x7fc2b415d330 2023-11-27T22:30:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.221+0000 7fc29bfff640 1 -- 172.21.15.154:0/704471981 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2ac057d70 con 0x7fc2b415d330 2023-11-27T22:30:23.223 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc2a006b1c0 msgr2=0x7fc2a006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc2a006b1c0 0x7fc2a006d680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4036000 tx=0x7fc2a403d040 comp rx=0 tx=0).stop 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 msgr2=0x7fc2b40cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 0x7fc2b40cb6b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00cb40 tx=0x7fc2ac00a060 comp rx=0 tx=0).stop 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 shutdown_connections 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b40d3730 0x7fc2b40cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc2a006b1c0 0x7fc2a006d680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2b415d330 0x7fc2b40cb6b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 --2- 172.21.15.154:0/704471981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2b40d2910 0x7fc2b40c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 >> 172.21.15.154:0/704471981 conn(0x7fc2b4072020 msgr2=0x7fc2b40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.226 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 shutdown_connections 2023-11-27T22:30:23.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.223+0000 7fc2b9836640 1 -- 172.21.15.154:0/704471981 wait complete. 2023-11-27T22:30:23.236 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:30:23.236 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:23.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:23.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.390+0000 7fd297a5d640 1 Processor -- start 2023-11-27T22:30:23.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.390+0000 7fd297a5d640 1 -- start start 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd297a5d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd290143490 0x7fd2900b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd297a5d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd29015e730 0x7fd2900b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd297a5d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29015a4e0 0x7fd29015a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd297a5d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29015b520 con 0x7fd29015a4e0 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd297a5d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd290143870 con 0x7fd29015e730 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd297a5d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29015e2a0 con 0x7fd290143490 2023-11-27T22:30:23.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29015a4e0 0x7fd29015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd29015a4e0 0x7fd29015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34254/0 (socket says 172.21.15.154:34254) 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 -- 172.21.15.154:0/302874845 learned_addr learned my addr 172.21.15.154:0/302874845 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd294ff8640 1 --2- 172.21.15.154:0/302874845 >> v2:172.21.15.194:3300/0 conn(0x7fd29015e730 0x7fd2900b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 -- 172.21.15.154:0/302874845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd290143490 msgr2=0x7fd2900b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 --2- 172.21.15.154:0/302874845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd290143490 0x7fd2900b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 -- 172.21.15.154:0/302874845 >> v2:172.21.15.194:3300/0 conn(0x7fd29015e730 msgr2=0x7fd2900b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 --2- 172.21.15.154:0/302874845 >> v2:172.21.15.194:3300/0 conn(0x7fd29015e730 0x7fd2900b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd295ffa640 1 -- 172.21.15.154:0/302874845 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29015b240 con 0x7fd29015a4e0 2023-11-27T22:30:23.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.391+0000 7fd294ff8640 1 --2- 172.21.15.154:0/302874845 >> v2:172.21.15.194:3300/0 conn(0x7fd29015e730 0x7fd2900b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.392+0000 7fd295ffa640 1 --2- 172.21.15.154:0/302874845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29015a970 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd29006e680 tx=0x7fd28802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4d4f5811f71012 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.392+0000 7fd287fff640 1 -- 172.21.15.154:0/302874845 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28802ca70 con 0x7fd29015a4e0 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.392+0000 7fd287fff640 1 -- 172.21.15.154:0/302874845 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28802cbd0 con 0x7fd29015a4e0 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.392+0000 7fd287fff640 1 -- 172.21.15.154:0/302874845 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880343f0 con 0x7fd29015a4e0 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 -- 172.21.15.154:0/302874845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 msgr2=0x7fd29015a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 --2- 172.21.15.154:0/302874845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29015a970 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd29006e680 tx=0x7fd28802bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 -- 172.21.15.154:0/302874845 shutdown_connections 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 --2- 172.21.15.154:0/302874845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29015a970 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 --2- 172.21.15.154:0/302874845 >> v2:172.21.15.194:3300/0 conn(0x7fd29015e730 0x7fd2900b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 --2- 172.21.15.154:0/302874845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd290143490 0x7fd2900b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 -- 172.21.15.154:0/302874845 >> 172.21.15.154:0/302874845 conn(0x7fd29006a4d0 msgr2=0x7fd29006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 -- 172.21.15.154:0/302874845 shutdown_connections 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.393+0000 7fd297a5d640 1 -- 172.21.15.154:0/302874845 wait complete. 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.394+0000 7fd297a5d640 1 Processor -- start 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.394+0000 7fd297a5d640 1 -- start start 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd290143490 0x7fd290156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29013df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd29015e730 0x7fd290070300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29013a250 con 0x7fd29015a4e0 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29013b080 con 0x7fd290143490 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29013b360 con 0x7fd29015e730 2023-11-27T22:30:23.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29013df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29013df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34256/0 (socket says 172.21.15.154:34256) 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 -- 172.21.15.154:0/2759393067 learned_addr learned my addr 172.21.15.154:0/2759393067 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd295ffa640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd29015e730 0x7fd290070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd2957f9640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd290143490 0x7fd290156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 -- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd29015e730 msgr2=0x7fd290070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd29015e730 0x7fd290070300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 -- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd290143490 msgr2=0x7fd290156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd290143490 0x7fd290156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 -- 172.21.15.154:0/2759393067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009b30 con 0x7fd29015a4e0 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd2957f9640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd290143490 0x7fd290156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd294ff8640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29013df40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c7f0 tx=0x7fd28000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280007820 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280007980 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd280007cf0 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.395+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29013b640 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.396+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29013a6e0 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.397+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29013a3c0 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.397+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd2800113f0 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.397+0000 7fd285ffb640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd27406b1c0 0x7fd27406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.397+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fd280089de0 con 0x7fd29015a4e0 2023-11-27T22:30:23.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.397+0000 7fd2957f9640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd27406b1c0 0x7fd27406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.398+0000 7fd2957f9640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd27406b1c0 0x7fd27406d680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009930 tx=0x7fd28c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.401+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd280054a90 con 0x7fd29015a4e0 2023-11-27T22:30:23.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.570+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd290069400 con 0x7fd29015a4e0 2023-11-27T22:30:23.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.571+0000 7fd285ffb640 1 -- 172.21.15.154:0/2759393067 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7fd28001f090 con 0x7fd29015a4e0 2023-11-27T22:30:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:23.574 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd27406b1c0 msgr2=0x7fd27406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd27406b1c0 0x7fd27406d680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009930 tx=0x7fd28c008040 comp rx=0 tx=0).stop 2023-11-27T22:30:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 msgr2=0x7fd29013df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29013df40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c7f0 tx=0x7fd28000ccb0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 shutdown_connections 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd27406b1c0 0x7fd27406d680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd29015e730 0x7fd290070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd29015a4e0 0x7fd29013df40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 --2- 172.21.15.154:0/2759393067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd290143490 0x7fd290156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 >> 172.21.15.154:0/2759393067 conn(0x7fd29006a4d0 msgr2=0x7fd29006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 shutdown_connections 2023-11-27T22:30:23.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.573+0000 7fd297a5d640 1 -- 172.21.15.154:0/2759393067 wait complete. 2023-11-27T22:30:23.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:23.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:23.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 Processor -- start 2023-11-27T22:30:23.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 -- start start 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1e015d330 0x7fa1e00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1e00d2910 0x7fa1e00d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d3730 0x7fa1e00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e00b2b10 con 0x7fa1e015d330 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.688+0000 7fa1e6e48640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e00d3b90 con 0x7fa1e00d2910 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e6e48640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e00d1590 con 0x7fa1e00d3730 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1e015d330 0x7fa1e00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa1e015d330 0x7fa1e00b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34268/0 (socket says 172.21.15.154:34268) 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 -- 172.21.15.154:0/629337695 learned_addr learned my addr 172.21.15.154:0/629337695 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1dffff640 1 --2- 172.21.15.154:0/629337695 >> v2:172.21.15.194:3300/0 conn(0x7fa1e00d2910 0x7fa1e00d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e53e5640 1 --2- 172.21.15.154:0/629337695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d3730 0x7fa1e00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 -- 172.21.15.154:0/629337695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d3730 msgr2=0x7fa1e00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 --2- 172.21.15.154:0/629337695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d3730 0x7fa1e00b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 -- 172.21.15.154:0/629337695 >> v2:172.21.15.194:3300/0 conn(0x7fa1e00d2910 msgr2=0x7fa1e00d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 --2- 172.21.15.154:0/629337695 >> v2:172.21.15.194:3300/0 conn(0x7fa1e00d2910 0x7fa1e00d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.689+0000 7fa1e4be4640 1 -- 172.21.15.154:0/629337695 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e00d1870 con 0x7fa1e015d330 2023-11-27T22:30:23.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e4be4640 1 --2- 172.21.15.154:0/629337695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e015d330 0x7fa1e00b8b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00d1540 tx=0x7fa1d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841037f5f955621e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1df7fe640 1 -- 172.21.15.154:0/629337695 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d40317e0 con 0x7fa1e015d330 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1df7fe640 1 -- 172.21.15.154:0/629337695 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4031940 con 0x7fa1e015d330 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1df7fe640 1 -- 172.21.15.154:0/629337695 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4031cd0 con 0x7fa1e015d330 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 -- 172.21.15.154:0/629337695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e015d330 msgr2=0x7fa1e00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/629337695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e015d330 0x7fa1e00b8b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00d1540 tx=0x7fa1d402b880 comp rx=0 tx=0).stop 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 -- 172.21.15.154:0/629337695 shutdown_connections 2023-11-27T22:30:23.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/629337695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d3730 0x7fa1e00b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/629337695 >> v2:172.21.15.194:3300/0 conn(0x7fa1e00d2910 0x7fa1e00d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/629337695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e015d330 0x7fa1e00b8b80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 -- 172.21.15.154:0/629337695 >> 172.21.15.154:0/629337695 conn(0x7fa1e0072020 msgr2=0x7fa1e0072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 -- 172.21.15.154:0/629337695 shutdown_connections 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.690+0000 7fa1e6e48640 1 -- 172.21.15.154:0/629337695 wait complete. 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 Processor -- start 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 -- start start 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d2910 0x7fa1e01603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 0x7fa1e015e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e015d330 0x7fa1e014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e015e3c0 con 0x7fa1e00d3730 2023-11-27T22:30:23.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e014d540 con 0x7fa1e015d330 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1e6e48640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e015d7b0 con 0x7fa1e00d2910 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 0x7fa1e015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 0x7fa1e015e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34284/0 (socket says 172.21.15.154:34284) 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.692+0000 7fa1dffff640 1 -- 172.21.15.154:0/47089907 learned_addr learned my addr 172.21.15.154:0/47089907 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1e53e5640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e015d330 0x7fa1e014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dffff640 1 -- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d2910 msgr2=0x7fa1e01603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dffff640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d2910 0x7fa1e01603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dffff640 1 -- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e015d330 msgr2=0x7fa1e014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dffff640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e015d330 0x7fa1e014d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dffff640 1 -- 172.21.15.154:0/47089907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40094d0 con 0x7fa1e00d3730 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dffff640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 0x7fa1e015e850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00e890 tx=0x7fa1cc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc00c940 con 0x7fa1e00d3730 2023-11-27T22:30:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc00caa0 con 0x7fa1e00d3730 2023-11-27T22:30:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e015da90 con 0x7fa1e00d3730 2023-11-27T22:30:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc00ce30 con 0x7fa1e00d3730 2023-11-27T22:30:23.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.693+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e015e050 con 0x7fa1e00d3730 2023-11-27T22:30:23.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.694+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e0069400 con 0x7fa1e00d3730 2023-11-27T22:30:23.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.695+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa1cc013470 con 0x7fa1e00d3730 2023-11-27T22:30:23.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.695+0000 7fa1dd7fa640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1c406b1f0 0x7fa1c406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.695+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fa1cc089c30 con 0x7fa1e00d3730 2023-11-27T22:30:23.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.695+0000 7fa1e4be4640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1c406b1f0 0x7fa1c406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.695+0000 7fa1e4be4640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1c406b1f0 0x7fa1c406d6b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4036000 tx=0x7fa1d4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.699+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa1cc0548e0 con 0x7fa1e00d3730 2023-11-27T22:30:23.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.865+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1e00b8fa0 con 0x7fa1e00d3730 2023-11-27T22:30:23.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.865+0000 7fa1dd7fa640 1 -- 172.21.15.154:0/47089907 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1cc0170a0 con 0x7fa1e00d3730 2023-11-27T22:30:23.868 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1c406b1f0 msgr2=0x7fa1c406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1c406b1f0 0x7fa1c406d6b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4036000 tx=0x7fa1d4030000 comp rx=0 tx=0).stop 2023-11-27T22:30:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 msgr2=0x7fa1e015e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 0x7fa1e015e850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00e890 tx=0x7fa1cc00ed50 comp rx=0 tx=0).stop 2023-11-27T22:30:23.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 shutdown_connections 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1e015d330 0x7fa1e014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1c406b1f0 0x7fa1c406d6b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa1e00d3730 0x7fa1e015e850 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 --2- 172.21.15.154:0/47089907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1e00d2910 0x7fa1e01603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 >> 172.21.15.154:0/47089907 conn(0x7fa1e0072020 msgr2=0x7fa1e0072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 shutdown_connections 2023-11-27T22:30:23.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.867+0000 7fa1e6e48640 1 -- 172.21.15.154:0/47089907 wait complete. 2023-11-27T22:30:23.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:23.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.980+0000 7f9c2aa09640 1 Processor -- start 2023-11-27T22:30:23.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c2aa09640 1 -- start start 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c2aa09640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9c2415d330 0x7f9c240b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c2aa09640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c240d3900 0x7f9c240b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c2aa09640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240b2b10 con 0x7f9c240d2910 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c2aa09640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c240d1590 con 0x7f9c240d3900 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c2aa09640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c240d1870 con 0x7f9c2415d330 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.981+0000 7f9c28fa6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9c240d3900 0x7f9c240b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c237fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9c240d2910 0x7f9c240d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60212/0 (socket says 172.21.15.154:60212) 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c237fe640 1 -- 172.21.15.154:0/1881970975 learned_addr learned my addr 172.21.15.154:0/1881970975 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c23fff640 1 --2- 172.21.15.154:0/1881970975 >> v2:172.21.15.194:3300/0 conn(0x7f9c2415d330 0x7f9c240b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c28fa6640 1 -- 172.21.15.154:0/1881970975 >> v2:172.21.15.194:3300/0 conn(0x7f9c2415d330 msgr2=0x7f9c240b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:23.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c28fa6640 1 --2- 172.21.15.154:0/1881970975 >> v2:172.21.15.194:3300/0 conn(0x7f9c2415d330 0x7f9c240b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c28fa6640 1 -- 172.21.15.154:0/1881970975 >> v1:172.21.15.154:6789/0 conn(0x7f9c240d2910 legacy=0x7f9c240d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c28fa6640 1 -- 172.21.15.154:0/1881970975 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240d1b50 con 0x7f9c240d3900 2023-11-27T22:30:23.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.982+0000 7f9c22ffd640 1 -- 172.21.15.154:0/1881970975 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191935104 0 0) 0x7f9c240b2b10 con 0x7f9c240d2910 2023-11-27T22:30:23.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c28fa6640 1 --2- 172.21.15.154:0/1881970975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c240b6390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c240d0d10 tx=0x7f9c1c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc65f41ea16842ff server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c22ffd640 1 -- 172.21.15.154:0/1881970975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c02cbf0 con 0x7f9c240d3900 2023-11-27T22:30:23.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c22ffd640 1 -- 172.21.15.154:0/1881970975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c02cd50 con 0x7f9c240d3900 2023-11-27T22:30:23.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c22ffd640 1 -- 172.21.15.154:0/1881970975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c034660 con 0x7f9c240d3900 2023-11-27T22:30:23.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 -- 172.21.15.154:0/1881970975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 msgr2=0x7f9c240b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/1881970975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c240b6390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c240d0d10 tx=0x7f9c1c02be40 comp rx=0 tx=0).stop 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 -- 172.21.15.154:0/1881970975 shutdown_connections 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/1881970975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c240b6390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/1881970975 >> v2:172.21.15.194:3300/0 conn(0x7f9c2415d330 0x7f9c240b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 -- 172.21.15.154:0/1881970975 >> 172.21.15.154:0/1881970975 conn(0x7f9c24072020 msgr2=0x7f9c24072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 -- 172.21.15.154:0/1881970975 shutdown_connections 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.983+0000 7f9c2aa09640 1 -- 172.21.15.154:0/1881970975 wait complete. 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.984+0000 7f9c2aa09640 1 Processor -- start 2023-11-27T22:30:23.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 -- start start 2023-11-27T22:30:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c240d2910 0x7f9c240c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c24159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c2415d330 0x7f9c24155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2415f0c0 con 0x7f9c240d3900 2023-11-27T22:30:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240c9b60 con 0x7f9c2415d330 2023-11-27T22:30:23.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c2aa09640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24159e50 con 0x7f9c240d2910 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c24159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c24159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34300/0 (socket says 172.21.15.154:34300) 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.985+0000 7f9c237fe640 1 -- 172.21.15.154:0/843840587 learned_addr learned my addr 172.21.15.154:0/843840587 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c28fa6640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c2415d330 0x7f9c24155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c23fff640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c240d2910 0x7f9c240c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c237fe640 1 -- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c240d2910 msgr2=0x7f9c240c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c237fe640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c240d2910 0x7f9c240c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c237fe640 1 -- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c2415d330 msgr2=0x7f9c24155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c237fe640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c2415d330 0x7f9c24155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c237fe640 1 -- 172.21.15.154:0/843840587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c009a70 con 0x7f9c240d3900 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c237fe640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c24159910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c460 tx=0x7f9c1800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180074e0 con 0x7f9c240d3900 2023-11-27T22:30:23.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18007660 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c24156240 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18004a20 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.986+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c241567e0 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.987+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2415f200 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.988+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9c18004b80 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.988+0000 7f9c20ff9640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c1006b1f0 0x7f9c1006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.988+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f9c18088f50 con 0x7f9c240d3900 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.988+0000 7f9c23fff640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c1006b1f0 0x7f9c1006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:23.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.988+0000 7f9c23fff640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c1006b1f0 0x7f9c1006d6b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009a10 tx=0x7f9c14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:23.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:23.992+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9c2415f200 con 0x7f9c240d3900 2023-11-27T22:30:24.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.157+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c2415f200 con 0x7f9c240d3900 2023-11-27T22:30:24.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.157+0000 7f9c20ff9640 1 -- 172.21.15.154:0/843840587 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c2415f200 con 0x7f9c240d3900 2023-11-27T22:30:24.160 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:24.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c1006b1f0 msgr2=0x7f9c1006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c1006b1f0 0x7f9c1006d6b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9c14009a10 tx=0x7f9c14008040 comp rx=0 tx=0).stop 2023-11-27T22:30:24.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 msgr2=0x7f9c24159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c24159910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c460 tx=0x7f9c1800c920 comp rx=0 tx=0).stop 2023-11-27T22:30:24.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 shutdown_connections 2023-11-27T22:30:24.162 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c2415d330 0x7f9c24155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c1006b1f0 0x7f9c1006d6b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c240d3900 0x7f9c24159910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 --2- 172.21.15.154:0/843840587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c240d2910 0x7f9c240c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 >> 172.21.15.154:0/843840587 conn(0x7f9c24072020 msgr2=0x7f9c240cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 shutdown_connections 2023-11-27T22:30:24.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.159+0000 7f9c2aa09640 1 -- 172.21.15.154:0/843840587 wait complete. 2023-11-27T22:30:24.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:24.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.273+0000 7f4b95b25640 1 Processor -- start 2023-11-27T22:30:24.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.273+0000 7f4b95b25640 1 -- start start 2023-11-27T22:30:24.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b95b25640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4b9015f280 0x7f4b9015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b95b25640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900c7ee0 con 0x7f4b9015bbe0 2023-11-27T22:30:24.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b95b25640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900cf330 con 0x7f4b900cebb0 2023-11-27T22:30:24.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b95b25640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900c7920 con 0x7f4b9015f280 2023-11-27T22:30:24.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b8f7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4b9015bbe0 0x7f4b9015bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60218/0 (socket says 172.21.15.154:60218) 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b8f7fe640 1 -- 172.21.15.154:0/2137093817 learned_addr learned my addr 172.21.15.154:0/2137093817 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b8ffff640 1 --2- 172.21.15.154:0/2137093817 >> v2:172.21.15.194:3300/0 conn(0x7f4b9015f280 0x7f4b9015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/2137093817 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879856122 0 0) 0x7f4b900c7ee0 con 0x7f4b9015bbe0 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.274+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/2137093817 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78003520 con 0x7f4b9015bbe0 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.275+0000 7f4b8ffff640 1 -- 172.21.15.154:0/2137093817 >> v1:172.21.15.194:6789/0 conn(0x7f4b900cebb0 legacy=0x7f4b900c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.275+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/2137093817 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1938108426 0 0) 0x7f4b78003520 con 0x7f4b9015bbe0 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.275+0000 7f4b8ffff640 1 -- 172.21.15.154:0/2137093817 >> v1:172.21.15.154:6789/0 conn(0x7f4b9015bbe0 legacy=0x7f4b9015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.278 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.275+0000 7f4b8ffff640 1 -- 172.21.15.154:0/2137093817 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900c7c00 con 0x7f4b9015f280 2023-11-27T22:30:24.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.275+0000 7f4b8ffff640 1 --2- 172.21.15.154:0/2137093817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015f280 0x7f4b9015f6d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009d90 tx=0x7f4b8802bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce24d33b6ebfe5a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:24.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/2137093817 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80001670 con 0x7f4b9015f280 2023-11-27T22:30:24.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/2137093817 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8802d720 con 0x7f4b9015f280 2023-11-27T22:30:24.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b8e7fc640 1 -- 172.21.15.154:0/2137093817 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8802da90 con 0x7f4b9015f280 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 -- 172.21.15.154:0/2137093817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015f280 msgr2=0x7f4b9015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 --2- 172.21.15.154:0/2137093817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015f280 0x7f4b9015f6d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009d90 tx=0x7f4b8802bbe0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 -- 172.21.15.154:0/2137093817 shutdown_connections 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 --2- 172.21.15.154:0/2137093817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015f280 0x7f4b9015f6d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 -- 172.21.15.154:0/2137093817 >> 172.21.15.154:0/2137093817 conn(0x7f4b900b2c10 msgr2=0x7f4b900b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 -- 172.21.15.154:0/2137093817 shutdown_connections 2023-11-27T22:30:24.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.276+0000 7f4b95b25640 1 -- 172.21.15.154:0/2137093817 wait complete. 2023-11-27T22:30:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.277+0000 7f4b95b25640 1 Processor -- start 2023-11-27T22:30:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.277+0000 7f4b95b25640 1 -- start start 2023-11-27T22:30:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b95b25640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cebb0 0x7f4b90154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b95b25640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015bbe0 0x7f4b9006c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b95b25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 0x7f4b901e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.282 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b95b25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b901546c0 con 0x7f4b9015f280 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b95b25640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900c8b60 con 0x7f4b9015bbe0 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b95b25640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900c8e00 con 0x7f4b900cebb0 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 0x7f4b901e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b8ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 0x7f4b901e4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34310/0 (socket says 172.21.15.154:34310) 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b8ffff640 1 -- 172.21.15.154:0/4055485112 learned_addr learned my addr 172.21.15.154:0/4055485112 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.278+0000 7f4b8effd640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015bbe0 0x7f4b9006c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8f7fe640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cebb0 0x7f4b90154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8ffff640 1 -- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cebb0 msgr2=0x7f4b90154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8ffff640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cebb0 0x7f4b90154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8ffff640 1 -- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015bbe0 msgr2=0x7f4b9006c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8ffff640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015bbe0 0x7f4b9006c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.283 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8ffff640 1 -- 172.21.15.154:0/4055485112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009a70 con 0x7f4b9015f280 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8f7fe640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cebb0 0x7f4b90154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b8ffff640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 0x7f4b901e4a10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009d90 tx=0x7f4b88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88007000 con 0x7f4b9015f280 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88035c80 con 0x7f4b9015f280 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900c6710 con 0x7f4b9015f280 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8803f430 con 0x7f4b9015f280 2023-11-27T22:30:24.284 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.279+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900c93c0 con 0x7f4b9015f280 2023-11-27T22:30:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.280+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b90069400 con 0x7f4b9015f280 2023-11-27T22:30:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.280+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4b8803f590 con 0x7f4b9015f280 2023-11-27T22:30:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.281+0000 7f4b77fff640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.281+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f4b88031070 con 0x7f4b9015f280 2023-11-27T22:30:24.285 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.281+0000 7f4b8f7fe640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.281+0000 7f4b8f7fe640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b80001eb0 tx=0x7f4b80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:24.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.285+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4b8807af90 con 0x7f4b9015f280 2023-11-27T22:30:24.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.451+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b900b3a20 con 0x7f4b9015f280 2023-11-27T22:30:24.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.451+0000 7f4b77fff640 1 -- 172.21.15.154:0/4055485112 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b8807ab20 con 0x7f4b9015f280 2023-11-27T22:30:24.454 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:24.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 msgr2=0x7f4b7c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b80001eb0 tx=0x7f4b80009040 comp rx=0 tx=0).stop 2023-11-27T22:30:24.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 msgr2=0x7f4b901e4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 0x7f4b901e4a10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009d90 tx=0x7f4b88004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:24.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 shutdown_connections 2023-11-27T22:30:24.456 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b9015bbe0 0x7f4b9006c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4b7c06b1f0 0x7f4b7c06d6b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4b9015f280 0x7f4b901e4a10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 --2- 172.21.15.154:0/4055485112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4b900cebb0 0x7f4b90154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 >> 172.21.15.154:0/4055485112 conn(0x7f4b900b2c10 msgr2=0x7f4b900cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 shutdown_connections 2023-11-27T22:30:24.457 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.453+0000 7f4b95b25640 1 -- 172.21.15.154:0/4055485112 wait complete. 2023-11-27T22:30:24.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.565+0000 7f4522415640 1 Processor -- start 2023-11-27T22:30:24.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.565+0000 7f4522415640 1 -- start start 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f4522415640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f451c15d330 0x7f451c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f4522415640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f451c0d2910 0x7f451c0d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f4522415640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d3730 0x7f451c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f4522415640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0b2b10 con 0x7f451c15d330 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f4522415640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c0d3b90 con 0x7f451c0d2910 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f4522415640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c0d1590 con 0x7f451c0d3730 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f451bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f451c15d330 0x7f451c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f451bfff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f451c15d330 0x7f451c0b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34314/0 (socket says 172.21.15.154:34314) 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.566+0000 7f451bfff640 1 -- 172.21.15.154:0/390776193 learned_addr learned my addr 172.21.15.154:0/390776193 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:24.572 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451b7fe640 1 --2- 172.21.15.154:0/390776193 >> v2:172.21.15.194:3300/0 conn(0x7f451c0d2910 0x7f451c0d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451bfff640 1 -- 172.21.15.154:0/390776193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d3730 msgr2=0x7f451c0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451bfff640 1 --2- 172.21.15.154:0/390776193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d3730 0x7f451c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451bfff640 1 -- 172.21.15.154:0/390776193 >> v2:172.21.15.194:3300/0 conn(0x7f451c0d2910 msgr2=0x7f451c0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451bfff640 1 --2- 172.21.15.154:0/390776193 >> v2:172.21.15.194:3300/0 conn(0x7f451c0d2910 0x7f451c0d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451bfff640 1 -- 172.21.15.154:0/390776193 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0d1870 con 0x7f451c15d330 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451b7fe640 1 --2- 172.21.15.154:0/390776193 >> v2:172.21.15.194:3300/0 conn(0x7f451c0d2910 0x7f451c0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.567+0000 7f451bfff640 1 --2- 172.21.15.154:0/390776193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c15d330 0x7f451c0b8b80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d1540 tx=0x7f450c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb148cab97f08167 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f451affd640 1 -- 172.21.15.154:0/390776193 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0317e0 con 0x7f451c15d330 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f451affd640 1 -- 172.21.15.154:0/390776193 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c031940 con 0x7f451c15d330 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f451affd640 1 -- 172.21.15.154:0/390776193 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c031cd0 con 0x7f451c15d330 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 -- 172.21.15.154:0/390776193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c15d330 msgr2=0x7f451c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 --2- 172.21.15.154:0/390776193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c15d330 0x7f451c0b8b80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f451c0d1540 tx=0x7f450c02b880 comp rx=0 tx=0).stop 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 -- 172.21.15.154:0/390776193 shutdown_connections 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 --2- 172.21.15.154:0/390776193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d3730 0x7f451c0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 --2- 172.21.15.154:0/390776193 >> v2:172.21.15.194:3300/0 conn(0x7f451c0d2910 0x7f451c0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 --2- 172.21.15.154:0/390776193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c15d330 0x7f451c0b8b80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 -- 172.21.15.154:0/390776193 >> 172.21.15.154:0/390776193 conn(0x7f451c072020 msgr2=0x7f451c072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 -- 172.21.15.154:0/390776193 shutdown_connections 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.568+0000 7f4522415640 1 -- 172.21.15.154:0/390776193 wait complete. 2023-11-27T22:30:24.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.569+0000 7f4522415640 1 Processor -- start 2023-11-27T22:30:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 -- start start 2023-11-27T22:30:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d2910 0x7f451c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 0x7f451c1f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f451c15d330 0x7f451c0c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c15e930 con 0x7f451c0d3730 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c15ec10 con 0x7f451c15d330 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f4522415640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c15eef0 con 0x7f451c0d2910 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 0x7f451c1f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 0x7f451c1f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34316/0 (socket says 172.21.15.154:34316) 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f451b7fe640 1 -- 172.21.15.154:0/273199592 learned_addr learned my addr 172.21.15.154:0/273199592 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:24.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.570+0000 7f45209b2640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f451c15d330 0x7f451c0c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451bfff640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d2910 0x7f451c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451b7fe640 1 -- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d2910 msgr2=0x7f451c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451b7fe640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d2910 0x7f451c0c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451b7fe640 1 -- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f451c15d330 msgr2=0x7f451c0c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451b7fe640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f451c15d330 0x7f451c0c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451b7fe640 1 -- 172.21.15.154:0/273199592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c0094d0 con 0x7f451c0d3730 2023-11-27T22:30:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f451b7fe640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 0x7f451c1f3180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f451000c7f0 tx=0x7f451000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510007a30 con 0x7f451c0d3730 2023-11-27T22:30:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4510007b90 con 0x7f451c0d3730 2023-11-27T22:30:24.579 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c15f1d0 con 0x7f451c0d3730 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000ce40 con 0x7f451c0d3730 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.571+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c1f36c0 con 0x7f451c0d3730 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.572+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c069400 con 0x7f451c0d3730 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.573+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f45100113f0 con 0x7f451c0d3730 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.573+0000 7f4518ff9640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f450806b1f0 0x7f450806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.573+0000 7f451bfff640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f450806b1f0 0x7f450806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.573+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f4510089cc0 con 0x7f451c0d3730 2023-11-27T22:30:24.580 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.573+0000 7f451bfff640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f450806b1f0 0x7f450806d6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f450c036000 tx=0x7f450c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:24.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.577+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4510054880 con 0x7f451c0d3730 2023-11-27T22:30:24.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.758+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f451c15c260 con 0x7f451c0d3730 2023-11-27T22:30:24.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.759+0000 7f4518ff9640 1 -- 172.21.15.154:0/273199592 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4510057ea0 con 0x7f451c0d3730 2023-11-27T22:30:24.761 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.760+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f450806b1f0 msgr2=0x7f450806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.760+0000 7f4522415640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f450806b1f0 0x7f450806d6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f450c036000 tx=0x7f450c03d040 comp rx=0 tx=0).stop 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.760+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 msgr2=0x7f451c1f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.760+0000 7f4522415640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 0x7f451c1f3180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f451000c7f0 tx=0x7f451000cbf0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 shutdown_connections 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f451c15d330 0x7f451c0c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f450806b1f0 0x7f450806d6b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f451c0d3730 0x7f451c1f3180 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 --2- 172.21.15.154:0/273199592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f451c0d2910 0x7f451c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 >> 172.21.15.154:0/273199592 conn(0x7f451c072020 msgr2=0x7f451c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 shutdown_connections 2023-11-27T22:30:24.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:24.761+0000 7f4522415640 1 -- 172.21.15.154:0/273199592 wait complete. 2023-11-27T22:30:24.774 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2023-11-27T22:30:24.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:24.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-27T22:30:24.802 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:24.802 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-27T22:30:24.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:24.802 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-27T22:30:24.858 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:30:24.858 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:24.879 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:30:24.879 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:24.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.036+0000 7f5541287640 1 Processor -- start 2023-11-27T22:30:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.036+0000 7f5541287640 1 -- start start 2023-11-27T22:30:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f5541287640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f553c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f5541287640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c0b2b10 con 0x7f553c0d2910 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f5541287640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c0d1590 con 0x7f553c0d2d90 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f5541287640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0d1870 con 0x7f553c15d330 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f553a7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f553c0d2910 0x7f553c0d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60220/0 (socket says 172.21.15.154:60220) 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f553a7fc640 1 -- 172.21.15.154:0/3524325660 learned_addr learned my addr 172.21.15.154:0/3524325660 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f553affd640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f553c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042816543 0 0) 0x7f553c0b2b10 con 0x7f553c0d2910 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.037+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5524003520 con 0x7f553c0d2910 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446677118 0 0) 0x7f5524003520 con 0x7f553c0d2910 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 msgr2=0x7f553c0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f553c0b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 >> v1:172.21.15.194:6789/0 conn(0x7f553c0d2d90 legacy=0x7f553c0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0d1b50 con 0x7f553c0d2910 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f5530001670 con 0x7f553c0d2910 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 >> v1:172.21.15.154:6789/0 conn(0x7f553c0d2910 legacy=0x7f553c0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55240039a0 0x7f5524003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f5524004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f5524005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0d1870 con 0x7f5524004350 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552400ba30 con 0x7f55240039a0 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552400bbf0 con 0x7f553c15d330 2023-11-27T22:30:25.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553a7fc640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f5524004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553affd640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55240039a0 0x7f5524003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553b7fe640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f5524005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553a7fc640 1 -- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 msgr2=0x7f5524005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553a7fc640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f5524005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553a7fc640 1 -- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55240039a0 msgr2=0x7f5524003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553a7fc640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55240039a0 0x7f5524003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553a7fc640 1 -- 172.21.15.154:0/3524325660 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524003520 con 0x7f5524004350 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.038+0000 7f553b7fe640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15d330 0x7f5524005120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f553a7fc640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f5524004820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f553000c210 tx=0x7f55240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8c052dc522787f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530005ad0 con 0x7f5524004350 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530005c50 con 0x7f5524004350 2023-11-27T22:30:25.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5539ffb640 1 -- 172.21.15.154:0/3524325660 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553002c8d0 con 0x7f5524004350 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5541287640 1 -- 172.21.15.154:0/3524325660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 msgr2=0x7f5524004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5541287640 1 --2- 172.21.15.154:0/3524325660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f5524004820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f553000c210 tx=0x7f55240057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f553b7fe640 1 -- 172.21.15.154:0/3524325660 reap_dead start 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5541287640 1 -- 172.21.15.154:0/3524325660 shutdown_connections 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.039+0000 7f5541287640 1 -- 172.21.15.154:0/3524325660 >> 172.21.15.154:0/3524325660 conn(0x7f553c072020 msgr2=0x7f553c072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.040+0000 7f5541287640 1 -- 172.21.15.154:0/3524325660 shutdown_connections 2023-11-27T22:30:25.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.040+0000 7f5541287640 1 -- 172.21.15.154:0/3524325660 wait complete. 2023-11-27T22:30:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.041+0000 7f5541287640 1 Processor -- start 2023-11-27T22:30:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.041+0000 7f5541287640 1 -- start start 2023-11-27T22:30:25.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f553c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c1f6bb0 0x7f553c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c0cb4d0 0x7f553c0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0ca330 con 0x7f5524004350 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c15e880 con 0x7f553c1f6bb0 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1f7030 con 0x7f553c0cb4d0 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f553c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f553c15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34340/0 (socket says 172.21.15.154:34340) 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 -- 172.21.15.154:0/1717300910 learned_addr learned my addr 172.21.15.154:0/1717300910 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 -- 172.21.15.154:0/1717300910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c0cb4d0 msgr2=0x7f553c0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c0cb4d0 0x7f553c0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 -- 172.21.15.154:0/1717300910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c1f6bb0 msgr2=0x7f553c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c1f6bb0 0x7f553c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 -- 172.21.15.154:0/1717300910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c15dfe0 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f553affd640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f553c15d920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f552c011920 tx=0x7f552c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c00fa90 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00fbf0 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c15e2c0 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c014440 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.042+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c15f2a0 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.043+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c069400 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.044+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f552c0145a0 con 0x7f5524004350 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.044+0000 7f55237fe640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552806b1f0 0x7f552806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.044+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f552c08a220 con 0x7f5524004350 2023-11-27T22:30:25.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.044+0000 7f553a7fc640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552806b1f0 0x7f552806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.045+0000 7f553a7fc640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552806b1f0 0x7f552806d6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5530034000 tx=0x7f5530007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.048+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f552c054ed0 con 0x7f5524004350 2023-11-27T22:30:25.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.216+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f553c0b7a50 con 0x7f5524004350 2023-11-27T22:30:25.220 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.217+0000 7f55237fe640 1 -- 172.21.15.154:0/1717300910 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7f552c0584f0 con 0x7f5524004350 2023-11-27T22:30:25.220 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:25.220 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:25.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552806b1f0 msgr2=0x7f552806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552806b1f0 0x7f552806d6b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5530034000 tx=0x7f5530007000 comp rx=0 tx=0).stop 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 msgr2=0x7f553c15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f553c15d920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f552c011920 tx=0x7f552c011de0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 shutdown_connections 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c1f6bb0 0x7f553c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552806b1f0 0x7f552806d6b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c0cb4d0 0x7f553c0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 --2- 172.21.15.154:0/1717300910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5524004350 0x7f553c15d920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 >> 172.21.15.154:0/1717300910 conn(0x7f553c072020 msgr2=0x7f553c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 shutdown_connections 2023-11-27T22:30:25.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.219+0000 7f5541287640 1 -- 172.21.15.154:0/1717300910 wait complete. 2023-11-27T22:30:25.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:25.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.333+0000 7f03e7cee640 1 Processor -- start 2023-11-27T22:30:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.333+0000 7f03e7cee640 1 -- start start 2023-11-27T22:30:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e7cee640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f03e00ceb70 0x7f03e00cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e7cee640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03e00b4370 0x7f03e00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.339 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e7cee640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e0071770 con 0x7f03e0144980 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e7cee640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e015ced0 con 0x7f03e00b4370 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e7cee640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e00b4ce0 con 0x7f03e00ceb70 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e5a8a640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f03e0144980 0x7f03e015c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60230/0 (socket says 172.21.15.154:60230) 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e5a8a640 1 -- 172.21.15.154:0/1421069751 learned_addr learned my addr 172.21.15.154:0/1421069751 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e628b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f03e00b4370 0x7f03e00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e5289640 1 --2- 172.21.15.154:0/1421069751 >> v2:172.21.15.194:3300/0 conn(0x7f03e00ceb70 0x7f03e00cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e628b640 1 -- 172.21.15.154:0/1421069751 >> v2:172.21.15.194:3300/0 conn(0x7f03e00ceb70 msgr2=0x7f03e00cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e628b640 1 --2- 172.21.15.154:0/1421069751 >> v2:172.21.15.194:3300/0 conn(0x7f03e00ceb70 0x7f03e00cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e628b640 1 -- 172.21.15.154:0/1421069751 >> v1:172.21.15.154:6789/0 conn(0x7f03e0144980 legacy=0x7f03e015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e4a88640 1 -- 172.21.15.154:0/1421069751 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533702662 0 0) 0x7f03e0071770 con 0x7f03e0144980 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.334+0000 7f03e628b640 1 -- 172.21.15.154:0/1421069751 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00ccdc0 con 0x7f03e00b4370 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.335+0000 7f03e628b640 1 --2- 172.21.15.154:0/1421069751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e00b4370 0x7f03e00b47a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f03e015b600 tx=0x7f03d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3955c52e76b2890d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.340 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.335+0000 7f03e4a88640 1 -- 172.21.15.154:0/1421069751 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d802cc80 con 0x7f03e00b4370 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.335+0000 7f03e4a88640 1 -- 172.21.15.154:0/1421069751 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d802cde0 con 0x7f03e00b4370 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.335+0000 7f03e4a88640 1 -- 172.21.15.154:0/1421069751 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8034660 con 0x7f03e00b4370 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 -- 172.21.15.154:0/1421069751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e00b4370 msgr2=0x7f03e00b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1421069751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e00b4370 0x7f03e00b47a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f03e015b600 tx=0x7f03d802bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 -- 172.21.15.154:0/1421069751 shutdown_connections 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1421069751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e00b4370 0x7f03e00b47a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1421069751 >> v2:172.21.15.194:3300/0 conn(0x7f03e00ceb70 0x7f03e00cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 -- 172.21.15.154:0/1421069751 >> 172.21.15.154:0/1421069751 conn(0x7f03e006a4d0 msgr2=0x7f03e006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 -- 172.21.15.154:0/1421069751 shutdown_connections 2023-11-27T22:30:25.341 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.336+0000 7f03e7cee640 1 -- 172.21.15.154:0/1421069751 wait complete. 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.337+0000 7f03e7cee640 1 Processor -- start 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.337+0000 7f03e7cee640 1 -- start start 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e00b4370 0x7f03e0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03e00ceb70 0x7f03e01f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 0x7f03e01f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00c9750 con 0x7f03e0144980 2023-11-27T22:30:25.344 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0155080 con 0x7f03e00b4370 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e00c8dd0 con 0x7f03e00ceb70 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 0x7f03e01f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 0x7f03e01f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34356/0 (socket says 172.21.15.154:34356) 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 -- 172.21.15.154:0/1095039323 learned_addr learned my addr 172.21.15.154:0/1095039323 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e5a8a640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e00b4370 0x7f03e0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e5289640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03e00ceb70 0x7f03e01f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 -- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03e00ceb70 msgr2=0x7f03e01f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03e00ceb70 0x7f03e01f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 -- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e00b4370 msgr2=0x7f03e0154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e00b4370 0x7f03e0154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 -- 172.21.15.154:0/1095039323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8009a70 con 0x7f03e0144980 2023-11-27T22:30:25.345 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e5a8a640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e00b4370 0x7f03e0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e628b640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 0x7f03e01f4500 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009e80 tx=0x7f03d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8040650 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d80407b0 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e015b8b0 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8040b60 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.338+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e00c9370 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.339+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e00c9890 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.340+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f03d8040cc0 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.340+0000 7f03d67fc640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f03c406b1c0 0x7f03c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.340+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f03d80ac8e0 con 0x7f03e0144980 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.340+0000 7f03e5a8a640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f03c406b1c0 0x7f03c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.346 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.341+0000 7f03e5a8a640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f03c406b1c0 0x7f03c406d680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03dc000f60 tx=0x7f03dc007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.344+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f03e00c9890 con 0x7f03e0144980 2023-11-27T22:30:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.509+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03e00c9890 con 0x7f03e0144980 2023-11-27T22:30:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.510+0000 7f03d67fc640 1 -- 172.21.15.154:0/1095039323 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03e00c9890 con 0x7f03e0144980 2023-11-27T22:30:25.513 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f03c406b1c0 msgr2=0x7f03c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f03c406b1c0 0x7f03c406d680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03dc000f60 tx=0x7f03dc007ca0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 msgr2=0x7f03e01f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 0x7f03e01f4500 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009e80 tx=0x7f03d8004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 shutdown_connections 2023-11-27T22:30:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f03c406b1c0 0x7f03c406d680 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f03e0144980 0x7f03e01f4500 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03e00ceb70 0x7f03e01f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 --2- 172.21.15.154:0/1095039323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e00b4370 0x7f03e0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 >> 172.21.15.154:0/1095039323 conn(0x7f03e006a4d0 msgr2=0x7f03e006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 shutdown_connections 2023-11-27T22:30:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.512+0000 7f03e7cee640 1 -- 172.21.15.154:0/1095039323 wait complete. 2023-11-27T22:30:25.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:25.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.626+0000 7f15b46ec640 1 Processor -- start 2023-11-27T22:30:25.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.626+0000 7f15b46ec640 1 -- start start 2023-11-27T22:30:25.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.627+0000 7f15b46ec640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f15ac15d330 0x7f15ac0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.627+0000 7f15b46ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac0d3900 0x7f15ac0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.627+0000 7f15b46ec640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0b2b10 con 0x7f15ac0d2910 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.627+0000 7f15b46ec640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0d1590 con 0x7f15ac15d330 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.627+0000 7f15b46ec640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0d1870 con 0x7f15ac0d3900 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2c89640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac0d3900 0x7f15ac0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b1c87640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f15ac0d2910 0x7f15ac0d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:33488/0 (socket says 172.21.15.154:33488) 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2488640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f15ac15d330 0x7f15ac0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b1c87640 1 -- 172.21.15.154:0/2503592281 learned_addr learned my addr 172.21.15.154:0/2503592281 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2488640 1 -- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac0d3900 msgr2=0x7f15ac0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2488640 1 --2- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac0d3900 0x7f15ac0b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2488640 1 -- 172.21.15.154:0/2503592281 >> v1:172.21.15.194:6789/0 conn(0x7f15ac0d2910 legacy=0x7f15ac0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2488640 1 -- 172.21.15.154:0/2503592281 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0d1b50 con 0x7f15ac15d330 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b1486640 1 -- 172.21.15.154:0/2503592281 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761941505 0 0) 0x7f15ac0b2b10 con 0x7f15ac0d2910 2023-11-27T22:30:25.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.628+0000 7f15b2c89640 1 --2- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac0d3900 0x7f15ac0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:25.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.629+0000 7f15b2488640 1 --2- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac15d330 0x7f15ac0b8b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f159c009d90 tx=0x7f159c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c603b14ba0ce3ded server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.629+0000 7f15b1486640 1 -- 172.21.15.154:0/2503592281 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c02cbc0 con 0x7f15ac15d330 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.629+0000 7f15b1486640 1 -- 172.21.15.154:0/2503592281 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c02cd20 con 0x7f15ac15d330 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.629+0000 7f15b1486640 1 -- 172.21.15.154:0/2503592281 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c034660 con 0x7f15ac15d330 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.629+0000 7f15b46ec640 1 -- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac15d330 msgr2=0x7f15ac0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.629+0000 7f15b46ec640 1 --2- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac15d330 0x7f15ac0b8b80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f159c009d90 tx=0x7f159c02be10 comp rx=0 tx=0).stop 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.630+0000 7f15b46ec640 1 -- 172.21.15.154:0/2503592281 shutdown_connections 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.630+0000 7f15b46ec640 1 --2- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac0d3900 0x7f15ac0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.630+0000 7f15b46ec640 1 --2- 172.21.15.154:0/2503592281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac15d330 0x7f15ac0b8b80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.630+0000 7f15b46ec640 1 -- 172.21.15.154:0/2503592281 >> 172.21.15.154:0/2503592281 conn(0x7f15ac072020 msgr2=0x7f15ac072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.630+0000 7f15b46ec640 1 -- 172.21.15.154:0/2503592281 shutdown_connections 2023-11-27T22:30:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.630+0000 7f15b46ec640 1 -- 172.21.15.154:0/2503592281 wait complete. 2023-11-27T22:30:25.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 Processor -- start 2023-11-27T22:30:25.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 -- start start 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac0d2910 0x7f15ac0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 0x7f15ac15d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac15d330 0x7f15ac15de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0cccc0 con 0x7f15ac0d3900 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c7d10 con 0x7f15ac0d2910 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.631+0000 7f15b46ec640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c73e0 con 0x7f15ac15d330 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 0x7f15ac15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 0x7f15ac15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34370/0 (socket says 172.21.15.154:34370) 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 -- 172.21.15.154:0/3342557364 learned_addr learned my addr 172.21.15.154:0/3342557364 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b2c89640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac15d330 0x7f15ac15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b2488640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac0d2910 0x7f15ac0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 -- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac15d330 msgr2=0x7f15ac15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac15d330 0x7f15ac15de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 -- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac0d2910 msgr2=0x7f15ac0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac0d2910 0x7f15ac0b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 -- 172.21.15.154:0/3342557364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009400 con 0x7f15ac0d3900 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b1c87640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 0x7f15ac15d920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c460 tx=0x7f15a000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00074e0 con 0x7f15ac0d3900 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0007660 con 0x7f15ac0d3900 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c009a70 con 0x7f15ac0d3900 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0004a20 con 0x7f15ac0d3900 2023-11-27T22:30:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.632+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0c79a0 con 0x7f15ac0d3900 2023-11-27T22:30:25.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.633+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac069400 con 0x7f15ac0d3900 2023-11-27T22:30:25.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.634+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f15a0004b80 con 0x7f15ac0d3900 2023-11-27T22:30:25.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.634+0000 7f15aaffd640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f159806b1c0 0x7f159806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.634+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f15a0088f50 con 0x7f15ac0d3900 2023-11-27T22:30:25.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.634+0000 7f15b2488640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f159806b1c0 0x7f159806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.635+0000 7f15b2488640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f159806b1c0 0x7f159806d680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f159c036000 tx=0x7f159c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.639+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f15a0053c00 con 0x7f15ac0d3900 2023-11-27T22:30:25.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.808+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15ac0d1170 con 0x7f15ac0d3900 2023-11-27T22:30:25.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.810+0000 7f15aaffd640 1 -- 172.21.15.154:0/3342557364 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15a00180a0 con 0x7f15ac0d3900 2023-11-27T22:30:25.812 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:25.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f159806b1c0 msgr2=0x7f159806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f159806b1c0 0x7f159806d680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f159c036000 tx=0x7f159c030000 comp rx=0 tx=0).stop 2023-11-27T22:30:25.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 msgr2=0x7f15ac15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 0x7f15ac15d920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c460 tx=0x7f15a000c920 comp rx=0 tx=0).stop 2023-11-27T22:30:25.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 shutdown_connections 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f159806b1c0 0x7f159806d680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15ac15d330 0x7f15ac15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15ac0d3900 0x7f15ac15d920 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 --2- 172.21.15.154:0/3342557364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f15ac0d2910 0x7f15ac0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 >> 172.21.15.154:0/3342557364 conn(0x7f15ac072020 msgr2=0x7f15ac072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 shutdown_connections 2023-11-27T22:30:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.812+0000 7f15b46ec640 1 -- 172.21.15.154:0/3342557364 wait complete. 2023-11-27T22:30:25.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.927+0000 7fb428890640 1 Processor -- start 2023-11-27T22:30:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.927+0000 7fb428890640 1 -- start start 2023-11-27T22:30:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb428890640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb42415d330 0x7fb4240b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb428890640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4240d3900 0x7fb4240b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb428890640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240b2b10 con 0x7fb4240d2910 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb428890640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240d1590 con 0x7fb42415d330 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb428890640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240d1870 con 0x7fb4240d3900 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb42259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb42415d330 0x7fb4240b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb421d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb4240d2910 0x7fb4240d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60238/0 (socket says 172.21.15.154:60238) 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb42259c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb42415d330 0x7fb4240b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34378/0 (socket says 172.21.15.154:34378) 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.928+0000 7fb421d9b640 1 -- 172.21.15.154:0/141856716 learned_addr learned my addr 172.21.15.154:0/141856716 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb422d9d640 1 --2- 172.21.15.154:0/141856716 >> v2:172.21.15.194:3300/0 conn(0x7fb4240d3900 0x7fb4240b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb42259c640 1 -- 172.21.15.154:0/141856716 >> v2:172.21.15.194:3300/0 conn(0x7fb4240d3900 msgr2=0x7fb4240b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb42259c640 1 --2- 172.21.15.154:0/141856716 >> v2:172.21.15.194:3300/0 conn(0x7fb4240d3900 0x7fb4240b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb42259c640 1 -- 172.21.15.154:0/141856716 >> v1:172.21.15.154:6789/0 conn(0x7fb4240d2910 legacy=0x7fb4240d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb42259c640 1 -- 172.21.15.154:0/141856716 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240d1b50 con 0x7fb42415d330 2023-11-27T22:30:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb42159a640 1 -- 172.21.15.154:0/141856716 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474886594 0 0) 0x7fb4240b2b10 con 0x7fb4240d2910 2023-11-27T22:30:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb422d9d640 1 --2- 172.21.15.154:0/141856716 >> v2:172.21.15.194:3300/0 conn(0x7fb4240d3900 0x7fb4240b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:25.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.929+0000 7fb42259c640 1 --2- 172.21.15.154:0/141856716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42415d330 0x7fb4240b8b80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb42406c500 tx=0x7fb41402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9395e0825b6f744 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.934 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb42159a640 1 -- 172.21.15.154:0/141856716 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41402cbf0 con 0x7fb42415d330 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb42159a640 1 -- 172.21.15.154:0/141856716 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41402cd50 con 0x7fb42415d330 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb42159a640 1 -- 172.21.15.154:0/141856716 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414034660 con 0x7fb42415d330 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 -- 172.21.15.154:0/141856716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42415d330 msgr2=0x7fb4240b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 --2- 172.21.15.154:0/141856716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42415d330 0x7fb4240b8b80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb42406c500 tx=0x7fb41402be40 comp rx=0 tx=0).stop 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 -- 172.21.15.154:0/141856716 shutdown_connections 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 --2- 172.21.15.154:0/141856716 >> v2:172.21.15.194:3300/0 conn(0x7fb4240d3900 0x7fb4240b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 --2- 172.21.15.154:0/141856716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb42415d330 0x7fb4240b8b80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 -- 172.21.15.154:0/141856716 >> 172.21.15.154:0/141856716 conn(0x7fb424072020 msgr2=0x7fb424072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 -- 172.21.15.154:0/141856716 shutdown_connections 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.930+0000 7fb428890640 1 -- 172.21.15.154:0/141856716 wait complete. 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.931+0000 7fb428890640 1 Processor -- start 2023-11-27T22:30:25.935 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 -- start start 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 0x7fb424155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4240d3900 0x7fb42415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb42415d330 0x7fb4241f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424155780 con 0x7fb4240d2910 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42415ec10 con 0x7fb4240d3900 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb428890640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42415eef0 con 0x7fb42415d330 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb42259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 0x7fb424155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb42259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 0x7fb424155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34388/0 (socket says 172.21.15.154:34388) 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.932+0000 7fb42259c640 1 -- 172.21.15.154:0/1644346652 learned_addr learned my addr 172.21.15.154:0/1644346652 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:25.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb421d9b640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4240d3900 0x7fb42415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb422d9d640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb42415d330 0x7fb4241f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb42259c640 1 -- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb42415d330 msgr2=0x7fb4241f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb42259c640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb42415d330 0x7fb4241f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb42259c640 1 -- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4240d3900 msgr2=0x7fb42415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb42259c640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4240d3900 0x7fb42415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb42259c640 1 -- 172.21.15.154:0/1644346652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb414009a70 con 0x7fb4240d2910 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb422d9d640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb42415d330 0x7fb4241f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb42259c640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 0x7fb424155240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb414037040 tx=0x7fb414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414040650 con 0x7fb4240d2910 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4140407b0 con 0x7fb4240d2910 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42415f1d0 con 0x7fb4240d2910 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414040b60 con 0x7fb4240d2910 2023-11-27T22:30:25.939 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.933+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42415f820 con 0x7fb4240d2910 2023-11-27T22:30:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.934+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4240c6a10 con 0x7fb4240d2910 2023-11-27T22:30:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.934+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb414040cc0 con 0x7fb4240d2910 2023-11-27T22:30:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.935+0000 7fb412ffd640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb40406b1c0 0x7fb40406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.935+0000 7fb421d9b640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb40406b1c0 0x7fb40406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.935+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fb4140acab0 con 0x7fb4240d2910 2023-11-27T22:30:25.940 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.935+0000 7fb421d9b640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb40406b1c0 0x7fb40406d680 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb4240b1f90 tx=0x7fb418007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:25.939+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb414077630 con 0x7fb4240d2910 2023-11-27T22:30:26.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.106+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb424069400 con 0x7fb4240d2910 2023-11-27T22:30:26.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.106+0000 7fb412ffd640 1 -- 172.21.15.154:0/1644346652 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb414044020 con 0x7fb4240d2910 2023-11-27T22:30:26.109 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:26.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb40406b1c0 msgr2=0x7fb40406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb40406b1c0 0x7fb40406d680 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb4240b1f90 tx=0x7fb418007de0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 msgr2=0x7fb424155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 0x7fb424155240 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb414037040 tx=0x7fb414004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 shutdown_connections 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4240d3900 0x7fb42415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb40406b1c0 0x7fb40406d680 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb42415d330 0x7fb4241f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 --2- 172.21.15.154:0/1644346652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4240d2910 0x7fb424155240 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 >> 172.21.15.154:0/1644346652 conn(0x7fb424072020 msgr2=0x7fb424072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.108+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 shutdown_connections 2023-11-27T22:30:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.109+0000 7fb428890640 1 -- 172.21.15.154:0/1644346652 wait complete. 2023-11-27T22:30:26.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.220+0000 7f504c036640 1 Processor -- start 2023-11-27T22:30:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.220+0000 7f504c036640 1 -- start start 2023-11-27T22:30:26.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f504c036640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 0x7f50440c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f504c036640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f50440c63c0 0x7f504415f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f504c036640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50440c7ee0 con 0x7f504415bbe0 2023-11-27T22:30:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f504c036640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50440cf330 con 0x7f50440c63c0 2023-11-27T22:30:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f504c036640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50440c7920 con 0x7f50440cebb0 2023-11-27T22:30:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f5049dd2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f504415bbe0 0x7f504415bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60252/0 (socket says 172.21.15.154:60252) 2023-11-27T22:30:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.221+0000 7f5049dd2640 1 -- 172.21.15.154:0/2589688787 learned_addr learned my addr 172.21.15.154:0/2589688787 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f50495d1640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 0x7f50440c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 --2- 172.21.15.154:0/2589688787 >> v2:172.21.15.194:3300/0 conn(0x7f50440c63c0 0x7f504415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197092101 0 0) 0x7f50440c7ee0 con 0x7f504415bbe0 2023-11-27T22:30:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5030003520 con 0x7f504415bbe0 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028577540 0 0) 0x7f5030003520 con 0x7f504415bbe0 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 msgr2=0x7f50440c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 0x7f50440c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 >> v2:172.21.15.194:3300/0 conn(0x7f50440c63c0 msgr2=0x7f504415f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 --2- 172.21.15.154:0/2589688787 >> v2:172.21.15.194:3300/0 conn(0x7f50440c63c0 0x7f504415f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440c7c00 con 0x7f504415bbe0 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f50400019f0 con 0x7f504415bbe0 2023-11-27T22:30:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 >> v1:172.21.15.154:6789/0 conn(0x7f504415bbe0 legacy=0x7f504415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5030003970 0x7f5030003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 0x7f50300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5030004d00 0x7f5030005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440cf330 con 0x7f5030004d00 2023-11-27T22:30:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440c7920 con 0x7f5030003970 2023-11-27T22:30:26.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503000b980 con 0x7f50440cebb0 2023-11-27T22:30:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5030004d00 0x7f5030005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f5049dd2640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5030003970 0x7f5030003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f50495d1640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 0x7f50300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 -- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 msgr2=0x7f50300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50440cebb0 0x7f50300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 -- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5030003970 msgr2=0x7f5030003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5030003970 0x7f5030003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.222+0000 7f504a5d3640 1 -- 172.21.15.154:0/2589688787 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030003520 con 0x7f5030004d00 2023-11-27T22:30:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.223+0000 7f504a5d3640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5030004d00 0x7f5030005180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f503c009ac0 tx=0x7f50300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23993ee1b57a397f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.223+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c03b400 con 0x7f5030004d00 2023-11-27T22:30:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.223+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c037050 con 0x7f5030004d00 2023-11-27T22:30:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.223+0000 7f5048dd0640 1 -- 172.21.15.154:0/2589688787 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c03b580 con 0x7f5030004d00 2023-11-27T22:30:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504c036640 1 -- 172.21.15.154:0/2589688787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5030004d00 msgr2=0x7f5030005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504c036640 1 --2- 172.21.15.154:0/2589688787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5030004d00 0x7f5030005180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f503c009ac0 tx=0x7f50300057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504a5d3640 1 -- 172.21.15.154:0/2589688787 reap_dead start 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504c036640 1 -- 172.21.15.154:0/2589688787 shutdown_connections 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504c036640 1 -- 172.21.15.154:0/2589688787 >> 172.21.15.154:0/2589688787 conn(0x7f50440b2c10 msgr2=0x7f50440b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504c036640 1 -- 172.21.15.154:0/2589688787 shutdown_connections 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.224+0000 7f504c036640 1 -- 172.21.15.154:0/2589688787 wait complete. 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.225+0000 7f504c036640 1 Processor -- start 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.225+0000 7f504c036640 1 -- start start 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50441538e0 0x7f504415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5044153cc0 0x7f50440c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 0x7f5044150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440b3fa0 con 0x7f504415bfc0 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504415d000 con 0x7f5044153cc0 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504415c760 con 0x7f50441538e0 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 0x7f5044150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 0x7f5044150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34402/0 (socket says 172.21.15.154:34402) 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 -- 172.21.15.154:0/3036659310 learned_addr learned my addr 172.21.15.154:0/3036659310 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f50495d1640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5044153cc0 0x7f50440c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f5049dd2640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50441538e0 0x7f504415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 -- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50441538e0 msgr2=0x7f504415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50441538e0 0x7f504415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 -- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5044153cc0 msgr2=0x7f50440c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5044153cc0 0x7f50440c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 -- 172.21.15.154:0/3036659310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504415ca40 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f5049dd2640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50441538e0 0x7f504415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504a5d3640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 0x7f5044150990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f503c009ac0 tx=0x7f503c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c003a20 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c003b80 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c045410 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.226+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504415cd20 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.227+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5044150ed0 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.228+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50440b3a20 con 0x7f504415bfc0 2023-11-27T22:30:26.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.228+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f503c042070 con 0x7f504415bfc0 2023-11-27T22:30:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.228+0000 7f503a7fc640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f502806b1c0 0x7f502806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.228+0000 7f5049dd2640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f502806b1c0 0x7f502806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.228+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f503c000e40 con 0x7f504415bfc0 2023-11-27T22:30:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.229+0000 7f5049dd2640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f502806b1c0 0x7f502806d680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5044070ea0 tx=0x7f5040006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.233+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f503c07e520 con 0x7f504415bfc0 2023-11-27T22:30:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.412+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50440b3c80 con 0x7f504415bfc0 2023-11-27T22:30:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.412+0000 7f503a7fc640 1 -- 172.21.15.154:0/3036659310 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f503c081b40 con 0x7f504415bfc0 2023-11-27T22:30:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f502806b1c0 msgr2=0x7f502806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f502806b1c0 0x7f502806d680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5044070ea0 tx=0x7f5040006040 comp rx=0 tx=0).stop 2023-11-27T22:30:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 msgr2=0x7f5044150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 0x7f5044150990 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f503c009ac0 tx=0x7f503c004730 comp rx=0 tx=0).stop 2023-11-27T22:30:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 shutdown_connections 2023-11-27T22:30:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5044153cc0 0x7f50440c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f502806b1c0 0x7f502806d680 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f504415bfc0 0x7f5044150990 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 --2- 172.21.15.154:0/3036659310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50441538e0 0x7f504415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 >> 172.21.15.154:0/3036659310 conn(0x7f50440b2c10 msgr2=0x7f504406c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 shutdown_connections 2023-11-27T22:30:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.414+0000 7f504c036640 1 -- 172.21.15.154:0/3036659310 wait complete. 2023-11-27T22:30:26.428 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-27T22:30:26.428 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T22:30:26.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:26.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.544+0000 7fe20227c640 1 Processor -- start 2023-11-27T22:30:26.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 -- start start 2023-11-27T22:30:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe1fc143490 0x7fe1fc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1fc15a4e0 0x7fe1fc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc15b520 con 0x7fe1fc15a4e0 2023-11-27T22:30:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc143870 con 0x7fe1fc143490 2023-11-27T22:30:26.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe20227c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15e2a0 con 0x7fe1fc15e730 2023-11-27T22:30:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.545+0000 7fe200819640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1fc15a4e0 0x7fe1fc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1fc15a4e0 0x7fe1fc15a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34416/0 (socket says 172.21.15.154:34416) 2023-11-27T22:30:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 -- 172.21.15.154:0/2487236940 learned_addr learned my addr 172.21.15.154:0/2487236940 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe1fbfff640 1 --2- 172.21.15.154:0/2487236940 >> v2:172.21.15.194:3300/0 conn(0x7fe1fc143490 0x7fe1fc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 -- 172.21.15.154:0/2487236940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 msgr2=0x7fe1fc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe1fb7fe640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 -- 172.21.15.154:0/2487236940 >> v2:172.21.15.194:3300/0 conn(0x7fe1fc143490 msgr2=0x7fe1fc0b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 --2- 172.21.15.154:0/2487236940 >> v2:172.21.15.194:3300/0 conn(0x7fe1fc143490 0x7fe1fc0b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe200819640 1 -- 172.21.15.154:0/2487236940 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc15b240 con 0x7fe1fc15a4e0 2023-11-27T22:30:26.552 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe1fbfff640 1 --2- 172.21.15.154:0/2487236940 >> v2:172.21.15.194:3300/0 conn(0x7fe1fc143490 0x7fe1fc0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.546+0000 7fe1fb7fe640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe200819640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc15a970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc06e620 tx=0x7fe1f402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efcacd5e17c2b5b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe1faffd640 1 -- 172.21.15.154:0/2487236940 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f402ea80 con 0x7fe1fc15a4e0 2023-11-27T22:30:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe1faffd640 1 -- 172.21.15.154:0/2487236940 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f402ebe0 con 0x7fe1fc15a4e0 2023-11-27T22:30:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe1faffd640 1 -- 172.21.15.154:0/2487236940 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4009600 con 0x7fe1fc15a4e0 2023-11-27T22:30:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 -- 172.21.15.154:0/2487236940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc15a4e0 msgr2=0x7fe1fc15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc15a970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc06e620 tx=0x7fe1f402e0e0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 -- 172.21.15.154:0/2487236940 shutdown_connections 2023-11-27T22:30:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc15a970 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 --2- 172.21.15.154:0/2487236940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.554 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 --2- 172.21.15.154:0/2487236940 >> v2:172.21.15.194:3300/0 conn(0x7fe1fc143490 0x7fe1fc0b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 -- 172.21.15.154:0/2487236940 >> 172.21.15.154:0/2487236940 conn(0x7fe1fc06a4d0 msgr2=0x7fe1fc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 -- 172.21.15.154:0/2487236940 shutdown_connections 2023-11-27T22:30:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.547+0000 7fe20227c640 1 -- 172.21.15.154:0/2487236940 wait complete. 2023-11-27T22:30:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.548+0000 7fe20227c640 1 Processor -- start 2023-11-27T22:30:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 -- start start 2023-11-27T22:30:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 0x7fe1fc13ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc0a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc142a20 con 0x7fe1fc143490 2023-11-27T22:30:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0a8a10 con 0x7fe1fc15a4e0 2023-11-27T22:30:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe20227c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc13f1c0 con 0x7fe1fc15e730 2023-11-27T22:30:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe1fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 0x7fe1fc13ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe1fbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 0x7fe1fc13ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34420/0 (socket says 172.21.15.154:34420) 2023-11-27T22:30:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.549+0000 7fe1fbfff640 1 -- 172.21.15.154:0/193292201 learned_addr learned my addr 172.21.15.154:0/193292201 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:26.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fb7fe640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc0a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe200819640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fbfff640 1 -- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 msgr2=0x7fe1fc1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fbfff640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fbfff640 1 -- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc15a4e0 msgr2=0x7fe1fc0a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fbfff640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc0a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fbfff640 1 -- 172.21.15.154:0/193292201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f400bd40 con 0x7fe1fc143490 2023-11-27T22:30:26.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1fbfff640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 0x7fe1fc13ddf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c7f0 tx=0x7fe1ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0079d0 con 0x7fe1fc143490 2023-11-27T22:30:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec007b30 con 0x7fe1fc143490 2023-11-27T22:30:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc1423d0 con 0x7fe1fc143490 2023-11-27T22:30:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00ce40 con 0x7fe1fc143490 2023-11-27T22:30:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.550+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc13ee90 con 0x7fe1fc143490 2023-11-27T22:30:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.551+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc1421f0 con 0x7fe1fc143490 2023-11-27T22:30:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.552+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe1ec0113f0 con 0x7fe1fc143490 2023-11-27T22:30:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.552+0000 7fe1f8ff9640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e806b1f0 0x7fe1e806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.552+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fe1ec089c10 con 0x7fe1fc143490 2023-11-27T22:30:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.552+0000 7fe1fb7fe640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e806b1f0 0x7fe1e806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.552+0000 7fe1fb7fe640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e806b1f0 0x7fe1e806d6b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b1a90 tx=0x7fe1f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.556+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe1ec054830 con 0x7fe1fc143490 2023-11-27T22:30:26.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.725+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1fc069400 con 0x7fe1fc143490 2023-11-27T22:30:26.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.726+0000 7fe1f8ff9640 1 -- 172.21.15.154:0/193292201 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7fe1ec01f090 con 0x7fe1fc143490 2023-11-27T22:30:26.730 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:26.730 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:26.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e806b1f0 msgr2=0x7fe1e806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e806b1f0 0x7fe1e806d6b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0b1a90 tx=0x7fe1f0008040 comp rx=0 tx=0).stop 2023-11-27T22:30:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 msgr2=0x7fe1fc13ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 0x7fe1fc13ddf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00c7f0 tx=0x7fe1ec00cbf0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 shutdown_connections 2023-11-27T22:30:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1fc15a4e0 0x7fe1fc0a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe1e806b1f0 0x7fe1e806d6b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe1fc15e730 0x7fe1fc1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 --2- 172.21.15.154:0/193292201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1fc143490 0x7fe1fc13ddf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 >> 172.21.15.154:0/193292201 conn(0x7fe1fc06a4d0 msgr2=0x7fe1fc0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.728+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 shutdown_connections 2023-11-27T22:30:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.729+0000 7fe20227c640 1 -- 172.21.15.154:0/193292201 wait complete. 2023-11-27T22:30:26.742 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:26.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.845+0000 7fcfd2f53640 1 Processor -- start 2023-11-27T22:30:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.845+0000 7fcfd2f53640 1 -- start start 2023-11-27T22:30:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd2f53640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfcc143490 0x7fcfcc0b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd2f53640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd2f53640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcfcc15a4e0 0x7fcfcc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd2f53640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc15b520 con 0x7fcfcc143490 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd2f53640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc143870 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd2f53640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc15e2a0 con 0x7fcfcc15e730 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfcc143490 0x7fcfcc0b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcfcc143490 0x7fcfcc0b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34422/0 (socket says 172.21.15.154:34422) 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 -- 172.21.15.154:0/2452423954 learned_addr learned my addr 172.21.15.154:0/2452423954 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd14f0640 1 --2- 172.21.15.154:0/2452423954 >> v2:172.21.15.194:3300/0 conn(0x7fcfcc15a4e0 0x7fcfcc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfcbfff640 1 --2- 172.21.15.154:0/2452423954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 -- 172.21.15.154:0/2452423954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 msgr2=0x7fcfcc0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 --2- 172.21.15.154:0/2452423954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc0b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 -- 172.21.15.154:0/2452423954 >> v2:172.21.15.194:3300/0 conn(0x7fcfcc15a4e0 msgr2=0x7fcfcc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 --2- 172.21.15.154:0/2452423954 >> v2:172.21.15.194:3300/0 conn(0x7fcfcc15a4e0 0x7fcfcc15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd0cef640 1 -- 172.21.15.154:0/2452423954 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc15b240 con 0x7fcfcc143490 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.846+0000 7fcfd14f0640 1 --2- 172.21.15.154:0/2452423954 >> v2:172.21.15.194:3300/0 conn(0x7fcfcc15a4e0 0x7fcfcc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.847+0000 7fcfd0cef640 1 --2- 172.21.15.154:0/2452423954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc143490 0x7fcfcc0b0cf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc15eb90 tx=0x7fcfc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7d0286406dfb9d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.847+0000 7fcfcb7fe640 1 -- 172.21.15.154:0/2452423954 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0031870 con 0x7fcfcc143490 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.847+0000 7fcfcb7fe640 1 -- 172.21.15.154:0/2452423954 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc00319d0 con 0x7fcfcc143490 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.847+0000 7fcfcb7fe640 1 -- 172.21.15.154:0/2452423954 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0031d60 con 0x7fcfcc143490 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 -- 172.21.15.154:0/2452423954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc143490 msgr2=0x7fcfcc0b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/2452423954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc143490 0x7fcfcc0b0cf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc15eb90 tx=0x7fcfc002b910 comp rx=0 tx=0).stop 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 -- 172.21.15.154:0/2452423954 shutdown_connections 2023-11-27T22:30:26.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/2452423954 >> v2:172.21.15.194:3300/0 conn(0x7fcfcc15a4e0 0x7fcfcc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/2452423954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/2452423954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc143490 0x7fcfcc0b0cf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 -- 172.21.15.154:0/2452423954 >> 172.21.15.154:0/2452423954 conn(0x7fcfcc06a4d0 msgr2=0x7fcfcc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 -- 172.21.15.154:0/2452423954 shutdown_connections 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.848+0000 7fcfd2f53640 1 -- 172.21.15.154:0/2452423954 wait complete. 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.849+0000 7fcfd2f53640 1 Processor -- start 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.849+0000 7fcfd2f53640 1 -- start start 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfcc143490 0x7fcfcc159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 0x7fcfcc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc13d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc159fa0 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc13d020 con 0x7fcfcc143490 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc15cb30 con 0x7fcfcc15e730 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 0x7fcfcc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 0x7fcfcc15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34432/0 (socket says 172.21.15.154:34432) 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 -- 172.21.15.154:0/3407857940 learned_addr learned my addr 172.21.15.154:0/3407857940 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 -- 172.21.15.154:0/3407857940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 msgr2=0x7fcfcc13d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc13d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 -- 172.21.15.154:0/3407857940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfcc143490 msgr2=0x7fcfcc159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfcc143490 0x7fcfcc159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 -- 172.21.15.154:0/3407857940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00094d0 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfcbfff640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 0x7fcfcc15c070 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d5f0 tx=0x7fcfb800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80125f0 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8012750 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc15ce10 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8012b00 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.850+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc15d3d0 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.851+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc069400 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.852+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcfb8012c60 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.852+0000 7fcfc97fa640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcfb006b1c0 0x7fcfb006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.852+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fcfb8089f50 con 0x7fcfcc15a4e0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.852+0000 7fcfd0cef640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcfb006b1c0 0x7fcfb006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:26.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.853+0000 7fcfd0cef640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcfb006b1c0 0x7fcfb006d680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0036000 tx=0x7fcfc0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:26.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:26.857+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcfb8054b70 con 0x7fcfcc15a4e0 2023-11-27T22:30:27.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.022+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfcc0b2820 con 0x7fcfcc15a4e0 2023-11-27T22:30:27.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.022+0000 7fcfc97fa640 1 -- 172.21.15.154:0/3407857940 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfb8058190 con 0x7fcfcc15a4e0 2023-11-27T22:30:27.025 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:27.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcfb006b1c0 msgr2=0x7fcfb006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcfb006b1c0 0x7fcfb006d680 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0036000 tx=0x7fcfc0030000 comp rx=0 tx=0).stop 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 msgr2=0x7fcfcc15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 0x7fcfcc15c070 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800d5f0 tx=0x7fcfb800dab0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 shutdown_connections 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcfb006b1c0 0x7fcfb006d680 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcfcc15e730 0x7fcfcc13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfcc15a4e0 0x7fcfcc15c070 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 --2- 172.21.15.154:0/3407857940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcfcc143490 0x7fcfcc159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 >> 172.21.15.154:0/3407857940 conn(0x7fcfcc06a4d0 msgr2=0x7fcfcc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 shutdown_connections 2023-11-27T22:30:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.024+0000 7fcfd2f53640 1 -- 172.21.15.154:0/3407857940 wait complete. 2023-11-27T22:30:27.038 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.137+0000 7f2aaad25640 1 Processor -- start 2023-11-27T22:30:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aaad25640 1 -- start start 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aaad25640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 0x7f2aa40d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aaad25640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40b2b10 con 0x7f2aa40d3730 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aaad25640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa40d3b50 con 0x7f2aa415d330 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aaad25640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40d1590 con 0x7f2aa40d2910 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aa92c2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2aa40d3730 0x7f2aa40b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60266/0 (socket says 172.21.15.154:60266) 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.138+0000 7f2aa92c2640 1 -- 172.21.15.154:0/3804924091 learned_addr learned my addr 172.21.15.154:0/3804924091 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 0x7f2aa40d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354996784 0 0) 0x7f2aa40b2b10 con 0x7f2aa40d3730 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a94003520 con 0x7f2aa40d3730 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 578953647 0 0) 0x7f2a94003520 con 0x7f2aa40d3730 2023-11-27T22:30:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 msgr2=0x7f2aa40d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 0x7f2aa40d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 >> v1:172.21.15.194:6789/0 conn(0x7f2aa415d330 legacy=0x7f2aa40b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40d1870 con 0x7f2aa40d3730 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f2a9c0019f0 con 0x7f2aa40d3730 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 >> v1:172.21.15.154:6789/0 conn(0x7f2aa40d3730 legacy=0x7f2aa40b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a940039a0 0x7f2a94003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94004350 0x7f2a94004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 0x7f2a94005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40d1590 con 0x7f2a94004350 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9400ba60 con 0x7f2a940039a0 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9400bc20 con 0x7f2aa40d2910 2023-11-27T22:30:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94004350 0x7f2a94004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa8ac1640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a940039a0 0x7f2a94003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa92c2640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 0x7f2a94005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 -- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 msgr2=0x7f2a94005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2aa40d2910 0x7f2a94005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 -- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a940039a0 msgr2=0x7f2a94003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a940039a0 0x7f2a94003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.139+0000 7f2aa3fff640 1 -- 172.21.15.154:0/3804924091 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94003520 con 0x7f2a94004350 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.140+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94004350 0x7f2a94004820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009ac0 tx=0x7f2a940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3fe235853b2065 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.140+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9002c6b0 con 0x7f2a94004350 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.140+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9002c810 con 0x7f2a94004350 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.140+0000 7f2aa37fe640 1 -- 172.21.15.154:0/3804924091 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9002cba0 con 0x7f2a94004350 2023-11-27T22:30:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aaad25640 1 -- 172.21.15.154:0/3804924091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94004350 msgr2=0x7f2a94004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aaad25640 1 --2- 172.21.15.154:0/3804924091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a94004350 0x7f2a94004820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009ac0 tx=0x7f2a940057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aa92c2640 1 -- 172.21.15.154:0/3804924091 reap_dead start 2023-11-27T22:30:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aaad25640 1 -- 172.21.15.154:0/3804924091 shutdown_connections 2023-11-27T22:30:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aaad25640 1 -- 172.21.15.154:0/3804924091 >> 172.21.15.154:0/3804924091 conn(0x7f2aa4072020 msgr2=0x7f2aa4072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aaad25640 1 -- 172.21.15.154:0/3804924091 shutdown_connections 2023-11-27T22:30:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.141+0000 7f2aaad25640 1 -- 172.21.15.154:0/3804924091 wait complete. 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.142+0000 7f2aaad25640 1 Processor -- start 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.142+0000 7f2aaad25640 1 -- start start 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aaad25640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a94004350 0x7f2aa41f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aaad25640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4153a70 0x7f2aa415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aaad25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 0x7f2aa40caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aaad25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40ca330 con 0x7f2aa40cab10 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aaad25640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa41f3920 con 0x7f2aa4153a70 2023-11-27T22:30:27.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aaad25640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa41f3c00 con 0x7f2a94004350 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 0x7f2aa40caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 0x7f2aa40caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34452/0 (socket says 172.21.15.154:34452) 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 -- 172.21.15.154:0/898639605 learned_addr learned my addr 172.21.15.154:0/898639605 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4153a70 0x7f2aa415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa8ac1640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a94004350 0x7f2aa41f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 -- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a94004350 msgr2=0x7f2aa41f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a94004350 0x7f2aa41f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 -- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4153a70 msgr2=0x7f2aa415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4153a70 0x7f2aa415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 -- 172.21.15.154:0/898639605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa41f3ee0 con 0x7f2aa40cab10 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa3fff640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4153a70 0x7f2aa415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.143+0000 7f2aa92c2640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 0x7f2aa40caf90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2aa406b9f0 tx=0x7f2a9c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.144+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00ab90 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.144+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00acf0 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.144+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa40ca5f0 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.144+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c013610 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.144+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa415f350 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.145+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40ca7e0 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.145+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2a9c013770 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.145+0000 7f2aa17fa640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2a8806b1c0 0x7f2a8806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.145+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f2a9c08a1b0 con 0x7f2aa40cab10 2023-11-27T22:30:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.145+0000 7f2aa8ac1640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2a8806b1c0 0x7f2a8806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.146+0000 7f2aa8ac1640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2a8806b1c0 0x7f2a8806d680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2a98000c00 tx=0x7f2a98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.150+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2a9c054dd0 con 0x7f2aa40cab10 2023-11-27T22:30:27.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.315+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2aa4069400 con 0x7f2aa40cab10 2023-11-27T22:30:27.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.315+0000 7f2aa17fa640 1 -- 172.21.15.154:0/898639605 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a9c00ae60 con 0x7f2aa40cab10 2023-11-27T22:30:27.318 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2a8806b1c0 msgr2=0x7f2a8806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2a8806b1c0 0x7f2a8806d680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2a98000c00 tx=0x7f2a98009040 comp rx=0 tx=0).stop 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 msgr2=0x7f2aa40caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 0x7f2aa40caf90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2aa406b9f0 tx=0x7f2a9c007bd0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 shutdown_connections 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2aa4153a70 0x7f2aa415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2a8806b1c0 0x7f2a8806d680 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aa40cab10 0x7f2aa40caf90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 --2- 172.21.15.154:0/898639605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a94004350 0x7f2aa41f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 >> 172.21.15.154:0/898639605 conn(0x7f2aa4072020 msgr2=0x7f2aa40c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 shutdown_connections 2023-11-27T22:30:27.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.317+0000 7f2aaad25640 1 -- 172.21.15.154:0/898639605 wait complete. 2023-11-27T22:30:27.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:27.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.431+0000 7f151d1b0640 1 Processor -- start 2023-11-27T22:30:27.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.431+0000 7f151d1b0640 1 -- start start 2023-11-27T22:30:27.528 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151d1b0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15180ad640 0x7f151806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151d1b0640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f151806bbf0 0x7f151806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151d1b0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151815d720 con 0x7f151815d340 2023-11-27T22:30:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151d1b0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180adae0 con 0x7f15180ad640 2023-11-27T22:30:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151d1b0640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180addc0 con 0x7f151806bbf0 2023-11-27T22:30:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15180ad640 0x7f151806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f15180ad640 0x7f151806d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34468/0 (socket says 172.21.15.154:34468) 2023-11-27T22:30:27.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 -- 172.21.15.154:0/2673457196 learned_addr learned my addr 172.21.15.154:0/2673457196 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:27.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151759e640 1 --2- 172.21.15.154:0/2673457196 >> v2:172.21.15.194:3300/0 conn(0x7f151806bbf0 0x7f151806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 -- 172.21.15.154:0/2673457196 >> v2:172.21.15.194:3300/0 conn(0x7f151806bbf0 msgr2=0x7f151806d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:27.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 --2- 172.21.15.154:0/2673457196 >> v2:172.21.15.194:3300/0 conn(0x7f151806bbf0 0x7f151806d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.530 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 -- 172.21.15.154:0/2673457196 >> v1:172.21.15.194:6789/0 conn(0x7f151815d340 legacy=0x7f151806b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:27.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.432+0000 7f151659c640 1 -- 172.21.15.154:0/2673457196 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180ae0a0 con 0x7f15180ad640 2023-11-27T22:30:27.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.433+0000 7f151659c640 1 --2- 172.21.15.154:0/2673457196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15180ad640 0x7f151806d0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15180b3d20 tx=0x7f150c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64bf53ad075805c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.433+0000 7f1515d9b640 1 -- 172.21.15.154:0/2673457196 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c031870 con 0x7f15180ad640 2023-11-27T22:30:27.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.433+0000 7f1515d9b640 1 -- 172.21.15.154:0/2673457196 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150c0319d0 con 0x7f15180ad640 2023-11-27T22:30:27.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.433+0000 7f1515d9b640 1 -- 172.21.15.154:0/2673457196 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150c031d60 con 0x7f15180ad640 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 -- 172.21.15.154:0/2673457196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15180ad640 msgr2=0x7f151806d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 --2- 172.21.15.154:0/2673457196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15180ad640 0x7f151806d0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15180b3d20 tx=0x7f150c02b910 comp rx=0 tx=0).stop 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 -- 172.21.15.154:0/2673457196 shutdown_connections 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 --2- 172.21.15.154:0/2673457196 >> v2:172.21.15.194:3300/0 conn(0x7f151806bbf0 0x7f151806d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 --2- 172.21.15.154:0/2673457196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15180ad640 0x7f151806d0b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 -- 172.21.15.154:0/2673457196 >> 172.21.15.154:0/2673457196 conn(0x7f1518070e70 msgr2=0x7f1518071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 -- 172.21.15.154:0/2673457196 shutdown_connections 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.434+0000 7f151d1b0640 1 -- 172.21.15.154:0/2673457196 wait complete. 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.435+0000 7f151d1b0640 1 Processor -- start 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.435+0000 7f151d1b0640 1 -- start start 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151d1b0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 0x7f1518150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151d1b0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15180ad640 0x7f151815f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151d1b0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f151815d340 0x7f1518151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151d1b0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180cdb40 con 0x7f151806bbf0 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151d1b0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151815ffa0 con 0x7f151815d340 2023-11-27T22:30:27.533 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151d1b0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518160280 con 0x7f15180ad640 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 0x7f1518150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 0x7f1518150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34484/0 (socket says 172.21.15.154:34484) 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 -- 172.21.15.154:0/3107407676 learned_addr learned my addr 172.21.15.154:0/3107407676 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f151759e640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f151815d340 0x7f1518151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 -- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15180ad640 msgr2=0x7f151815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15180ad640 0x7f151815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.534 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 -- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f151815d340 msgr2=0x7f1518151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f151815d340 0x7f1518151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.436+0000 7f1516d9d640 1 -- 172.21.15.154:0/3107407676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150c0094d0 con 0x7f151806bbf0 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.437+0000 7f1516d9d640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 0x7f1518150de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f150800ba50 tx=0x7f150800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.437+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800cc10 con 0x7f151806bbf0 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.437+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800cd70 con 0x7f151806bbf0 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.437+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508014680 con 0x7f151806bbf0 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.437+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180cd4f0 con 0x7f151806bbf0 2023-11-27T22:30:27.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.437+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15181519b0 con 0x7f151806bbf0 2023-11-27T22:30:27.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.438+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15180cd350 con 0x7f151806bbf0 2023-11-27T22:30:27.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.438+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f150801d3b0 con 0x7f151806bbf0 2023-11-27T22:30:27.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.438+0000 7f14ff7fe640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f150406b1c0 0x7f150406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.439+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f1508089b70 con 0x7f151806bbf0 2023-11-27T22:30:27.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.439+0000 7f151659c640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f150406b1c0 0x7f150406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.439+0000 7f151659c640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f150406b1c0 0x7f150406d680 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f150c036000 tx=0x7f150c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.443+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f15180cd350 con 0x7f151806bbf0 2023-11-27T22:30:27.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.612+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1518159430 con 0x7f151806bbf0 2023-11-27T22:30:27.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.612+0000 7f14ff7fe640 1 -- 172.21.15.154:0/3107407676 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1508019020 con 0x7f151806bbf0 2023-11-27T22:30:27.616 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:27.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f150406b1c0 msgr2=0x7f150406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f150406b1c0 0x7f150406d680 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f150c036000 tx=0x7f150c030000 comp rx=0 tx=0).stop 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 msgr2=0x7f1518150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 0x7f1518150de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f150800ba50 tx=0x7f150800bf10 comp rx=0 tx=0).stop 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 shutdown_connections 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f151815d340 0x7f1518151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f150406b1c0 0x7f150406d680 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15180ad640 0x7f151815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 --2- 172.21.15.154:0/3107407676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f151806bbf0 0x7f1518150de0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 >> 172.21.15.154:0/3107407676 conn(0x7f1518070e70 msgr2=0x7f15181535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 shutdown_connections 2023-11-27T22:30:27.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.614+0000 7f151d1b0640 1 -- 172.21.15.154:0/3107407676 wait complete. 2023-11-27T22:30:27.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T22:30:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.728+0000 7f1041353640 1 Processor -- start 2023-11-27T22:30:27.731 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.728+0000 7f1041353640 1 -- start start 2023-11-27T22:30:27.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1041353640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f103c15d530 0x7f103c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1041353640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1230 0x7f103c0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1041353640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103c0cf0a0 con 0x7f103c0d1c20 2023-11-27T22:30:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1041353640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103c0d20b0 con 0x7f103c15d530 2023-11-27T22:30:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1041353640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c0b2a80 con 0x7f103c0d1230 2023-11-27T22:30:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f103c15d530 0x7f103c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f103c0d1c20 0x7f103c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:60276/0 (socket says 172.21.15.154:60276) 2023-11-27T22:30:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103b7fe640 1 -- 172.21.15.154:0/3781361410 learned_addr learned my addr 172.21.15.154:0/3781361410 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1033fff640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1230 0x7f103c0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103affd640 1 -- 172.21.15.154:0/3781361410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1230 msgr2=0x7f103c0d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103affd640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1230 0x7f103c0d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103affd640 1 -- 172.21.15.154:0/3781361410 >> v1:172.21.15.154:6789/0 conn(0x7f103c0d1c20 legacy=0x7f103c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103a7fc640 1 -- 172.21.15.154:0/3781361410 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302535700 0 0) 0x7f103c0cf0a0 con 0x7f103c0d1c20 2023-11-27T22:30:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f103affd640 1 -- 172.21.15.154:0/3781361410 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0ceae0 con 0x7f103c15d530 2023-11-27T22:30:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.729+0000 7f1033fff640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1230 0x7f103c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.730+0000 7f103affd640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c0d0cf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f102c0097a0 tx=0x7f102c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89bd150b92a1108 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.730+0000 7f103a7fc640 1 -- 172.21.15.154:0/3781361410 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c02e070 con 0x7f103c15d530 2023-11-27T22:30:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.730+0000 7f103a7fc640 1 -- 172.21.15.154:0/3781361410 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0315a0 con 0x7f103c15d530 2023-11-27T22:30:27.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.730+0000 7f103a7fc640 1 -- 172.21.15.154:0/3781361410 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c031930 con 0x7f103c15d530 2023-11-27T22:30:27.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 -- 172.21.15.154:0/3781361410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 msgr2=0x7f103c0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c0d0cf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f102c0097a0 tx=0x7f102c02b840 comp rx=0 tx=0).stop 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 -- 172.21.15.154:0/3781361410 shutdown_connections 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1230 0x7f103c0d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 --2- 172.21.15.154:0/3781361410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c0d0cf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 -- 172.21.15.154:0/3781361410 >> 172.21.15.154:0/3781361410 conn(0x7f103c09c480 msgr2=0x7f103c0d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 -- 172.21.15.154:0/3781361410 shutdown_connections 2023-11-27T22:30:27.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.731+0000 7f1041353640 1 -- 172.21.15.154:0/3781361410 wait complete. 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.732+0000 7f1041353640 1 Processor -- start 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.732+0000 7f1041353640 1 -- start start 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f103c0d1230 0x7f103c160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1c20 0x7f103c15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c15e710 con 0x7f103c15d530 2023-11-27T22:30:27.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c15f250 con 0x7f103c0d1230 2023-11-27T22:30:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103c15e9b0 con 0x7f103c0d1c20 2023-11-27T22:30:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c1521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34496/0 (socket says 172.21.15.154:34496) 2023-11-27T22:30:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 -- 172.21.15.154:0/488029824 learned_addr learned my addr 172.21.15.154:0/488029824 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1033fff640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1c20 0x7f103c15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 -- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1c20 msgr2=0x7f103c15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103affd640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f103c0d1230 0x7f103c160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1c20 0x7f103c15f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 -- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f103c0d1230 msgr2=0x7f103c160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f103c0d1230 0x7f103c160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 -- 172.21.15.154:0/488029824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c009400 con 0x7f103c15d530 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103affd640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f103c0d1230 0x7f103c160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:27.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f103b7fe640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c1521a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f103400c780 tx=0x7f103400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400ce90 con 0x7f103c15d530 2023-11-27T22:30:27.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400a640 con 0x7f103c15d530 2023-11-27T22:30:27.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400a9d0 con 0x7f103c15d530 2023-11-27T22:30:27.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c15ec90 con 0x7f103c15d530 2023-11-27T22:30:27.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.733+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c160740 con 0x7f103c15d530 2023-11-27T22:30:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.734+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103c0c6eb0 con 0x7f103c15d530 2023-11-27T22:30:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.735+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f103400ab30 con 0x7f103c15d530 2023-11-27T22:30:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.735+0000 7f10337fe640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f101c06b1c0 0x7f101c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.735+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f1034089050 con 0x7f103c15d530 2023-11-27T22:30:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.735+0000 7f103affd640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f101c06b1c0 0x7f101c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:27.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.736+0000 7f103affd640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f101c06b1c0 0x7f101c06d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f102c036000 tx=0x7f102c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:27.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.739+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f103c0c6eb0 con 0x7f103c15d530 2023-11-27T22:30:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.920+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f103c0c6eb0 con 0x7f103c15d530 2023-11-27T22:30:27.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.921+0000 7f10337fe640 1 -- 172.21.15.154:0/488029824 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f103c0c6eb0 con 0x7f103c15d530 2023-11-27T22:30:27.924 INFO:teuthology.orchestra.run.smithi154.stderr:listed 0 entries 2023-11-27T22:30:27.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f101c06b1c0 msgr2=0x7f101c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f101c06b1c0 0x7f101c06d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f102c036000 tx=0x7f102c03d040 comp rx=0 tx=0).stop 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 msgr2=0x7f103c1521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c1521a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f103400c780 tx=0x7f103400cc40 comp rx=0 tx=0).stop 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 shutdown_connections 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f101c06b1c0 0x7f101c06d680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f103c15d530 0x7f103c1521a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f103c0d1c20 0x7f103c15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 --2- 172.21.15.154:0/488029824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f103c0d1230 0x7f103c160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:27.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 >> 172.21.15.154:0/488029824 conn(0x7f103c09c480 msgr2=0x7f103c06b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:27.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 shutdown_connections 2023-11-27T22:30:27.927 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:27.923+0000 7f1041353640 1 -- 172.21.15.154:0/488029824 wait complete. 2023-11-27T22:30:27.936 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi194.front.sepia.ceph.com... 2023-11-27T22:30:27.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:27.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-27T22:30:27.969 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:27.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-11-27T22:30:27.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:27.970 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-27T22:30:28.027 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-27T22:30:28.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:30:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.125+0000 7fd73739e640 1 Processor -- start 2023-11-27T22:30:28.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.125+0000 7fd73739e640 1 -- start start 2023-11-27T22:30:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd73739e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd730144a00 0x7fd73006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd73739e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd730144440 0x7fd73006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd73739e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7300b2ef0 con 0x7fd7301415f0 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd73739e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7300b3b70 con 0x7fd730144a00 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd73739e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd730142510 con 0x7fd730144440 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd734939640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd730144a00 0x7fd73006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd734939640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd730144a00 0x7fd73006b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34508/0 (socket says 172.21.15.154:34508) 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd734939640 1 -- 172.21.15.154:0/2180991868 learned_addr learned my addr 172.21.15.154:0/2180991868 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:28.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.126+0000 7fd73593b640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd730144440 0x7fd73006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd734939640 1 -- 172.21.15.154:0/2180991868 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd730144440 msgr2=0x7fd73006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:28.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd734939640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd730144440 0x7fd73006ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd734939640 1 -- 172.21.15.154:0/2180991868 >> v1:172.21.15.194:6789/0 conn(0x7fd7301415f0 legacy=0x7fd730141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd734939640 1 -- 172.21.15.154:0/2180991868 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300b31d0 con 0x7fd730144a00 2023-11-27T22:30:28.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd73593b640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd730144440 0x7fd73006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:28.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd734939640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73006b4e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd7200098a0 tx=0x7fd72002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2764bb95ef1ca711 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd727fff640 1 -- 172.21.15.154:0/2180991868 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720030840 con 0x7fd730144a00 2023-11-27T22:30:28.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd727fff640 1 -- 172.21.15.154:0/2180991868 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7200309a0 con 0x7fd730144a00 2023-11-27T22:30:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.127+0000 7fd727fff640 1 -- 172.21.15.154:0/2180991868 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720030d30 con 0x7fd730144a00 2023-11-27T22:30:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 -- 172.21.15.154:0/2180991868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 msgr2=0x7fd73006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73006b4e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd7200098a0 tx=0x7fd72002b980 comp rx=0 tx=0).stop 2023-11-27T22:30:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 -- 172.21.15.154:0/2180991868 shutdown_connections 2023-11-27T22:30:28.140 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd730144440 0x7fd73006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 --2- 172.21.15.154:0/2180991868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73006b4e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 -- 172.21.15.154:0/2180991868 >> 172.21.15.154:0/2180991868 conn(0x7fd730070e70 msgr2=0x7fd730071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 -- 172.21.15.154:0/2180991868 shutdown_connections 2023-11-27T22:30:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.128+0000 7fd73739e640 1 -- 172.21.15.154:0/2180991868 wait complete. 2023-11-27T22:30:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.129+0000 7fd73739e640 1 Processor -- start 2023-11-27T22:30:28.141 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.129+0000 7fd73739e640 1 -- start start 2023-11-27T22:30:28.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73739e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7301415f0 0x7fd7301f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73739e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd730144440 0x7fd7300a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73739e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73013d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73739e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300a8c20 con 0x7fd730144a00 2023-11-27T22:30:28.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73739e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300caf20 con 0x7fd730144440 2023-11-27T22:30:28.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73739e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7301f4270 con 0x7fd7301415f0 2023-11-27T22:30:28.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73013d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73013d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34510/0 (socket says 172.21.15.154:34510) 2023-11-27T22:30:28.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 -- 172.21.15.154:0/3990177975 learned_addr learned my addr 172.21.15.154:0/3990177975 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:28.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73513a640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7301415f0 0x7fd7301f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.143 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd734939640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd730144440 0x7fd7300a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 -- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7301415f0 msgr2=0x7fd7301f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7301415f0 0x7fd7301f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 -- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd730144440 msgr2=0x7fd7300a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd730144440 0x7fd7300a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.130+0000 7fd73593b640 1 -- 172.21.15.154:0/3990177975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7200094d0 con 0x7fd730144a00 2023-11-27T22:30:28.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.131+0000 7fd73593b640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73013d5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd72800c820 tx=0x7fd72800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.131+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728007a30 con 0x7fd730144a00 2023-11-27T22:30:28.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.131+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd728007b90 con 0x7fd730144a00 2023-11-27T22:30:28.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.131+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7300ca580 con 0x7fd730144a00 2023-11-27T22:30:28.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.131+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72800ce10 con 0x7fd730144a00 2023-11-27T22:30:28.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.131+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7300cab40 con 0x7fd730144a00 2023-11-27T22:30:28.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.132+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7300cb060 con 0x7fd730144a00 2023-11-27T22:30:28.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.132+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd7280113f0 con 0x7fd730144a00 2023-11-27T22:30:28.146 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.133+0000 7fd725ffb640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd71406b1c0 0x7fd71406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.133+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fd728089b70 con 0x7fd730144a00 2023-11-27T22:30:28.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.133+0000 7fd73513a640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd71406b1c0 0x7fd71406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.133+0000 7fd73513a640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd71406b1c0 0x7fd71406d680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd73006f290 tx=0x7fd72c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.137+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd7300cb060 con 0x7fd730144a00 2023-11-27T22:30:28.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.344+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7300cb060 con 0x7fd730144a00 2023-11-27T22:30:28.347 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.345+0000 7fd725ffb640 1 -- 172.21.15.154:0/3990177975 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fd7300cb060 con 0x7fd730144a00 2023-11-27T22:30:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:28.348 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:30:28.349 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:30:28.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd71406b1c0 msgr2=0x7fd71406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd71406b1c0 0x7fd71406d680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd73006f290 tx=0x7fd72c009040 comp rx=0 tx=0).stop 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 msgr2=0x7fd73013d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73013d5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd72800c820 tx=0x7fd72800cce0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 shutdown_connections 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd730144440 0x7fd7300a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd71406b1c0 0x7fd71406d680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd730144a00 0x7fd73013d5b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.351 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 --2- 172.21.15.154:0/3990177975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7301415f0 0x7fd7301f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 >> 172.21.15.154:0/3990177975 conn(0x7fd730070e70 msgr2=0x7fd730141c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:28.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 shutdown_connections 2023-11-27T22:30:28.352 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.347+0000 7fd73739e640 1 -- 172.21.15.154:0/3990177975 wait complete. 2023-11-27T22:30:28.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.461+0000 7fc7dda2b640 1 Processor -- start 2023-11-27T22:30:28.464 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.461+0000 7fc7dda2b640 1 -- start start 2023-11-27T22:30:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7dda2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d80b1400 0x7fc7d815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7dda2b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc7d815e730 0x7fc7d815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7dda2b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d815e2a0 con 0x7fc7d8143490 2023-11-27T22:30:28.468 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7dda2b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d815b520 con 0x7fc7d815e730 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7dda2b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d8143870 con 0x7fc7d80b1400 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d77fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc7d815e730 0x7fc7d815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d67fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d80b1400 0x7fc7d815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d6ffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc7d8143490 0x7fc7d80b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:50968/0 (socket says 172.21.15.154:50968) 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d6ffd640 1 -- 172.21.15.154:0/3244683761 learned_addr learned my addr 172.21.15.154:0/3244683761 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d77fe640 1 -- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d80b1400 msgr2=0x7fc7d815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:28.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d77fe640 1 --2- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d80b1400 0x7fc7d815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d77fe640 1 -- 172.21.15.154:0/3244683761 >> v1:172.21.15.194:6789/0 conn(0x7fc7d8143490 legacy=0x7fc7d80b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d77fe640 1 -- 172.21.15.154:0/3244683761 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d815b240 con 0x7fc7d815e730 2023-11-27T22:30:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.462+0000 7fc7d5ffb640 1 -- 172.21.15.154:0/3244683761 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496782641 0 0) 0x7fc7d815e2a0 con 0x7fc7d8143490 2023-11-27T22:30:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.463+0000 7fc7d77fe640 1 --2- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d815e730 0x7fc7d815aa20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009d90 tx=0x7fc7d002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27b8c1310679ee2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7d5ffb640 1 -- 172.21.15.154:0/3244683761 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d002cc50 con 0x7fc7d815e730 2023-11-27T22:30:28.470 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7d5ffb640 1 -- 172.21.15.154:0/3244683761 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d002cdb0 con 0x7fc7d815e730 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7d5ffb640 1 -- 172.21.15.154:0/3244683761 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0034660 con 0x7fc7d815e730 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 -- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d815e730 msgr2=0x7fc7d815aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d815e730 0x7fc7d815aa20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009d90 tx=0x7fc7d002bea0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 -- 172.21.15.154:0/3244683761 shutdown_connections 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d815e730 0x7fc7d815aa20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/3244683761 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d80b1400 0x7fc7d815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 -- 172.21.15.154:0/3244683761 >> 172.21.15.154:0/3244683761 conn(0x7fc7d806a4d0 msgr2=0x7fc7d806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 -- 172.21.15.154:0/3244683761 shutdown_connections 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.464+0000 7fc7dda2b640 1 -- 172.21.15.154:0/3244683761 wait complete. 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.465+0000 7fc7dda2b640 1 Processor -- start 2023-11-27T22:30:28.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 -- start start 2023-11-27T22:30:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d80b1400 0x7fc7d8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 0x7fc7d80a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d815e730 0x7fc7d80a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d813fac0 con 0x7fc7d8143490 2023-11-27T22:30:28.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d812ce60 con 0x7fc7d80b1400 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7dda2b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d812c250 con 0x7fc7d815e730 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7d67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 0x7fc7d80a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7d67fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 0x7fc7d80a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56208/0 (socket says 172.21.15.154:56208) 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7d67fc640 1 -- 172.21.15.154:0/777732533 learned_addr learned my addr 172.21.15.154:0/777732533 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7d6ffd640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d80b1400 0x7fc7d8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.466+0000 7fc7d77fe640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d815e730 0x7fc7d80a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d67fc640 1 -- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d815e730 msgr2=0x7fc7d80a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d67fc640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d815e730 0x7fc7d80a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d67fc640 1 -- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d80b1400 msgr2=0x7fc7d8159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d67fc640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d80b1400 0x7fc7d8159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d67fc640 1 -- 172.21.15.154:0/777732533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009a70 con 0x7fc7d8143490 2023-11-27T22:30:28.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d6ffd640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d80b1400 0x7fc7d8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7d67fc640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 0x7fc7d80a8f70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800e9b0 tx=0x7fc7c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8009670 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c800c9a0 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d812c530 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800cd50 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.467+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d812caf0 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.468+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d8069400 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.469+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fc7c8013470 con 0x7fc7d8143490 2023-11-27T22:30:28.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.469+0000 7fc7bffff640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7c406b1c0 0x7fc7c406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.469+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fc7c8089d50 con 0x7fc7d8143490 2023-11-27T22:30:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.469+0000 7fc7d6ffd640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7c406b1c0 0x7fc7c406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.470+0000 7fc7d6ffd640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7c406b1c0 0x7fc7c406d680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc000f60 tx=0x7fc7cc007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.474+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fc7c808d030 con 0x7fc7d8143490 2023-11-27T22:30:28.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.664+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d80b2820 con 0x7fc7d8143490 2023-11-27T22:30:28.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.665+0000 7fc7bffff640 1 -- 172.21.15.154:0/777732533 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7fc7c80549a0 con 0x7fc7d8143490 2023-11-27T22:30:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:28.669 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:28.670 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.667+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7c406b1c0 msgr2=0x7fc7c406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.667+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7c406b1c0 0x7fc7c406d680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc000f60 tx=0x7fc7cc007d50 comp rx=0 tx=0).stop 2023-11-27T22:30:28.671 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.667+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 msgr2=0x7fc7d80a8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.667+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 0x7fc7d80a8f70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800e9b0 tx=0x7fc7c800ee70 comp rx=0 tx=0).stop 2023-11-27T22:30:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.667+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 shutdown_connections 2023-11-27T22:30:28.672 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fc7c406b1c0 0x7fc7c406d680 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7d815e730 0x7fc7d80a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc7d8143490 0x7fc7d80a8f70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 --2- 172.21.15.154:0/777732533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7d80b1400 0x7fc7d8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 >> 172.21.15.154:0/777732533 conn(0x7fc7d806a4d0 msgr2=0x7fc7d806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 shutdown_connections 2023-11-27T22:30:28.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.668+0000 7fc7dda2b640 1 -- 172.21.15.154:0/777732533 wait complete. 2023-11-27T22:30:28.682 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:29:37.040127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:29:37.966564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:28.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.785+0000 7fe54a02b640 1 Processor -- start 2023-11-27T22:30:28.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.785+0000 7fe54a02b640 1 -- start start 2023-11-27T22:30:28.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe54a02b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe54415d330 0x7fe5440b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe54a02b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440b2b10 con 0x7fe5440d2910 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe54a02b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5440d1590 con 0x7fe5440d3900 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe54a02b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5440d1870 con 0x7fe54415d330 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe5437fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe54415d330 0x7fe5440b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe5437fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe54415d330 0x7fe5440b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56212/0 (socket says 172.21.15.154:56212) 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe53bfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe5440d2910 0x7fe5440d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54570/0 (socket says 172.21.15.154:54570) 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.786+0000 7fe5437fe640 1 -- 172.21.15.154:0/1795338445 learned_addr learned my addr 172.21.15.154:0/1795338445 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.787+0000 7fe5437fe640 1 -- 172.21.15.154:0/1795338445 >> v1:172.21.15.194:6789/0 conn(0x7fe5440d3900 legacy=0x7fe5440b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.787+0000 7fe5437fe640 1 -- 172.21.15.154:0/1795338445 >> v1:172.21.15.154:6789/0 conn(0x7fe5440d2910 legacy=0x7fe5440d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.787+0000 7fe5437fe640 1 -- 172.21.15.154:0/1795338445 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440d1b50 con 0x7fe54415d330 2023-11-27T22:30:28.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.787+0000 7fe5437fe640 1 --2- 172.21.15.154:0/1795338445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54415d330 0x7fe5440b8b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe53402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd0b1c79f4f2836 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe542ffd640 1 -- 172.21.15.154:0/1795338445 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534030860 con 0x7fe54415d330 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe542ffd640 1 -- 172.21.15.154:0/1795338445 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5340309c0 con 0x7fe54415d330 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe542ffd640 1 -- 172.21.15.154:0/1795338445 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe534030d50 con 0x7fe54415d330 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 -- 172.21.15.154:0/1795338445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54415d330 msgr2=0x7fe5440b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1795338445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54415d330 0x7fe5440b8b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe53402b9a0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 -- 172.21.15.154:0/1795338445 shutdown_connections 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1795338445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe54415d330 0x7fe5440b8b80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 -- 172.21.15.154:0/1795338445 >> 172.21.15.154:0/1795338445 conn(0x7fe544072020 msgr2=0x7fe544072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 -- 172.21.15.154:0/1795338445 shutdown_connections 2023-11-27T22:30:28.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.788+0000 7fe54a02b640 1 -- 172.21.15.154:0/1795338445 wait complete. 2023-11-27T22:30:28.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.789+0000 7fe54a02b640 1 Processor -- start 2023-11-27T22:30:28.794 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 -- start start 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5440d2910 0x7fe54415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 0x7fe5440cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe54415d330 0x7fe54415fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5440cc390 con 0x7fe5440d3900 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54415ac40 con 0x7fe5440d2910 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe54a02b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54415af20 con 0x7fe54415d330 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe53bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 0x7fe5440cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe53bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 0x7fe5440cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56216/0 (socket says 172.21.15.154:56216) 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.790+0000 7fe53bfff640 1 -- 172.21.15.154:0/1443418896 learned_addr learned my addr 172.21.15.154:0/1443418896 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:28.795 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe5437fe640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5440d2910 0x7fe54415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe543fff640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe54415d330 0x7fe54415fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe53bfff640 1 -- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe54415d330 msgr2=0x7fe54415fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe53bfff640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe54415d330 0x7fe54415fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe53bfff640 1 -- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5440d2910 msgr2=0x7fe54415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe53bfff640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5440d2910 0x7fe54415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe53bfff640 1 -- 172.21.15.154:0/1443418896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340094d0 con 0x7fe5440d3900 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe53bfff640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 0x7fe5440cbe50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00c4d0 tx=0x7fe52c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c007480 con 0x7fe5440d3900 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0075e0 con 0x7fe5440d3900 2023-11-27T22:30:28.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54415b200 con 0x7fe5440d3900 2023-11-27T22:30:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0049e0 con 0x7fe5440d3900 2023-11-27T22:30:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.791+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54415b7c0 con 0x7fe5440d3900 2023-11-27T22:30:28.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.792+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54415b9e0 con 0x7fe5440d3900 2023-11-27T22:30:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.793+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe52c004b40 con 0x7fe5440d3900 2023-11-27T22:30:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.793+0000 7fe540ff9640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe52406b1c0 0x7fe52406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.793+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fe52c089090 con 0x7fe5440d3900 2023-11-27T22:30:28.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.793+0000 7fe5437fe640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe52406b1c0 0x7fe52406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:28.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.794+0000 7fe5437fe640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe52406b1c0 0x7fe52406d680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe534036000 tx=0x7fe53403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:28.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.798+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe52c053cb0 con 0x7fe5440d3900 2023-11-27T22:30:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.966+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe544069400 con 0x7fe5440d3900 2023-11-27T22:30:28.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.966+0000 7fe540ff9640 1 -- 172.21.15.154:0/1443418896 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe52c0572d0 con 0x7fe5440d3900 2023-11-27T22:30:28.969 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:28.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.968+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe52406b1c0 msgr2=0x7fe52406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.968+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe52406b1c0 0x7fe52406d680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe534036000 tx=0x7fe53403b040 comp rx=0 tx=0).stop 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.968+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 msgr2=0x7fe5440cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.968+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 0x7fe5440cbe50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe52c00c4d0 tx=0x7fe52c00c990 comp rx=0 tx=0).stop 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 shutdown_connections 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe52406b1c0 0x7fe52406d680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe54415d330 0x7fe54415fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5440d3900 0x7fe5440cbe50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 --2- 172.21.15.154:0/1443418896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5440d2910 0x7fe54415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 >> 172.21.15.154:0/1443418896 conn(0x7fe544072020 msgr2=0x7fe544072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 shutdown_connections 2023-11-27T22:30:28.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:28.969+0000 7fe54a02b640 1 -- 172.21.15.154:0/1443418896 wait complete. 2023-11-27T22:30:28.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T22:30:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.085+0000 7f1c16905640 1 Processor -- start 2023-11-27T22:30:29.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.085+0000 7f1c16905640 1 -- start start 2023-11-27T22:30:29.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.085+0000 7f1c16905640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 0x7f1c100c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.085+0000 7f1c16905640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100c7ee0 con 0x7f1c100c63c0 2023-11-27T22:30:29.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.085+0000 7f1c16905640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100cf330 con 0x7f1c1015bbe0 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.085+0000 7f1c16905640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c7920 con 0x7f1c100cebb0 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c14ea2640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1c100c63c0 0x7f1c1015f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54576/0 (socket says 172.21.15.154:54576) 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c14ea2640 1 -- 172.21.15.154:0/4209140741 learned_addr learned my addr 172.21.15.154:0/4209140741 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0f7fe640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 0x7f1c100c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809621373 0 0) 0x7f1c100c7ee0 con 0x7f1c100c63c0 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf8003520 con 0x7f1c100c63c0 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4087507358 0 0) 0x7f1bf8003520 con 0x7f1c100c63c0 2023-11-27T22:30:29.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 msgr2=0x7f1c100c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 0x7f1c100c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 >> v1:172.21.15.194:6789/0 conn(0x7f1c1015bbe0 legacy=0x7f1c1015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100c7c00 con 0x7f1c100c63c0 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f1c080019f0 con 0x7f1c100c63c0 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 >> v1:172.21.15.154:6789/0 conn(0x7f1c100c63c0 legacy=0x7f1c1015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80039a0 0x7f1bf8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 0x7f1bf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf8004d00 0x7f1bf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c7920 con 0x7f1bf8004d00 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf800bab0 con 0x7f1bf80039a0 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf800bc70 con 0x7f1c100cebb0 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c14ea2640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf8004d00 0x7f1bf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.086+0000 7f1c0ffff640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80039a0 0x7f1bf8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c0f7fe640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 0x7f1bf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c14ea2640 1 -- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 msgr2=0x7f1bf80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:29.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c14ea2640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c100cebb0 0x7f1bf80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c14ea2640 1 -- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80039a0 msgr2=0x7f1bf8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c14ea2640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf80039a0 0x7f1bf8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c14ea2640 1 -- 172.21.15.154:0/4209140741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8003520 con 0x7f1bf8004d00 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.087+0000 7f1c14ea2640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf8004d00 0x7f1bf8005180 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800a830 tx=0x7f1bf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f8d47616a8980f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080072d0 con 0x7f1bf8004d00 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0802f070 con 0x7f1bf8004d00 2023-11-27T22:30:29.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c0effd640 1 -- 172.21.15.154:0/4209140741 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08007690 con 0x7f1bf8004d00 2023-11-27T22:30:29.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c16905640 1 -- 172.21.15.154:0/4209140741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf8004d00 msgr2=0x7f1bf8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c16905640 1 --2- 172.21.15.154:0/4209140741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1bf8004d00 0x7f1bf8005180 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800a830 tx=0x7f1bf80057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c14ea2640 1 -- 172.21.15.154:0/4209140741 reap_dead start 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c16905640 1 -- 172.21.15.154:0/4209140741 shutdown_connections 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c16905640 1 -- 172.21.15.154:0/4209140741 >> 172.21.15.154:0/4209140741 conn(0x7f1c100b2c10 msgr2=0x7f1c100b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c16905640 1 -- 172.21.15.154:0/4209140741 shutdown_connections 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.088+0000 7f1c16905640 1 -- 172.21.15.154:0/4209140741 wait complete. 2023-11-27T22:30:29.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.089+0000 7f1c16905640 1 Processor -- start 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 -- start start 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c101449b0 0x7f1c101f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 0x7f1c100b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1015d010 0x7f1c1015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1015d9d0 con 0x7f1c100b49b0 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c95a0 con 0x7f1c101449b0 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c16905640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c9880 con 0x7f1c1015d010 2023-11-27T22:30:29.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c0f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 0x7f1c100b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c0f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 0x7f1c100b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56232/0 (socket says 172.21.15.154:56232) 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.090+0000 7f1c0f7fe640 1 -- 172.21.15.154:0/3126494301 learned_addr learned my addr 172.21.15.154:0/3126494301 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0ffff640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c101449b0 0x7f1c101f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c14ea2640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1015d010 0x7f1c1015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0f7fe640 1 -- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1015d010 msgr2=0x7f1c1015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0f7fe640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1015d010 0x7f1c1015d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0f7fe640 1 -- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c101449b0 msgr2=0x7f1c101f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0f7fe640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c101449b0 0x7f1c101f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0f7fe640 1 -- 172.21.15.154:0/3126494301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100c9b60 con 0x7f1c100b49b0 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0f7fe640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 0x7f1c100b4e30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c000119a0 tx=0x7f1c00011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000faf0 con 0x7f1c100b49b0 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0000fc50 con 0x7f1c100b49b0 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00014440 con 0x7f1c100b49b0 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c100c9e40 con 0x7f1c100b49b0 2023-11-27T22:30:29.101 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.091+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100c9000 con 0x7f1c100b49b0 2023-11-27T22:30:29.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.092+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1006f990 con 0x7f1c100b49b0 2023-11-27T22:30:29.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.093+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1c000145a0 con 0x7f1c100b49b0 2023-11-27T22:30:29.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.093+0000 7f1c0cff9640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.093+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f1c0008a3f0 con 0x7f1c100b49b0 2023-11-27T22:30:29.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.093+0000 7f1c0ffff640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.093+0000 7f1c0ffff640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c040035f0 tx=0x7f1c04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.097+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f1c00055010 con 0x7f1c100b49b0 2023-11-27T22:30:29.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.271+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c100c99c0 con 0x7f1c100b49b0 2023-11-27T22:30:29.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.271+0000 7f1c0cff9640 1 -- 172.21.15.154:0/3126494301 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c100c99c0 con 0x7f1c100b49b0 2023-11-27T22:30:29.274 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-27T22:30:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 msgr2=0x7f1bfc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c040035f0 tx=0x7f1c04009040 comp rx=0 tx=0).stop 2023-11-27T22:30:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 msgr2=0x7f1c100b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 0x7f1c100b4e30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1c000119a0 tx=0x7f1c00011e60 comp rx=0 tx=0).stop 2023-11-27T22:30:29.276 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 shutdown_connections 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1015d010 0x7f1c1015d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c100b49b0 0x7f1c100b4e30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 --2- 172.21.15.154:0/3126494301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c101449b0 0x7f1c101f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 >> 172.21.15.154:0/3126494301 conn(0x7f1c100b2c10 msgr2=0x7f1c1006e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 shutdown_connections 2023-11-27T22:30:29.277 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.273+0000 7f1c16905640 1 -- 172.21.15.154:0/3126494301 wait complete. 2023-11-27T22:30:29.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T22:30:29.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 Processor -- start 2023-11-27T22:30:29.392 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 -- start start 2023-11-27T22:30:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb818143490 0x7fb8180b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb81815e730 0x7fb8180b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81815e2a0 con 0x7fb81815a4e0 2023-11-27T22:30:29.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81815b520 con 0x7fb818143490 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.389+0000 7fb81d2e1640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb818143870 con 0x7fb81815e730 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb818143490 0x7fb8180b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb818143490 0x7fb8180b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56234/0 (socket says 172.21.15.154:56234) 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 -- 172.21.15.154:0/3548849387 learned_addr learned my addr 172.21.15.154:0/3548849387 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 -- 172.21.15.154:0/3548849387 >> v2:172.21.15.194:3300/0 conn(0x7fb81815e730 msgr2=0x7fb8180b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 --2- 172.21.15.154:0/3548849387 >> v2:172.21.15.194:3300/0 conn(0x7fb81815e730 0x7fb8180b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 -- 172.21.15.154:0/3548849387 >> v1:172.21.15.194:6789/0 conn(0x7fb81815a4e0 legacy=0x7fb81815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.390+0000 7fb816ffd640 1 -- 172.21.15.154:0/3548849387 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81815b240 con 0x7fb818143490 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb816ffd640 1 --2- 172.21.15.154:0/3548849387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb818143490 0x7fb8180b0cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8180aeca0 tx=0x7fb80802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6504a258126ba54d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb815ffb640 1 -- 172.21.15.154:0/3548849387 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808031870 con 0x7fb818143490 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb815ffb640 1 -- 172.21.15.154:0/3548849387 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8080319d0 con 0x7fb818143490 2023-11-27T22:30:29.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb815ffb640 1 -- 172.21.15.154:0/3548849387 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808031d60 con 0x7fb818143490 2023-11-27T22:30:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 -- 172.21.15.154:0/3548849387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb818143490 msgr2=0x7fb8180b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/3548849387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb818143490 0x7fb8180b0cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb8180aeca0 tx=0x7fb80802b910 comp rx=0 tx=0).stop 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 -- 172.21.15.154:0/3548849387 shutdown_connections 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/3548849387 >> v2:172.21.15.194:3300/0 conn(0x7fb81815e730 0x7fb8180b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/3548849387 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb818143490 0x7fb8180b0cf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 -- 172.21.15.154:0/3548849387 >> 172.21.15.154:0/3548849387 conn(0x7fb81806a4d0 msgr2=0x7fb81806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 -- 172.21.15.154:0/3548849387 shutdown_connections 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.391+0000 7fb81d2e1640 1 -- 172.21.15.154:0/3548849387 wait complete. 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 Processor -- start 2023-11-27T22:30:29.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 -- start start 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb818143490 0x7fb81813d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb81815a4e0 0x7fb8180712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 0x7fb818071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818166890 con 0x7fb81815e730 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818163040 con 0x7fb81815a4e0 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.393+0000 7fb81d2e1640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8181632b0 con 0x7fb818143490 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 0x7fb818071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 0x7fb818071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56250/0 (socket says 172.21.15.154:56250) 2023-11-27T22:30:29.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 -- 172.21.15.154:0/946908402 learned_addr learned my addr 172.21.15.154:0/946908402 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8167fc640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb81815a4e0 0x7fb8180712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb816ffd640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb818143490 0x7fb81813d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 -- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb818143490 msgr2=0x7fb81813d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb818143490 0x7fb81813d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 -- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb81815a4e0 msgr2=0x7fb8180712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb81815a4e0 0x7fb8180712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 -- 172.21.15.154:0/946908402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080094d0 con 0x7fb81815e730 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb816ffd640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb818143490 0x7fb81813d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb8177fe640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 0x7fb818071820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c7b0 tx=0x7fb81000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810003d80 con 0x7fb81815e730 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810005070 con 0x7fb81815e730 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810005420 con 0x7fb81815e730 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818163590 con 0x7fb81815e730 2023-11-27T22:30:29.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.394+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb818163b50 con 0x7fb81815e730 2023-11-27T22:30:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.395+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818069400 con 0x7fb81815e730 2023-11-27T22:30:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.396+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb810005580 con 0x7fb81815e730 2023-11-27T22:30:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.396+0000 7fb7ff7fe640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb80406b1c0 0x7fb80406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.396+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fb810088f70 con 0x7fb81815e730 2023-11-27T22:30:29.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.396+0000 7fb816ffd640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb80406b1c0 0x7fb80406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.397+0000 7fb816ffd640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb80406b1c0 0x7fb80406d680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb808036000 tx=0x7fb80803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.401+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb8100bbe90 con 0x7fb81815e730 2023-11-27T22:30:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.572+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8180ccb60 con 0x7fb81815e730 2023-11-27T22:30:29.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.572+0000 7fb7ff7fe640 1 -- 172.21.15.154:0/946908402 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb810017020 con 0x7fb81815e730 2023-11-27T22:30:29.575 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-27T22:30:29.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb80406b1c0 msgr2=0x7fb80406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb80406b1c0 0x7fb80406d680 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb808036000 tx=0x7fb80803c040 comp rx=0 tx=0).stop 2023-11-27T22:30:29.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 msgr2=0x7fb818071820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 0x7fb818071820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c7b0 tx=0x7fb81000cc70 comp rx=0 tx=0).stop 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 shutdown_connections 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb81815a4e0 0x7fb8180712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb80406b1c0 0x7fb80406d680 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb81815e730 0x7fb818071820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 --2- 172.21.15.154:0/946908402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb818143490 0x7fb81813d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.574+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 >> 172.21.15.154:0/946908402 conn(0x7fb81806a4d0 msgr2=0x7fb81815b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.575+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 shutdown_connections 2023-11-27T22:30:29.578 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.575+0000 7fb81d2e1640 1 -- 172.21.15.154:0/946908402 wait complete. 2023-11-27T22:30:29.588 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:30:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.686+0000 7f5698b01640 1 Processor -- start 2023-11-27T22:30:29.689 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.686+0000 7f5698b01640 1 -- start start 2023-11-27T22:30:29.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.687+0000 7f5698b01640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5694143490 0x7f56940b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.687+0000 7f5698b01640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415e730 0x7f56940b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.687+0000 7f5698b01640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569415e2a0 con 0x7f569415a4e0 2023-11-27T22:30:29.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.687+0000 7f5698b01640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569415b520 con 0x7f5694143490 2023-11-27T22:30:29.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.687+0000 7f5698b01640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5694143870 con 0x7f569415e730 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f569259c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5694143490 0x7f56940b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5692d9d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f569415a4e0 0x7f569415a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:50992/0 (socket says 172.21.15.154:50992) 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5691d9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415e730 0x7f56940b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5692d9d640 1 -- 172.21.15.154:0/593190841 learned_addr learned my addr 172.21.15.154:0/593190841 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f569159a640 1 -- 172.21.15.154:0/593190841 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817558312 0 0) 0x7f569415e2a0 con 0x7f569415a4e0 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f569159a640 1 -- 172.21.15.154:0/593190841 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f567c003520 con 0x7f569415a4e0 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5691d9b640 1 -- 172.21.15.154:0/593190841 >> v2:172.21.15.194:3300/0 conn(0x7f5694143490 msgr2=0x7f56940b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5691d9b640 1 --2- 172.21.15.154:0/593190841 >> v2:172.21.15.194:3300/0 conn(0x7f5694143490 0x7f56940b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5691d9b640 1 -- 172.21.15.154:0/593190841 >> v1:172.21.15.194:6789/0 conn(0x7f569415a4e0 legacy=0x7f569415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f5691d9b640 1 -- 172.21.15.154:0/593190841 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569415b240 con 0x7f569415e730 2023-11-27T22:30:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.688+0000 7f569259c640 1 --2- 172.21.15.154:0/593190841 >> v2:172.21.15.194:3300/0 conn(0x7f5694143490 0x7f56940b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:29.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.689+0000 7f5691d9b640 1 --2- 172.21.15.154:0/593190841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415e730 0x7f56940b1230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56840097a0 tx=0x7f568402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2011e5886e507a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.689+0000 7f569159a640 1 -- 172.21.15.154:0/593190841 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568402d040 con 0x7f569415e730 2023-11-27T22:30:29.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.689+0000 7f569159a640 1 -- 172.21.15.154:0/593190841 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684031810 con 0x7f569415e730 2023-11-27T22:30:29.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.689+0000 7f569159a640 1 -- 172.21.15.154:0/593190841 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684031ba0 con 0x7f569415e730 2023-11-27T22:30:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 -- 172.21.15.154:0/593190841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415e730 msgr2=0x7f56940b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 --2- 172.21.15.154:0/593190841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415e730 0x7f56940b1230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56840097a0 tx=0x7f568402b8b0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 -- 172.21.15.154:0/593190841 shutdown_connections 2023-11-27T22:30:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 --2- 172.21.15.154:0/593190841 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415e730 0x7f56940b1230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 --2- 172.21.15.154:0/593190841 >> v2:172.21.15.194:3300/0 conn(0x7f5694143490 0x7f56940b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 -- 172.21.15.154:0/593190841 >> 172.21.15.154:0/593190841 conn(0x7f569406a4d0 msgr2=0x7f569406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 -- 172.21.15.154:0/593190841 shutdown_connections 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.690+0000 7f5698b01640 1 -- 172.21.15.154:0/593190841 wait complete. 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.691+0000 7f5698b01640 1 Processor -- start 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.691+0000 7f5698b01640 1 -- start start 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 0x7f56941f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415a4e0 0x7f569413a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f569415e730 0x7f56941f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56941f2ce0 con 0x7f5694143490 2023-11-27T22:30:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56941f2060 con 0x7f569415e730 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56941f2340 con 0x7f569415a4e0 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 0x7f56941f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 0x7f56941f1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56260/0 (socket says 172.21.15.154:56260) 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 -- 172.21.15.154:0/2106454918 learned_addr learned my addr 172.21.15.154:0/2106454918 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5691d9b640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415a4e0 0x7f569413a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5692d9d640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f569415e730 0x7f56941f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 -- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415a4e0 msgr2=0x7f569413a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415a4e0 0x7f569413a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 -- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f569415e730 msgr2=0x7f56941f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f569415e730 0x7f56941f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 -- 172.21.15.154:0/2106454918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5688009400 con 0x7f5694143490 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5691d9b640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415a4e0 0x7f569413a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f569259c640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 0x7f56941f1830 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f568800ebe0 tx=0x7f568800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688009760 con 0x7f5694143490 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568800cc30 con 0x7f5694143490 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5684009400 con 0x7f5694143490 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.692+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568800eee0 con 0x7f5694143490 2023-11-27T22:30:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.693+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56941f2900 con 0x7f5694143490 2023-11-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.694+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56940b4330 con 0x7f5694143490 2023-11-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.694+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5688013470 con 0x7f5694143490 2023-11-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.694+0000 7f5682ffd640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f567406b1c0 0x7f567406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.694+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f5688089e30 con 0x7f5694143490 2023-11-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.694+0000 7f5691d9b640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f567406b1c0 0x7f567406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:29.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.695+0000 7f5691d9b640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f567406b1c0 0x7f567406d680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5684036000 tx=0x7f568403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.699+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5688054ae0 con 0x7f5694143490 2023-11-27T22:30:29.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.898+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5694069400 con 0x7f5694143490 2023-11-27T22:30:29.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.899+0000 7f5682ffd640 1 -- 172.21.15.154:0/2106454918 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f5688017090 con 0x7f5694143490 2023-11-27T22:30:29.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:29.902 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:30:29.902 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:30:29.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f567406b1c0 msgr2=0x7f567406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f567406b1c0 0x7f567406d680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5684036000 tx=0x7f568403c040 comp rx=0 tx=0).stop 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 msgr2=0x7f56941f1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 0x7f56941f1830 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f568800ebe0 tx=0x7f568800c520 comp rx=0 tx=0).stop 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 shutdown_connections 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f569415e730 0x7f56941f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f567406b1c0 0x7f567406d680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f569415a4e0 0x7f569413a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 --2- 172.21.15.154:0/2106454918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694143490 0x7f56941f1830 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 >> 172.21.15.154:0/2106454918 conn(0x7f569406a4d0 msgr2=0x7f5694071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 shutdown_connections 2023-11-27T22:30:29.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:29.901+0000 7f5698b01640 1 -- 172.21.15.154:0/2106454918 wait complete. 2023-11-27T22:30:29.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:30.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.012+0000 7f3bc1a96640 1 Processor -- start 2023-11-27T22:30:30.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.012+0000 7f3bc1a96640 1 -- start start 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bc1a96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bc1a96640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bbc0ad640 0x7f3bbc06ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bc1a96640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0adae0 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bc1a96640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0addc0 con 0x7f3bbc0ad640 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bc1a96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0ae0a0 con 0x7f3bbc15d1d0 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bbb7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.016 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bbb7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc06b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:38032/0 (socket says 172.21.15.154:38032) 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bbb7fe640 1 -- 172.21.15.154:0/680732900 learned_addr learned my addr 172.21.15.154:0/680732900 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bbaffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bbc0ad640 0x7f3bbc06ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.013+0000 7f3bbbfff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3bbc0aeb80 0x7f3bbc160ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:50998/0 (socket says 172.21.15.154:50998) 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.014+0000 7f3bbb7fe640 1 -- 172.21.15.154:0/680732900 >> v2:172.21.15.194:3300/0 conn(0x7f3bbc0ad640 msgr2=0x7f3bbc06ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.014+0000 7f3bbb7fe640 1 --2- 172.21.15.154:0/680732900 >> v2:172.21.15.194:3300/0 conn(0x7f3bbc0ad640 0x7f3bbc06ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.014+0000 7f3bbb7fe640 1 -- 172.21.15.154:0/680732900 >> v1:172.21.15.194:6789/0 conn(0x7f3bbc0aeb80 legacy=0x7f3bbc160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.014+0000 7f3bbb7fe640 1 -- 172.21.15.154:0/680732900 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0ae380 con 0x7f3bbc15d1d0 2023-11-27T22:30:30.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.014+0000 7f3bbb7fe640 1 --2- 172.21.15.154:0/680732900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc06b4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851961bd765c8d59 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bba7fc640 1 -- 172.21.15.154:0/680732900 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac030840 con 0x7f3bbc15d1d0 2023-11-27T22:30:30.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bba7fc640 1 -- 172.21.15.154:0/680732900 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0309a0 con 0x7f3bbc15d1d0 2023-11-27T22:30:30.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bba7fc640 1 -- 172.21.15.154:0/680732900 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac030d30 con 0x7f3bbc15d1d0 2023-11-27T22:30:30.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 -- 172.21.15.154:0/680732900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 msgr2=0x7f3bbc06b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.018 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/680732900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc06b4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac02b980 comp rx=0 tx=0).stop 2023-11-27T22:30:30.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 -- 172.21.15.154:0/680732900 shutdown_connections 2023-11-27T22:30:30.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/680732900 >> v2:172.21.15.194:3300/0 conn(0x7f3bbc0ad640 0x7f3bbc06ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/680732900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc06b4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 -- 172.21.15.154:0/680732900 >> 172.21.15.154:0/680732900 conn(0x7f3bbc070e70 msgr2=0x7f3bbc071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 -- 172.21.15.154:0/680732900 shutdown_connections 2023-11-27T22:30:30.019 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.015+0000 7f3bc1a96640 1 -- 172.21.15.154:0/680732900 wait complete. 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.016+0000 7f3bc1a96640 1 Processor -- start 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.016+0000 7f3bc1a96640 1 -- start start 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bc1a96640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bbc0ad640 0x7f3bbc0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bc1a96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 0x7f3bbc0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bc1a96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bc1a96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c51e0 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bc1a96640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1f7350 con 0x7f3bbc0ad640 2023-11-27T22:30:30.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bc1a96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1f7070 con 0x7f3bbc15d1d0 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bbaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 0x7f3bbc0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bbaffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 0x7f3bbc0c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56266/0 (socket says 172.21.15.154:56266) 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bbaffd640 1 -- 172.21.15.154:0/3698071417 learned_addr learned my addr 172.21.15.154:0/3698071417 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bbbfff640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.017+0000 7f3bbb7fe640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bbc0ad640 0x7f3bbc0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bbaffd640 1 -- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 msgr2=0x7f3bbc1f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bbaffd640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc1f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bbaffd640 1 -- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bbc0ad640 msgr2=0x7f3bbc0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bbaffd640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bbc0ad640 0x7f3bbc0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bbaffd640 1 -- 172.21.15.154:0/3698071417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0094d0 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bbaffd640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 0x7f3bbc0c5600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000e9b0 tx=0x7f3bb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0009670 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000c9a0 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000cd50 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc0c4b20 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.018+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc0cf140 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.019+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc0c5320 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.019+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3bb0013470 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.020+0000 7f3ba3fff640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3ba806b1c0 0x7f3ba806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.020+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f3bb0089c00 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.020+0000 7f3bbb7fe640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3ba806b1c0 0x7f3ba806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.020+0000 7f3bbb7fe640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3ba806b1c0 0x7f3ba806d680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bac036000 tx=0x7f3bac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.024+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3bbc0c5320 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.194 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.191+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bbc0c5320 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.193+0000 7f3ba3fff640 1 -- 172.21.15.154:0/3698071417 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7f3bbc0c5320 con 0x7f3bbc0aeb80 2023-11-27T22:30:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:30.196 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3ba806b1c0 msgr2=0x7f3ba806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3ba806b1c0 0x7f3ba806d680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bac036000 tx=0x7f3bac008030 comp rx=0 tx=0).stop 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 msgr2=0x7f3bbc0c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 0x7f3bbc0c5600 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000e9b0 tx=0x7f3bb000ee70 comp rx=0 tx=0).stop 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 shutdown_connections 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3ba806b1c0 0x7f3ba806d680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bbc15d1d0 0x7f3bbc1f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3bbc0aeb80 0x7f3bbc0c5600 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 --2- 172.21.15.154:0/3698071417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bbc0ad640 0x7f3bbc0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 >> 172.21.15.154:0/3698071417 conn(0x7f3bbc070e70 msgr2=0x7f3bbc06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.198 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 shutdown_connections 2023-11-27T22:30:30.199 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.195+0000 7f3bc1a96640 1 -- 172.21.15.154:0/3698071417 wait complete. 2023-11-27T22:30:30.209 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T22:30:30.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:30:30.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.306+0000 7f0d19ff5640 1 Processor -- start 2023-11-27T22:30:30.309 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.306+0000 7f0d19ff5640 1 -- start start 2023-11-27T22:30:30.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d19ff5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 0x7f0d1415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d19ff5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1415e2a0 con 0x7f0d140b1400 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d19ff5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1415b240 con 0x7f0d14143490 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d19ff5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415b520 con 0x7f0d1415e730 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d12ffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0d140b1400 0x7f0d1415a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54584/0 (socket says 172.21.15.154:54584) 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d12ffd640 1 -- 172.21.15.154:0/307230489 learned_addr learned my addr 172.21.15.154:0/307230489 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d13fff640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 0x7f0d1415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485478349 0 0) 0x7f0d1415e2a0 con 0x7f0d140b1400 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.307+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cfc003520 con 0x7f0d140b1400 2023-11-27T22:30:30.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550675893 0 0) 0x7f0cfc003520 con 0x7f0d140b1400 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 msgr2=0x7f0d1415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 0x7f0d1415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 >> v1:172.21.15.194:6789/0 conn(0x7f0d14143490 legacy=0x7f0d140b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1415dc50 con 0x7f0d140b1400 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f0d08001670 con 0x7f0d140b1400 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 >> v1:172.21.15.154:6789/0 conn(0x7f0d140b1400 legacy=0x7f0d1415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cfc0039a0 0x7f0cfc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 0x7f0cfc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc004d00 0x7f0cfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1415b520 con 0x7f0cfc0039a0 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc00ba30 con 0x7f0cfc004d00 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc00bbf0 con 0x7f0d1415e730 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d137fe640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cfc0039a0 0x7f0cfc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d12ffd640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 0x7f0cfc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d13fff640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc004d00 0x7f0cfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d137fe640 1 -- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 msgr2=0x7f0cfc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d137fe640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d1415e730 0x7f0cfc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d137fe640 1 -- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc004d00 msgr2=0x7f0cfc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d137fe640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc004d00 0x7f0cfc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d137fe640 1 -- 172.21.15.154:0/307230489 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc003520 con 0x7f0cfc0039a0 2023-11-27T22:30:30.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.308+0000 7f0d13fff640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc004d00 0x7f0cfc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d137fe640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cfc0039a0 0x7f0cfc003dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001720 tx=0x7f0cfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9411ff7e03b2c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d040052d0 con 0x7f0cfc0039a0 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0402e050 con 0x7f0cfc0039a0 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d127fc640 1 -- 172.21.15.154:0/307230489 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d040035f0 con 0x7f0cfc0039a0 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d19ff5640 1 -- 172.21.15.154:0/307230489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cfc0039a0 msgr2=0x7f0cfc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/307230489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cfc0039a0 0x7f0cfc003dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001720 tx=0x7f0cfc0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.309+0000 7f0d13fff640 1 -- 172.21.15.154:0/307230489 reap_dead start 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.310+0000 7f0d19ff5640 1 -- 172.21.15.154:0/307230489 shutdown_connections 2023-11-27T22:30:30.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.310+0000 7f0d19ff5640 1 -- 172.21.15.154:0/307230489 >> 172.21.15.154:0/307230489 conn(0x7f0d1406a4d0 msgr2=0x7f0d1406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.310+0000 7f0d19ff5640 1 -- 172.21.15.154:0/307230489 shutdown_connections 2023-11-27T22:30:30.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.310+0000 7f0d19ff5640 1 -- 172.21.15.154:0/307230489 wait complete. 2023-11-27T22:30:30.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.311+0000 7f0d19ff5640 1 Processor -- start 2023-11-27T22:30:30.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.311+0000 7f0d19ff5640 1 -- start start 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0039a0 0x7f0d141e5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 0x7f0d140a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d140a8fe0 0x7f0d140afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141e5d00 con 0x7f0d141e58a0 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140a9460 con 0x7f0cfc0039a0 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1413d9e0 con 0x7f0d140a8fe0 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 0x7f0d140a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 0x7f0d140a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56290/0 (socket says 172.21.15.154:56290) 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 -- 172.21.15.154:0/1734705877 learned_addr learned my addr 172.21.15.154:0/1734705877 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:30.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d13fff640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d140a8fe0 0x7f0d140afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d137fe640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0039a0 0x7f0d141e5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 -- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d140a8fe0 msgr2=0x7f0d140afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d140a8fe0 0x7f0d140afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 -- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0039a0 msgr2=0x7f0d141e5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0039a0 0x7f0d141e5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 -- 172.21.15.154:0/1734705877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1413dcc0 con 0x7f0d141e58a0 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d137fe640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0039a0 0x7f0d141e5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d12ffd640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 0x7f0d140a8aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0d080072c0 tx=0x7f0d08007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800f8e0 con 0x7f0d141e58a0 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0800fa40 con 0x7f0d141e58a0 2023-11-27T22:30:30.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800fdf0 con 0x7f0d141e58a0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1413dfa0 con 0x7f0d141e58a0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.312+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d140b0130 con 0x7f0d141e58a0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.313+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d141e3980 con 0x7f0d141e58a0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.314+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0d0801d460 con 0x7f0d141e58a0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.314+0000 7f0cfbfff640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d0006b1c0 0x7f0d0006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.314+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7f0d08089b50 con 0x7f0d141e58a0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.314+0000 7f0d137fe640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d0006b1c0 0x7f0d0006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.315+0000 7f0d137fe640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d0006b1c0 0x7f0d0006d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d04033000 tx=0x7f0d04009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.318+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0d141e3980 con 0x7f0d141e58a0 2023-11-27T22:30:30.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.518+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d141e3980 con 0x7f0d141e58a0 2023-11-27T22:30:30.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.518+0000 7f0cfbfff640 1 -- 172.21.15.154:0/1734705877 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f0d141e3980 con 0x7f0d141e58a0 2023-11-27T22:30:30.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:30.521 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:30:30.521 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d0006b1c0 msgr2=0x7f0d0006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d0006b1c0 0x7f0d0006d680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d04033000 tx=0x7f0d04009030 comp rx=0 tx=0).stop 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 msgr2=0x7f0d140a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 0x7f0d140a8aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0d080072c0 tx=0x7f0d08007780 comp rx=0 tx=0).stop 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 shutdown_connections 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d0006b1c0 0x7f0d0006d680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d140a8fe0 0x7f0d140afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141e58a0 0x7f0d140a8aa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 --2- 172.21.15.154:0/1734705877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cfc0039a0 0x7f0d141e5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 >> 172.21.15.154:0/1734705877 conn(0x7f0d1406a4d0 msgr2=0x7f0d1415a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 shutdown_connections 2023-11-27T22:30:30.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.520+0000 7f0d19ff5640 1 -- 172.21.15.154:0/1734705877 wait complete. 2023-11-27T22:30:30.535 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:30:30.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.634+0000 7fdab5df5640 1 Processor -- start 2023-11-27T22:30:30.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.634+0000 7fdab5df5640 1 -- start start 2023-11-27T22:30:30.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdab5df5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdab015d910 0x7fdab00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdab5df5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00b49f0 con 0x7fdab0150940 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdab5df5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00b3560 con 0x7fdab0150560 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdab5df5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00b3de0 con 0x7fdab015d910 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdaaeffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdab0150940 0x7fdab015d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54592/0 (socket says 172.21.15.154:54592) 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdaaeffd640 1 -- 172.21.15.154:0/316329580 learned_addr learned my addr 172.21.15.154:0/316329580 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020330264 0 0) 0x7fdab00b49f0 con 0x7fdab0150940 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.635+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda98003520 con 0x7fdab0150940 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaffff640 1 --2- 172.21.15.154:0/316329580 >> v2:172.21.15.194:3300/0 conn(0x7fdab015d910 0x7fdab00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612565420 0 0) 0x7fda98003520 con 0x7fdab0150940 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 >> v2:172.21.15.194:3300/0 conn(0x7fdab015d910 msgr2=0x7fdab00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 --2- 172.21.15.154:0/316329580 >> v2:172.21.15.194:3300/0 conn(0x7fdab015d910 0x7fdab00ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 >> v1:172.21.15.194:6789/0 conn(0x7fdab0150560 legacy=0x7fdab00b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00b40c0 con 0x7fdab0150940 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fdaa4001670 con 0x7fdab0150940 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 >> v1:172.21.15.154:6789/0 conn(0x7fdab0150940 legacy=0x7fdab015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda98003970 0x7fda98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980047c0 0x7fda98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda98005180 0x7fda9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00b3de0 con 0x7fda980047c0 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9800c020 con 0x7fda98005180 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9800c1e0 con 0x7fda98003970 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980047c0 0x7fda98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaffff640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda98005180 0x7fda9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaf7fe640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda98003970 0x7fda98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaeffd640 1 -- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda98003970 msgr2=0x7fda98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda98003970 0x7fda98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaeffd640 1 -- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda98005180 msgr2=0x7fda9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda98005180 0x7fda9800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaffff640 1 -- 172.21.15.154:0/316329580 reap_dead start 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.636+0000 7fdaaeffd640 1 -- 172.21.15.154:0/316329580 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98003520 con 0x7fda980047c0 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.637+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980047c0 0x7fda98004c40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c240 tx=0x7fda980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c802358ff20f8946 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.637+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4005ad0 con 0x7fda980047c0 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.637+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4005c30 con 0x7fda980047c0 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.637+0000 7fdaae7fc640 1 -- 172.21.15.154:0/316329580 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa402ca90 con 0x7fda980047c0 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 -- 172.21.15.154:0/316329580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980047c0 msgr2=0x7fda98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980047c0 0x7fda98004c40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c240 tx=0x7fda980057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 -- 172.21.15.154:0/316329580 shutdown_connections 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 --2- 172.21.15.154:0/316329580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda980047c0 0x7fda98004c40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 -- 172.21.15.154:0/316329580 >> 172.21.15.154:0/316329580 conn(0x7fdab006a4d0 msgr2=0x7fdab006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.644 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 -- 172.21.15.154:0/316329580 shutdown_connections 2023-11-27T22:30:30.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.638+0000 7fdab5df5640 1 -- 172.21.15.154:0/316329580 wait complete. 2023-11-27T22:30:30.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.639+0000 7fdab5df5640 1 Processor -- start 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.639+0000 7fdab5df5640 1 -- start start 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980047c0 0x7fdab014e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 0x7fdab0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdab01583b0 0x7fdab01efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0158830 con 0x7fdab00b02d0 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00af5a0 con 0x7fdab01583b0 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab015a550 con 0x7fda980047c0 2023-11-27T22:30:30.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 0x7fdab0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 0x7fdab0157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56300/0 (socket says 172.21.15.154:56300) 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 -- 172.21.15.154:0/939938411 learned_addr learned my addr 172.21.15.154:0/939938411 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaf7fe640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980047c0 0x7fdab014e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaffff640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdab01583b0 0x7fdab01efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 -- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980047c0 msgr2=0x7fdab014e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980047c0 0x7fdab014e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 -- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdab01583b0 msgr2=0x7fdab01efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdab01583b0 0x7fdab01efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 -- 172.21.15.154:0/939938411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00af7f0 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaffff640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdab01583b0 0x7fdab01efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdaaeffd640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 0x7fdab0157e70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdaa402c3f0 tx=0x7fdaa402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa403c040 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa402cc60 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab00afad0 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.640+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4007070 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.641+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab0151e30 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.641+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab0069400 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.642+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdaa4032070 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.642+0000 7fda97fff640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fda9c06b1f0 0x7fda9c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.642+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fdaa40aaf90 con 0x7fdab00b02d0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.642+0000 7fdaaf7fe640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fda9c06b1f0 0x7fda9c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.643+0000 7fdaaf7fe640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fda9c06b1f0 0x7fda9c06d6b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0000c00 tx=0x7fdaa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.646+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdaa40dde90 con 0x7fdab00b02d0 2023-11-27T22:30:30.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.848+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdab006aa50 con 0x7fdab00b02d0 2023-11-27T22:30:30.851 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.848+0000 7fda97fff640 1 -- 172.21.15.154:0/939938411 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fdaa4075c40 con 0x7fdab00b02d0 2023-11-27T22:30:30.851 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:30.851 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4113643144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4113643144},{"type":"v1","addr":"172.21.15.194:6833","nonce":4113643144}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/2265741906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":2265741906},{"type":"v1","addr":"172.21.15.154:6836","nonce":2265741906}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3296461120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":3296461120},{"type":"v1","addr":"172.21.15.154:6837","nonce":3296461120}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:29:38.987500+0000","modified":"2023-11-27T22:29:41.000321+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/4111391598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":4111391598},{"type":"v1","addr":"172.21.15.194:6835","nonce":4111391598}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T22:30:30.851 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 6 2023-11-27T22:30:30.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fda9c06b1f0 msgr2=0x7fda9c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fda9c06b1f0 0x7fda9c06d6b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0000c00 tx=0x7fdaa0009040 comp rx=0 tx=0).stop 2023-11-27T22:30:30.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 msgr2=0x7fdab0157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 0x7fdab0157e70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdaa402c3f0 tx=0x7fdaa402e070 comp rx=0 tx=0).stop 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 shutdown_connections 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdab01583b0 0x7fdab01efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fda9c06b1f0 0x7fda9c06d6b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdab00b02d0 0x7fdab0157e70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 --2- 172.21.15.154:0/939938411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda980047c0 0x7fdab014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.850+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 >> 172.21.15.154:0/939938411 conn(0x7fdab006a4d0 msgr2=0x7fdab00ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.851+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 shutdown_connections 2023-11-27T22:30:30.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.851+0000 7fdab5df5640 1 -- 172.21.15.154:0/939938411 wait complete. 2023-11-27T22:30:30.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:30.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.964+0000 7fcc9b30f640 1 Processor -- start 2023-11-27T22:30:30.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.964+0000 7fcc9b30f640 1 -- start start 2023-11-27T22:30:30.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc9b30f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc94158ba0 0x7fcc9415c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc9b30f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94071c80 0x7fcc94072110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc9b30f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc940adbb0 con 0x7fcc940ac370 2023-11-27T22:30:30.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc9b30f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc94072650 con 0x7fcc94158ba0 2023-11-27T22:30:30.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc9b30f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940aecf0 con 0x7fcc94071c80 2023-11-27T22:30:30.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc94158ba0 0x7fcc9415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcc94158ba0 0x7fcc9415c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56304/0 (socket says 172.21.15.154:56304) 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 -- 172.21.15.154:0/3188615853 learned_addr learned my addr 172.21.15.154:0/3188615853 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 -- 172.21.15.154:0/3188615853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94071c80 msgr2=0x7fcc94072110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc998ac640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94071c80 0x7fcc94072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94071c80 0x7fcc94072110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 -- 172.21.15.154:0/3188615853 >> v1:172.21.15.194:6789/0 conn(0x7fcc940ac370 legacy=0x7fcc940ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc990ab640 1 -- 172.21.15.154:0/3188615853 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940b4520 con 0x7fcc94158ba0 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.965+0000 7fcc998ac640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94071c80 0x7fcc94072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.966+0000 7fcc990ab640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94158ba0 0x7fcc9415c160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc900098a0 tx=0x7fcc9002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7839d06c56976fd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.966+0000 7fcc8bfff640 1 -- 172.21.15.154:0/3188615853 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900317c0 con 0x7fcc94158ba0 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.966+0000 7fcc8bfff640 1 -- 172.21.15.154:0/3188615853 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90031920 con 0x7fcc94158ba0 2023-11-27T22:30:30.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.966+0000 7fcc8bfff640 1 -- 172.21.15.154:0/3188615853 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90031cb0 con 0x7fcc94158ba0 2023-11-27T22:30:30.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3188615853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94158ba0 msgr2=0x7fcc9415c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94158ba0 0x7fcc9415c160 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc900098a0 tx=0x7fcc9002b860 comp rx=0 tx=0).stop 2023-11-27T22:30:30.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3188615853 shutdown_connections 2023-11-27T22:30:30.973 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94071c80 0x7fcc94072110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3188615853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94158ba0 0x7fcc9415c160 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3188615853 >> 172.21.15.154:0/3188615853 conn(0x7fcc940b4720 msgr2=0x7fcc940b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3188615853 shutdown_connections 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.967+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3188615853 wait complete. 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.968+0000 7fcc9b30f640 1 Processor -- start 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.968+0000 7fcc9b30f640 1 -- start start 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 0x7fcc941ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940ac370 0x7fcc9406c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94158ba0 0x7fcc940b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940cf470 con 0x7fcc94071c80 2023-11-27T22:30:30.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc941513c0 con 0x7fcc940ac370 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc941ed570 con 0x7fcc94158ba0 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 0x7fcc941ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 0x7fcc941ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56312/0 (socket says 172.21.15.154:56312) 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 -- 172.21.15.154:0/3067946194 learned_addr learned my addr 172.21.15.154:0/3067946194 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 -- 172.21.15.154:0/3067946194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94158ba0 msgr2=0x7fcc940b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94158ba0 0x7fcc940b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 -- 172.21.15.154:0/3067946194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940ac370 msgr2=0x7fcc9406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940ac370 0x7fcc9406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 -- 172.21.15.154:0/3067946194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc900094d0 con 0x7fcc94071c80 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc990ab640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 0x7fcc941ed030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcc9002b8a0 tx=0x7fcc900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900329a0 con 0x7fcc94071c80 2023-11-27T22:30:30.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90032b40 con 0x7fcc94071c80 2023-11-27T22:30:30.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc940ce7f0 con 0x7fcc94071c80 2023-11-27T22:30:30.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc900453f0 con 0x7fcc94071c80 2023-11-27T22:30:30.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.969+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc940cedb0 con 0x7fcc94071c80 2023-11-27T22:30:30.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.970+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc94069400 con 0x7fcc94071c80 2023-11-27T22:30:30.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.971+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcc9003b3f0 con 0x7fcc94071c80 2023-11-27T22:30:30.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.971+0000 7fcc89ffb640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcc7806b1c0 0x7fcc7806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:30.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.971+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fcc900ac060 con 0x7fcc94071c80 2023-11-27T22:30:30.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.971+0000 7fcc988aa640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcc7806b1c0 0x7fcc7806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:30.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.972+0000 7fcc988aa640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcc7806b1c0 0x7fcc7806d680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc940b24c0 tx=0x7fcc840079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:30.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:30.976+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcc90076da0 con 0x7fcc94071c80 2023-11-27T22:30:31.144 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.141+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc940ae0b0 con 0x7fcc94071c80 2023-11-27T22:30:31.145 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.143+0000 7fcc89ffb640 1 -- 172.21.15.154:0/3067946194 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17014 (secure 0 0 0) 0x7fcc9007a3c0 con 0x7fcc94071c80 2023-11-27T22:30:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:31.146 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":22,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:20.788137+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:29:37.040127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T22:29:37.966564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":1}]},{"pgid":"3.23","mappings":[{"from":0,"to":2}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcc7806b1c0 msgr2=0x7fcc7806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcc7806b1c0 0x7fcc7806d680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc940b24c0 tx=0x7fcc840079b0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 msgr2=0x7fcc941ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 0x7fcc941ed030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcc9002b8a0 tx=0x7fcc900046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 shutdown_connections 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc940ac370 0x7fcc9406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcc7806b1c0 0x7fcc7806d680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc94158ba0 0x7fcc940b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 --2- 172.21.15.154:0/3067946194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcc94071c80 0x7fcc941ed030 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 >> 172.21.15.154:0/3067946194 conn(0x7fcc940b4720 msgr2=0x7fcc94159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:31.148 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 shutdown_connections 2023-11-27T22:30:31.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.145+0000 7fcc9b30f640 1 -- 172.21.15.154:0/3067946194 wait complete. 2023-11-27T22:30:31.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T22:30:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.257+0000 7fb8d1b5a640 1 Processor -- start 2023-11-27T22:30:31.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.257+0000 7fb8d1b5a640 1 -- start start 2023-11-27T22:30:31.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.258+0000 7fb8d1b5a640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb8cc15d330 0x7fb8cc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.258+0000 7fb8d1b5a640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0b2b10 con 0x7fb8cc0d3900 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.258+0000 7fb8d1b5a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0d1590 con 0x7fb8cc0d2910 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.258+0000 7fb8d1b5a640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0d1870 con 0x7fb8cc15d330 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.258+0000 7fb8cbfff640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb8cc0d3900 0x7fb8cc0b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54608/0 (socket says 172.21.15.154:54608) 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.258+0000 7fb8cbfff640 1 -- 172.21.15.154:0/2062880638 learned_addr learned my addr 172.21.15.154:0/2062880638 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/2062880638 >> v2:172.21.15.194:3300/0 conn(0x7fb8cc15d330 0x7fb8cc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382125787 0 0) 0x7fb8cc0b2b10 con 0x7fb8cc0d3900 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b8003520 con 0x7fb8cc0d3900 2023-11-27T22:30:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059454526 0 0) 0x7fb8cc0d1590 con 0x7fb8cc0d2910 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8cc0b2b10 con 0x7fb8cc0d2910 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1475311168 0 0) 0x7fb8b8003520 con 0x7fb8cc0d3900 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 >> v2:172.21.15.194:3300/0 conn(0x7fb8cc15d330 msgr2=0x7fb8cc0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 --2- 172.21.15.154:0/2062880638 >> v2:172.21.15.194:3300/0 conn(0x7fb8cc15d330 0x7fb8cc0b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 >> v1:172.21.15.194:6789/0 conn(0x7fb8cc0d2910 legacy=0x7fb8cc0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc0d1b50 con 0x7fb8cc0d3900 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fb8c40019f0 con 0x7fb8cc0d3900 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 >> v1:172.21.15.154:6789/0 conn(0x7fb8cc0d3900 legacy=0x7fb8cc0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b8003b00 0x7fb8b8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b80047c0 0x7fb8b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b8005180 0x7fb8b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0d1870 con 0x7fb8b8003b00 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b800c0b0 con 0x7fb8b80047c0 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b800c270 con 0x7fb8b8005180 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b8003b00 0x7fb8b8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8c2ffd640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b80047c0 0x7fb8b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cbfff640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b8005180 0x7fb8b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 -- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b8005180 msgr2=0x7fb8b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b8005180 0x7fb8b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 -- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b80047c0 msgr2=0x7fb8b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b80047c0 0x7fb8b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cb7fe640 1 -- 172.21.15.154:0/2062880638 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8003520 con 0x7fb8b8003b00 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.259+0000 7fb8cbfff640 1 -- 172.21.15.154:0/2062880638 reap_dead start 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.260+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b8003b00 0x7fb8b8003f00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009ac0 tx=0x7fb8b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8baa1d48ec2b2ce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.260+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc02c6d0 con 0x7fb8b8003b00 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.260+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc02c830 con 0x7fb8b8003b00 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.260+0000 7fb8caffd640 1 -- 172.21.15.154:0/2062880638 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc02cbc0 con 0x7fb8b8003b00 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/2062880638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b8003b00 msgr2=0x7fb8b8003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b8003b00 0x7fb8b8003f00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009ac0 tx=0x7fb8b80057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/2062880638 shutdown_connections 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/2062880638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8b8003b00 0x7fb8b8003f00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/2062880638 >> 172.21.15.154:0/2062880638 conn(0x7fb8cc072020 msgr2=0x7fb8cc072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/2062880638 shutdown_connections 2023-11-27T22:30:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.261+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/2062880638 wait complete. 2023-11-27T22:30:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.262+0000 7fb8d1b5a640 1 Processor -- start 2023-11-27T22:30:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.262+0000 7fb8d1b5a640 1 -- start start 2023-11-27T22:30:31.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8d1b5a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b8003b00 0x7fb8cc0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.271 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8d1b5a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 0x7fb8cc1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8d1b5a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8cc0c8050 0x7fb8cc159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8d1b5a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc156f50 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8d1b5a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc157230 con 0x7fb8b8003b00 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8d1b5a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc153e60 con 0x7fb8cc0c8050 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 0x7fb8cc1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 0x7fb8cc1595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56342/0 (socket says 172.21.15.154:56342) 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 -- 172.21.15.154:0/1748539513 learned_addr learned my addr 172.21.15.154:0/1748539513 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8cbfff640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8cc0c8050 0x7fb8cc159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b8003b00 0x7fb8cc0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 -- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8cc0c8050 msgr2=0x7fb8cc159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8cc0c8050 0x7fb8cc159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 -- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b8003b00 msgr2=0x7fb8cc0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b8003b00 0x7fb8cc0c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 -- 172.21.15.154:0/1748539513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc154140 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8cbfff640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8cc0c8050 0x7fb8cc159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.263+0000 7fb8c2ffd640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 0x7fb8cc1595c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400f7a0 tx=0x7fb8b400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.264+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400fe50 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.264+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4005320 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.264+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc156b90 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.264+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4007290 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.264+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc149430 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.265+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc153cc0 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.265+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb8b40073f0 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.265+0000 7fb8c8ff9640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb8ac06b1c0 0x7fb8ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.265+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5970+0+0 (secure 0 0 0) 0x7fb8b40890b0 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.265+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb8ac06b1c0 0x7fb8ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.266+0000 7fb8cb7fe640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb8ac06b1c0 0x7fb8ac06d680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc036000 tx=0x7fb8bc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:31.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.270+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb8cc153cc0 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.473+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8cc153cc0 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.476 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-11-27T22:30:31.474+0000 7f28b9984640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T22:30:31.478 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.475+0000 7fb8c8ff9640 1 -- 172.21.15.154:0/1748539513 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb8cc153cc0 con 0x7fb8cc0c7bf0 2023-11-27T22:30:31.478 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb8ac06b1c0 msgr2=0x7fb8ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb8ac06b1c0 0x7fb8ac06d680 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc036000 tx=0x7fb8bc030000 comp rx=0 tx=0).stop 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 msgr2=0x7fb8cc1595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 0x7fb8cc1595c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400f7a0 tx=0x7fb8b400fc60 comp rx=0 tx=0).stop 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 shutdown_connections 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb8ac06b1c0 0x7fb8ac06d680 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8cc0c8050 0x7fb8cc159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8cc0c7bf0 0x7fb8cc1595c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 --2- 172.21.15.154:0/1748539513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b8003b00 0x7fb8cc0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 >> 172.21.15.154:0/1748539513 conn(0x7fb8cc072020 msgr2=0x7fb8cc15f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 shutdown_connections 2023-11-27T22:30:31.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.477+0000 7fb8d1b5a640 1 -- 172.21.15.154:0/1748539513 wait complete. 2023-11-27T22:30:31.484 INFO:tasks.ceph.mds.d.smithi194.stderr: -2762> 2023-11-27T22:29:43.685+0000 7f2bb7b1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T22:30:31.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T22:30:31.513 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2023-11-27T22:30:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.592+0000 7f0aba739640 1 Processor -- start 2023-11-27T22:30:31.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.592+0000 7f0aba739640 1 -- start start 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0aba739640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0ab4144980 0x7f0ab415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0aba739640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ab40b4370 0x7f0ab40b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0aba739640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab4071770 con 0x7f0ab40ceb70 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0aba739640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40ccb60 con 0x7f0ab40b4370 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0aba739640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40b4ce0 con 0x7f0ab4144980 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ab40b4370 0x7f0ab40b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0ab40b4370 0x7f0ab40b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56354/0 (socket says 172.21.15.154:56354) 2023-11-27T22:30:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 -- 172.21.15.154:0/27518715 learned_addr learned my addr 172.21.15.154:0/27518715 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab3fff640 1 --2- 172.21.15.154:0/27518715 >> v2:172.21.15.194:3300/0 conn(0x7f0ab4144980 0x7f0ab415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 -- 172.21.15.154:0/27518715 >> v2:172.21.15.194:3300/0 conn(0x7f0ab4144980 msgr2=0x7f0ab415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 --2- 172.21.15.154:0/27518715 >> v2:172.21.15.194:3300/0 conn(0x7f0ab4144980 0x7f0ab415c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 -- 172.21.15.154:0/27518715 >> v1:172.21.15.194:6789/0 conn(0x7f0ab40ceb70 legacy=0x7f0ab40cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.593+0000 7f0ab8cd6640 1 -- 172.21.15.154:0/27518715 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40ccdc0 con 0x7f0ab40b4370 2023-11-27T22:30:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.594+0000 7f0ab8cd6640 1 --2- 172.21.15.154:0/27518715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab40b47a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40b4ec0 tx=0x7f0aac02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2dc1391b1ab40a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.594+0000 7f0ab2ffd640 1 -- 172.21.15.154:0/27518715 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac02cb20 con 0x7f0ab40b4370 2023-11-27T22:30:31.598 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.594+0000 7f0ab2ffd640 1 -- 172.21.15.154:0/27518715 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac02cc80 con 0x7f0ab40b4370 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.594+0000 7f0ab2ffd640 1 -- 172.21.15.154:0/27518715 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0343f0 con 0x7f0ab40b4370 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 -- 172.21.15.154:0/27518715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 msgr2=0x7f0ab40b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 --2- 172.21.15.154:0/27518715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab40b47a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40b4ec0 tx=0x7f0aac02bf80 comp rx=0 tx=0).stop 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 -- 172.21.15.154:0/27518715 shutdown_connections 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 --2- 172.21.15.154:0/27518715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab40b47a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 --2- 172.21.15.154:0/27518715 >> v2:172.21.15.194:3300/0 conn(0x7f0ab4144980 0x7f0ab415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 -- 172.21.15.154:0/27518715 >> 172.21.15.154:0/27518715 conn(0x7f0ab406a4d0 msgr2=0x7f0ab406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 -- 172.21.15.154:0/27518715 shutdown_connections 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.595+0000 7f0aba739640 1 -- 172.21.15.154:0/27518715 wait complete. 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.596+0000 7f0aba739640 1 Processor -- start 2023-11-27T22:30:31.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.596+0000 7f0aba739640 1 -- start start 2023-11-27T22:30:31.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab41f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ab40ceb70 0x7f0ab40adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab4144980 0x7f0ab4156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4137db0 con 0x7f0ab40b4370 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab413ed80 con 0x7f0ab4144980 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41f6160 con 0x7f0ab40ceb70 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab41f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab41f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56362/0 (socket says 172.21.15.154:56362) 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 -- 172.21.15.154:0/2057106963 learned_addr learned my addr 172.21.15.154:0/2057106963 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab8cd6640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab4144980 0x7f0ab4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab37fe640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ab40ceb70 0x7f0ab40adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 -- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ab40ceb70 msgr2=0x7f0ab40adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ab40ceb70 0x7f0ab40adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 -- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab4144980 msgr2=0x7f0ab4156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab4144980 0x7f0ab4156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 -- 172.21.15.154:0/2057106963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac009b30 con 0x7f0ab40b4370 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab8cd6640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab4144980 0x7f0ab4156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab3fff640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab41f5c20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400e9e0 tx=0x7f0aa400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4009670 con 0x7f0ab40b4370 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400c9d0 con 0x7f0ab40b4370 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab40b2b50 con 0x7f0ab40b4370 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400cd80 con 0x7f0ab40b4370 2023-11-27T22:30:31.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.597+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab40b2870 con 0x7f0ab40b4370 2023-11-27T22:30:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.598+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab4069400 con 0x7f0ab40b4370 2023-11-27T22:30:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.599+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0aa4013470 con 0x7f0ab40b4370 2023-11-27T22:30:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.599+0000 7f0ab0ff9640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0aa006b1c0 0x7f0aa006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.599+0000 7f0ab37fe640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0aa006b1c0 0x7f0aa006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.599+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f0aa4089d20 con 0x7f0ab40b4370 2023-11-27T22:30:31.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.600+0000 7f0ab37fe640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0aa006b1c0 0x7f0aa006d680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40b1d40 tx=0x7f0aa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:31.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.604+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0aa4054980 con 0x7f0ab40b4370 2023-11-27T22:30:31.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:31.805+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0ab406ab00 con 0x7f0ab40b4370 2023-11-27T22:30:32.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.477+0000 7f0ab0ff9640 1 -- 172.21.15.154:0/2057106963 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0aa4057fa0 con 0x7f0ab40b4370 2023-11-27T22:30:32.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0aa006b1c0 msgr2=0x7f0aa006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:32.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0aa006b1c0 0x7f0aa006d680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40b1d40 tx=0x7f0aa8009040 comp rx=0 tx=0).stop 2023-11-27T22:30:32.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 msgr2=0x7f0ab41f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:32.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab41f5c20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400e9e0 tx=0x7f0aa400eea0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 shutdown_connections 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ab4144980 0x7f0ab4156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0aa006b1c0 0x7f0aa006d680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ab40ceb70 0x7f0ab40adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 --2- 172.21.15.154:0/2057106963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0ab40b4370 0x7f0ab41f5c20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.479+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 >> 172.21.15.154:0/2057106963 conn(0x7f0ab406a4d0 msgr2=0x7f0ab4143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.480+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 shutdown_connections 2023-11-27T22:30:32.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.480+0000 7f0aba739640 1 -- 172.21.15.154:0/2057106963 wait complete. 2023-11-27T22:30:32.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T22:30:32.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.598+0000 7f11cee90640 1 Processor -- start 2023-11-27T22:30:32.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.598+0000 7f11cee90640 1 -- start start 2023-11-27T22:30:32.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11cee90640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11c8143490 0x7f11c80b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:32.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11cee90640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:32.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11cee90640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c815e2a0 con 0x7f11c815a4e0 2023-11-27T22:30:32.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11cee90640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c815b520 con 0x7f11c8143490 2023-11-27T22:30:32.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11cee90640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8143870 con 0x7f11c815e730 2023-11-27T22:30:32.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11c8143490 0x7f11c80b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:32.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11c8143490 0x7f11c80b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56374/0 (socket says 172.21.15.154:56374) 2023-11-27T22:30:32.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 -- 172.21.15.154:0/2009184130 learned_addr learned my addr 172.21.15.154:0/2009184130 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:32.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11c7fff640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:32.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 -- 172.21.15.154:0/2009184130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 msgr2=0x7f11c80b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:32.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 -- 172.21.15.154:0/2009184130 >> v1:172.21.15.194:6789/0 conn(0x7f11c815a4e0 legacy=0x7f11c815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:32.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11ccc2c640 1 -- 172.21.15.154:0/2009184130 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c815b240 con 0x7f11c8143490 2023-11-27T22:30:32.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.599+0000 7f11c7fff640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:32.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.600+0000 7f11ccc2c640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c8143490 0x7f11c80b0cf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00bb10 tx=0x7f11bc02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b2c037b20cddd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:32.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.600+0000 7f11c77fe640 1 -- 172.21.15.154:0/2009184130 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc02ee70 con 0x7f11c8143490 2023-11-27T22:30:32.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.600+0000 7f11c77fe640 1 -- 172.21.15.154:0/2009184130 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc036440 con 0x7f11c8143490 2023-11-27T22:30:32.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.600+0000 7f11c77fe640 1 -- 172.21.15.154:0/2009184130 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0367d0 con 0x7f11c8143490 2023-11-27T22:30:32.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 -- 172.21.15.154:0/2009184130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c8143490 msgr2=0x7f11c80b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:32.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c8143490 0x7f11c80b0cf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00bb10 tx=0x7f11bc02e0c0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 -- 172.21.15.154:0/2009184130 shutdown_connections 2023-11-27T22:30:32.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 --2- 172.21.15.154:0/2009184130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c8143490 0x7f11c80b0cf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 -- 172.21.15.154:0/2009184130 >> 172.21.15.154:0/2009184130 conn(0x7f11c806a4d0 msgr2=0x7f11c806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:32.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 -- 172.21.15.154:0/2009184130 shutdown_connections 2023-11-27T22:30:32.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.601+0000 7f11cee90640 1 -- 172.21.15.154:0/2009184130 wait complete. 2023-11-27T22:30:32.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.602+0000 7f11cee90640 1 Processor -- start 2023-11-27T22:30:32.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.602+0000 7f11cee90640 1 -- start start 2023-11-27T22:30:32.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c8143490 0x7f11c81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:32.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 0x7f11c80acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:32.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:32.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80ad5a0 con 0x7f11c815a4e0 2023-11-27T22:30:32.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80ad880 con 0x7f11c8143490 2023-11-27T22:30:32.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80adb60 con 0x7f11c815e730 2023-11-27T22:30:32.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 0x7f11c80acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:32.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 0x7f11c80acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56380/0 (socket says 172.21.15.154:56380) 2023-11-27T22:30:32.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 -- 172.21.15.154:0/3454356885 learned_addr learned my addr 172.21.15.154:0/3454356885 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:32.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11ccc2c640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c8143490 0x7f11c81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:32.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cd42d640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:32.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 -- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 msgr2=0x7f11c80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:32.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 -- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c8143490 msgr2=0x7f11c81598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:32.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c8143490 0x7f11c81598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 -- 172.21.15.154:0/3454356885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc00b770 con 0x7f11c815a4e0 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11ccc2c640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c8143490 0x7f11c81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cd42d640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c7fff640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 0x7f11c80acb50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c7f0 tx=0x7f11b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4007820 con 0x7f11c815a4e0 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4007980 con 0x7f11c815a4e0 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c80ade40 con 0x7f11c815a4e0 2023-11-27T22:30:32.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4007cf0 con 0x7f11c815a4e0 2023-11-27T22:30:32.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.603+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c8159e30 con 0x7f11c815a4e0 2023-11-27T22:30:32.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.604+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c815d250 con 0x7f11c815a4e0 2023-11-27T22:30:32.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.605+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f11b40113f0 con 0x7f11c815a4e0 2023-11-27T22:30:32.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.605+0000 7f11c57fa640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f11ac06b1c0 0x7f11ac06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:32.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.605+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f11b4089c00 con 0x7f11c815a4e0 2023-11-27T22:30:32.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.605+0000 7f11ccc2c640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f11ac06b1c0 0x7f11ac06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:32.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.606+0000 7f11ccc2c640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f11ac06b1c0 0x7f11ac06d680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f11bc038000 tx=0x7f11bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:32.619 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.610+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f11b4054860 con 0x7f11c815a4e0 2023-11-27T22:30:32.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:32.777+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11c8069400 con 0x7f11c815a4e0 2023-11-27T22:30:33.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.479+0000 7f11c57fa640 1 -- 172.21.15.154:0/3454356885 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f11b4057e80 con 0x7f11c815a4e0 2023-11-27T22:30:33.482 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-11-27T22:30:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.482+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f11ac06b1c0 msgr2=0x7f11ac06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.482+0000 7f11cee90640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f11ac06b1c0 0x7f11ac06d680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f11bc038000 tx=0x7f11bc008040 comp rx=0 tx=0).stop 2023-11-27T22:30:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.482+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 msgr2=0x7f11c80acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:33.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.482+0000 7f11cee90640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 0x7f11c80acb50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c7f0 tx=0x7f11b400ccb0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 shutdown_connections 2023-11-27T22:30:33.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f11ac06b1c0 0x7f11ac06d680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c815e730 0x7f11c80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11c815a4e0 0x7f11c80acb50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 --2- 172.21.15.154:0/3454356885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c8143490 0x7f11c81598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 >> 172.21.15.154:0/3454356885 conn(0x7f11c806a4d0 msgr2=0x7f11c8071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 shutdown_connections 2023-11-27T22:30:33.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.483+0000 7f11cee90640 1 -- 172.21.15.154:0/3454356885 wait complete. 2023-11-27T22:30:33.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T22:30:33.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.600+0000 7fde0b93c640 1 Processor -- start 2023-11-27T22:30:33.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.600+0000 7fde0b93c640 1 -- start start 2023-11-27T22:30:33.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde0b93c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04141e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:33.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde0b93c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde04144a00 0x7fde0406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:33.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde0b93c640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040b2ef0 con 0x7fde04144440 2023-11-27T22:30:33.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde0b93c640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040b3b70 con 0x7fde04144a00 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde0b93c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b31d0 con 0x7fde041415f0 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde08ed7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde04144a00 0x7fde0406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde09ed9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fde04144440 0x7fde040b3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54620/0 (socket says 172.21.15.154:54620) 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde09ed9640 1 -- 172.21.15.154:0/1387723711 learned_addr learned my addr 172.21.15.154:0/1387723711 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde096d8640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde08ed7640 1 -- 172.21.15.154:0/1387723711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 msgr2=0x7fde04141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde08ed7640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde08ed7640 1 -- 172.21.15.154:0/1387723711 >> v1:172.21.15.154:6789/0 conn(0x7fde04144440 legacy=0x7fde040b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fddfbfff640 1 -- 172.21.15.154:0/1387723711 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227254245 0 0) 0x7fde040b2ef0 con 0x7fde04144440 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde08ed7640 1 -- 172.21.15.154:0/1387723711 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040b34b0 con 0x7fde04144a00 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.601+0000 7fde096d8640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:33.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.602+0000 7fde08ed7640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144a00 0x7fde0406b4e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fddf40097a0 tx=0x7fddf402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2881851cfc8efe3b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:33.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.602+0000 7fddfbfff640 1 -- 172.21.15.154:0/1387723711 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4031830 con 0x7fde04144a00 2023-11-27T22:30:33.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.602+0000 7fddfbfff640 1 -- 172.21.15.154:0/1387723711 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4031990 con 0x7fde04144a00 2023-11-27T22:30:33.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.602+0000 7fddfbfff640 1 -- 172.21.15.154:0/1387723711 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4031d20 con 0x7fde04144a00 2023-11-27T22:30:33.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 -- 172.21.15.154:0/1387723711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144a00 msgr2=0x7fde0406b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:33.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144a00 0x7fde0406b4e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fddf40097a0 tx=0x7fddf402b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 -- 172.21.15.154:0/1387723711 shutdown_connections 2023-11-27T22:30:33.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144a00 0x7fde0406b4e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 --2- 172.21.15.154:0/1387723711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 -- 172.21.15.154:0/1387723711 >> 172.21.15.154:0/1387723711 conn(0x7fde04070e70 msgr2=0x7fde04071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:33.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 -- 172.21.15.154:0/1387723711 shutdown_connections 2023-11-27T22:30:33.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.603+0000 7fde0b93c640 1 -- 172.21.15.154:0/1387723711 wait complete. 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.604+0000 7fde0b93c640 1 Processor -- start 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.604+0000 7fde0b93c640 1 -- start start 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04131b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 0x7fde04130170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde04144a00 0x7fde0415cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde04131760 con 0x7fde04144440 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde04130ae0 con 0x7fde04144a00 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde04130dc0 con 0x7fde041415f0 2023-11-27T22:30:33.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 0x7fde04130170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 0x7fde04130170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56404/0 (socket says 172.21.15.154:56404) 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 -- 172.21.15.154:0/2554147618 learned_addr learned my addr 172.21.15.154:0/2554147618 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 -- 172.21.15.154:0/2554147618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 msgr2=0x7fde04131b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04131b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 -- 172.21.15.154:0/2554147618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde04144a00 msgr2=0x7fde0415cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde04144a00 0x7fde0415cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 -- 172.21.15.154:0/2554147618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4009400 con 0x7fde04144440 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde08ed7640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 0x7fde04130170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fddf4034040 tx=0x7fddf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf403aa60 con 0x7fde04144440 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf403abe0 con 0x7fde04144440 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde041310a0 con 0x7fde04144440 2023-11-27T22:30:33.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.605+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4044400 con 0x7fde04144440 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.606+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde041306b0 con 0x7fde04144440 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.606+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde041318a0 con 0x7fde04144440 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.607+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fddf404d440 con 0x7fde04144440 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.607+0000 7fddf9ffb640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdde806b1c0 0x7fdde806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.607+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5618+0+0 (secure 0 0 0) 0x7fddf40abbe0 con 0x7fde04144440 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.607+0000 7fde096d8640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdde806b1c0 0x7fdde806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.608+0000 7fde096d8640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdde806b1c0 0x7fdde806d680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde00006fd0 tx=0x7fde00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:33.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.612+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fde041318a0 con 0x7fde04144440 2023-11-27T22:30:33.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:33.778+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde041318a0 con 0x7fde04144440 2023-11-27T22:30:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.485+0000 7fddf9ffb640 1 -- 172.21.15.154:0/2554147618 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fde041318a0 con 0x7fde04144440 2023-11-27T22:30:34.487 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-11-27T22:30:34.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdde806b1c0 msgr2=0x7fdde806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdde806b1c0 0x7fdde806d680 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde00006fd0 tx=0x7fde00008040 comp rx=0 tx=0).stop 2023-11-27T22:30:34.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 msgr2=0x7fde04130170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 0x7fde04130170 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fddf4034040 tx=0x7fddf40046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 shutdown_connections 2023-11-27T22:30:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde04144a00 0x7fde0415cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.493 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdde806b1c0 0x7fdde806d680 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde00006fd0 tx=0x7fde00008040 comp rx=0 tx=0).stop 2023-11-27T22:30:34.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde04144440 0x7fde04130170 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 --2- 172.21.15.154:0/2554147618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde041415f0 0x7fde04131b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 >> 172.21.15.154:0/2554147618 conn(0x7fde04070e70 msgr2=0x7fde04071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:34.494 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.490+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 shutdown_connections 2023-11-27T22:30:34.495 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.491+0000 7fde0b93c640 1 -- 172.21.15.154:0/2554147618 wait complete. 2023-11-27T22:30:34.507 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T22:30:34.507 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-27T22:30:34.508 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T22:30:34.508 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:34.508 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T22:30:34.508 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-27T22:30:34.509 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T22:30:34.509 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:34.509 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T22:30:34.509 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-27T22:30:34.509 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T22:30:34.510 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:34.510 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-27T22:30:34.510 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-27T22:30:34.511 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-27T22:30:34.511 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T22:30:34.518 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T22:30:34.518 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T22:30:34.519 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T22:30:34.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T22:30:34.521 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T22:30:34.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T22:30:34.522 INFO:tasks.ceph.mds.d:Stopped 2023-11-27T22:30:34.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-27T22:30:34.563 INFO:tasks.ceph.mds.a:Started 2023-11-27T22:30:34.563 DEBUG:teuthology.parallel:result is None 2023-11-27T22:30:34.565 INFO:tasks.ceph.mds.c:Started 2023-11-27T22:30:34.565 DEBUG:teuthology.parallel:result is None 2023-11-27T22:30:34.565 INFO:tasks.ceph.mds.b:Started 2023-11-27T22:30:34.566 DEBUG:teuthology.parallel:result is None 2023-11-27T22:30:34.566 INFO:tasks.ceph.mds.d:Started 2023-11-27T22:30:34.566 DEBUG:teuthology.parallel:result is None 2023-11-27T22:30:34.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-27T22:30:34.640 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-11-27T22:30:34.641 INFO:tasks.ceph.mds.a.smithi154.stdout:starting mds.a at 2023-11-27T22:30:34.647 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2023-11-27T22:30:34.647 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2023-11-27T22:30:34.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.672+0000 7f8d8c9c9640 1 Processor -- start 2023-11-27T22:30:34.674 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.672+0000 7f8d8c9c9640 1 -- start start 2023-11-27T22:30:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8c9c9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d880d3900 0x7f8d880b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8c9c9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d880b2b10 con 0x7f8d8815d330 2023-11-27T22:30:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8c9c9640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d880d1590 con 0x7f8d880d2910 2023-11-27T22:30:34.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d86d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8d880d3900 0x7f8d880b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8659c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8d8815d330 0x7f8d880b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54636/0 (socket says 172.21.15.154:54636) 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8659c640 1 -- 172.21.15.154:0/3095058923 learned_addr learned my addr 172.21.15.154:0/3095058923 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/3095058923 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d880d1870 con 0x7f8d880d3900 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d86d9d640 1 -- 172.21.15.154:0/3095058923 >> v1:172.21.15.194:6789/0 conn(0x7f8d880d2910 legacy=0x7f8d880d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d8559a640 1 -- 172.21.15.154:0/3095058923 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146962985 0 0) 0x7f8d880b2b10 con 0x7f8d8815d330 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d86d9d640 1 -- 172.21.15.154:0/3095058923 >> v1:172.21.15.154:6789/0 conn(0x7f8d8815d330 legacy=0x7f8d880b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.676 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.673+0000 7f8d86d9d640 1 -- 172.21.15.154:0/3095058923 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880d1b50 con 0x7f8d880d3900 2023-11-27T22:30:34.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.674+0000 7f8d86d9d640 1 --2- 172.21.15.154:0/3095058923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d3900 0x7f8d880b6390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d8002bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7847e79193f4ba server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:34.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.674+0000 7f8d8559a640 1 -- 172.21.15.154:0/3095058923 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8002ca50 con 0x7f8d880d3900 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.674+0000 7f8d8559a640 1 -- 172.21.15.154:0/3095058923 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8002cbb0 con 0x7f8d880d3900 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.674+0000 7f8d8559a640 1 -- 172.21.15.154:0/3095058923 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80034440 con 0x7f8d880d3900 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/3095058923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d3900 msgr2=0x7f8d880b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/3095058923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d3900 0x7f8d880b6390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009d90 tx=0x7f8d8002bd20 comp rx=0 tx=0).stop 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/3095058923 shutdown_connections 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/3095058923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d3900 0x7f8d880b6390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/3095058923 >> 172.21.15.154:0/3095058923 conn(0x7f8d88072020 msgr2=0x7f8d88072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/3095058923 shutdown_connections 2023-11-27T22:30:34.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.675+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/3095058923 wait complete. 2023-11-27T22:30:34.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.676+0000 7f8d8c9c9640 1 Processor -- start 2023-11-27T22:30:34.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.676+0000 7f8d8c9c9640 1 -- start start 2023-11-27T22:30:34.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8c9c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 0x7f8d880ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8c9c9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d880d3900 0x7f8d880c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8c9c9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d8815d330 0x7f8d880c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8c9c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880c9c80 con 0x7f8d880d2910 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8c9c9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880cd2c0 con 0x7f8d880d3900 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8c9c9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8815e350 con 0x7f8d8815d330 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 0x7f8d880ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 0x7f8d880ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56446/0 (socket says 172.21.15.154:56446) 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 -- 172.21.15.154:0/316867718 learned_addr learned my addr 172.21.15.154:0/316867718 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d85d9b640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d880d3900 0x7f8d880c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d86d9d640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d8815d330 0x7f8d880c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 -- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d8815d330 msgr2=0x7f8d880c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d8815d330 0x7f8d880c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 -- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d880d3900 msgr2=0x7f8d880c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d880d3900 0x7f8d880c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.677+0000 7f8d8659c640 1 -- 172.21.15.154:0/316867718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80009a70 con 0x7f8d880d2910 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.678+0000 7f8d8659c640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 0x7f8d880ccd80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c430 tx=0x7f8d7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.678+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780074e0 con 0x7f8d880d2910 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.678+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d78007660 con 0x7f8d880d2910 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.678+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d78004a20 con 0x7f8d880d2910 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.678+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d88143520 con 0x7f8d880d2910 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.678+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8815dd00 con 0x7f8d880d2910 2023-11-27T22:30:34.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.679+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d88069400 con 0x7f8d880d2910 2023-11-27T22:30:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.679+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8d78004b80 con 0x7f8d880d2910 2023-11-27T22:30:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.680+0000 7f8d76ffd640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8d6806b1c0 0x7f8d6806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.680+0000 7f8d85d9b640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8d6806b1c0 0x7f8d6806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.680+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d78089380 con 0x7f8d880d2910 2023-11-27T22:30:34.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.680+0000 7f8d85d9b640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8d6806b1c0 0x7f8d6806d680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d881404c0 tx=0x7f8d7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:34.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.684+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8d78054460 con 0x7f8d880d2910 2023-11-27T22:30:34.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:34.865+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8d880b29f0 con 0x7f8d880d2910 2023-11-27T22:30:36.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.498+0000 7f8d76ffd640 1 -- 172.21.15.154:0/316867718 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d78057a80 con 0x7f8d880d2910 2023-11-27T22:30:36.500 INFO:teuthology.orchestra.run.smithi154.stderr: removed all blocklist entries 2023-11-27T22:30:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8d6806b1c0 msgr2=0x7f8d6806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8d6806b1c0 0x7f8d6806d680 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d881404c0 tx=0x7f8d7c009040 comp rx=0 tx=0).stop 2023-11-27T22:30:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 msgr2=0x7f8d880ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 0x7f8d880ccd80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c430 tx=0x7f8d7800c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 shutdown_connections 2023-11-27T22:30:36.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d880d3900 0x7f8d880c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8d6806b1c0 0x7f8d6806d680 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d8815d330 0x7f8d880c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 --2- 172.21.15.154:0/316867718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d880d2910 0x7f8d880ccd80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 >> 172.21.15.154:0/316867718 conn(0x7f8d88072020 msgr2=0x7f8d88072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 shutdown_connections 2023-11-27T22:30:36.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.501+0000 7f8d8c9c9640 1 -- 172.21.15.154:0/316867718 wait complete. 2023-11-27T22:30:36.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-27T22:30:36.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.621+0000 7f60c37ec640 1 Processor -- start 2023-11-27T22:30:36.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.621+0000 7f60c37ec640 1 -- start start 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c37ec640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60bc15d330 0x7f60bc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c37ec640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0b2b10 con 0x7f60bc0d3900 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c37ec640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0d1590 con 0x7f60bc0d2910 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c37ec640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc0d1870 con 0x7f60bc15d330 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c1588640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f60bc15d330 0x7f60bc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c1d89640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f60bc0d3900 0x7f60bc0b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54646/0 (socket says 172.21.15.154:54646) 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c1d89640 1 -- 172.21.15.154:0/3308948865 learned_addr learned my addr 172.21.15.154:0/3308948865 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c1588640 1 -- 172.21.15.154:0/3308948865 >> v1:172.21.15.194:6789/0 conn(0x7f60bc0d2910 legacy=0x7f60bc0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c1588640 1 -- 172.21.15.154:0/3308948865 >> v1:172.21.15.154:6789/0 conn(0x7f60bc0d3900 legacy=0x7f60bc0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60b3fff640 1 -- 172.21.15.154:0/3308948865 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905297304 0 0) 0x7f60bc0b2b10 con 0x7f60bc0d3900 2023-11-27T22:30:36.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.622+0000 7f60c1588640 1 -- 172.21.15.154:0/3308948865 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0d1b50 con 0x7f60bc15d330 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.623+0000 7f60c1588640 1 --2- 172.21.15.154:0/3308948865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc15d330 0x7f60bc0b8b80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f60b80097a0 tx=0x7f60b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a73a39d322ee1e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.623+0000 7f60b3fff640 1 -- 172.21.15.154:0/3308948865 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b802e070 con 0x7f60bc15d330 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.623+0000 7f60b3fff640 1 -- 172.21.15.154:0/3308948865 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b80315a0 con 0x7f60bc15d330 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.623+0000 7f60b3fff640 1 -- 172.21.15.154:0/3308948865 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8031930 con 0x7f60bc15d330 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 -- 172.21.15.154:0/3308948865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc15d330 msgr2=0x7f60bc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 --2- 172.21.15.154:0/3308948865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc15d330 0x7f60bc0b8b80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f60b80097a0 tx=0x7f60b802b840 comp rx=0 tx=0).stop 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 -- 172.21.15.154:0/3308948865 shutdown_connections 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 --2- 172.21.15.154:0/3308948865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc15d330 0x7f60bc0b8b80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 -- 172.21.15.154:0/3308948865 >> 172.21.15.154:0/3308948865 conn(0x7f60bc072020 msgr2=0x7f60bc072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:36.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 -- 172.21.15.154:0/3308948865 shutdown_connections 2023-11-27T22:30:36.627 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.624+0000 7f60c37ec640 1 -- 172.21.15.154:0/3308948865 wait complete. 2023-11-27T22:30:36.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.625+0000 7f60c37ec640 1 Processor -- start 2023-11-27T22:30:36.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.625+0000 7f60c37ec640 1 -- start start 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60bc0d2910 0x7f60bc0c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 0x7f60bc15f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60bc15d330 0x7f60bc15f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0c7f20 con 0x7f60bc0d3900 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0c72a0 con 0x7f60bc0d2910 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0c7580 con 0x7f60bc15d330 2023-11-27T22:30:36.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 0x7f60bc15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 0x7f60bc15f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56454/0 (socket says 172.21.15.154:56454) 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 -- 172.21.15.154:0/2095895187 learned_addr learned my addr 172.21.15.154:0/2095895187 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 -- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60bc15d330 msgr2=0x7f60bc15f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60bc15d330 0x7f60bc15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c1588640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60bc0d2910 0x7f60bc0c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 -- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60bc0d2910 msgr2=0x7f60bc0c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60bc0d2910 0x7f60bc0c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 -- 172.21.15.154:0/2095895187 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b8009400 con 0x7f60bc0d3900 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c0d87640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 0x7f60bc15f440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00c430 tx=0x7f60ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac011790 con 0x7f60bc0d3900 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac0118f0 con 0x7f60bc0d3900 2023-11-27T22:30:36.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc0c7860 con 0x7f60bc0d3900 2023-11-27T22:30:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.626+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac011ca0 con 0x7f60bc0d3900 2023-11-27T22:30:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.627+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc160250 con 0x7f60bc0d3900 2023-11-27T22:30:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.628+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc0c8060 con 0x7f60bc0d3900 2023-11-27T22:30:36.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.628+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f60ac01c460 con 0x7f60bc0d3900 2023-11-27T22:30:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.628+0000 7f60b1ffb640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f60a006b1c0 0x7f60a006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.628+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60ac089690 con 0x7f60bc0d3900 2023-11-27T22:30:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.628+0000 7f60c1588640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f60a006b1c0 0x7f60a006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:36.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.629+0000 7f60c1588640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f60a006b1c0 0x7f60a006d680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f60b8036000 tx=0x7f60b803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:36.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.632+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f60bc0c8060 con 0x7f60bc0d3900 2023-11-27T22:30:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.865+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f60bc0c8060 con 0x7f60bc0d3900 2023-11-27T22:30:36.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.865+0000 7f60b1ffb640 1 -- 172.21.15.154:0/2095895187 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f60bc0c8060 con 0x7f60bc0d3900 2023-11-27T22:30:36.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:36.868 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-27T22:30:36.868 INFO:teuthology.orchestra.run.smithi154.stdout: "auth_dump": [ 2023-11-27T22:30:36.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.868 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.a", 2023-11-27T22:30:36.868 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAYGGVlBks2OxAA4bQrCOU+i7B8hITtibvYBg==", 2023-11-27T22:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-11-27T22:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-11-27T22:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.870 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.b", 2023-11-27T22:30:36.870 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVlKNoCDBAA1QR6HUt+vhEmUJC6g4YdYw==", 2023-11-27T22:30:36.870 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.870 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.c", 2023-11-27T22:30:36.871 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVlDNn7BhAAtZaY+ycdpmuztUZzti3T+A==", 2023-11-27T22:30:36.872 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.872 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.872 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-11-27T22:30:36.872 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-11-27T22:30:36.872 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.872 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mds.d", 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVlLeNiExAAFZh7V7wGUUXIT4sCGIHs1g==", 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-11-27T22:30:36.873 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-11-27T22:30:36.874 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.874 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.874 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.0", 2023-11-27T22:30:36.874 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAcGGVlcF3oNxAAO2F7uGgoxLhQd83SbEAiPw==", 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.1", 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAfGGVlmhJuNhAAeOR+kMb5Ze6TXE0DgmrDUg==", 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.875 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.2", 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAiGGVlm0LsNBAAbSoRgp4qUWPQlG40AYoVcA==", 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.3", 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAlGGVl9VlIMxAAjrajQu2F1ObPZjTfp1cCZg==", 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.877 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.4", 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAsGGVlaeIfARAAT4HcGx60gjMX0oElkwuXDA==", 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.878 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.5", 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAuGGVlib7zOhAAjbkYKJSRVrLr/zS18CiibQ==", 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.6", 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAxGGVlk0mgORAAay/uSWKO+TE/re1yLktz+w==", 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.880 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "osd.7", 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA0GGVlQR70OBAAUOSb/7P2GFbZ++nZic7Q9A==", 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow profile osd", 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile osd", 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.881 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.0", 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVlAhSrFxAA3iO+CO56glsDGfCwT7XFtw==", 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.1", 2023-11-27T22:30:36.882 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVlDPzWIBAAPi+hZOUaD0dsIEUGc+WxBQ==", 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.2", 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVl6gF2HRAAzNuqgj5114hlvZVp+3icMg==", 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.883 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.3", 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAZGGVlkXmvJhAABkeC/4DLUK1Ooc6VCjJMdw==", 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow", 2023-11-27T22:30:36.884 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow r", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow rw", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow rwx" 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.admin", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAYGGVla6hCHhAAlFKYvm/VRCu+mbtcGVfkrQ==", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "mgr": "allow *", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow *", 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.885 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mds", 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA6GGVlfM4hNBAAg1vOTQVSANErJONSjoYJRA==", 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mds" 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-mgr", 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA6GGVlftchNBAAfBOzF/XLu6ilyWQGpeOfCA==", 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-osd", 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA6GGVlOt4hNBAAaI8u7VyO9Z1z0QoB+sWi6A==", 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-osd" 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd", 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA6GGVlmOQhNBAARALI4Rb1PotAk9Lnn2NmmQ==", 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-27T22:30:36.888 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA6GGVlX+shNBAA/x7IyP7LVHmpYnLv8Pmetw==", 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "client.bootstrap-rgw", 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQA6GGVlSvIhNBAAGLBvk7dkuZNbcdpfSs2Vng==", 2023-11-27T22:30:36.889 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.x", 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAYGGVlpKfFNxAAJxXO0Mff3j2s4fBmq/uWqA==", 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: "entity": "mgr.y", 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: "key": "AQAYGGVlIWOXMxAAG4LnC1Jz1fiKWPPltToLqw==", 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": { 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": "allow *", 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: "mon": "allow profile mgr", 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: "osd": "allow *" 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2023-11-27T22:30:36.891 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-27T22:30:36.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f60a006b1c0 msgr2=0x7f60a006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f60a006b1c0 0x7f60a006d680 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f60b8036000 tx=0x7f60b803d040 comp rx=0 tx=0).stop 2023-11-27T22:30:36.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 msgr2=0x7f60bc15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:36.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 0x7f60bc15f440 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00c430 tx=0x7f60ac00c8f0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 shutdown_connections 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f60a006b1c0 0x7f60a006d680 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60bc15d330 0x7f60bc15f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60bc0d3900 0x7f60bc15f440 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 --2- 172.21.15.154:0/2095895187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60bc0d2910 0x7f60bc0c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 >> 172.21.15.154:0/2095895187 conn(0x7f60bc072020 msgr2=0x7f60bc072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 shutdown_connections 2023-11-27T22:30:36.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.867+0000 7f60c37ec640 1 -- 172.21.15.154:0/2095895187 wait complete. 2023-11-27T22:30:36.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-27T22:30:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.995+0000 7fad865f5640 1 Processor -- start 2023-11-27T22:30:36.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.995+0000 7fad865f5640 1 -- start start 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad865f5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad8015d1d0 0x7fad8006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad865f5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fad800ad640 0x7fad8006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad865f5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad800adae0 con 0x7fad800aeb80 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad865f5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad800addc0 con 0x7fad8015d1d0 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad865f5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad800ae0a0 con 0x7fad800ad640 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad7ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad8015d1d0 0x7fad8006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad7ffff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad8015d1d0 0x7fad8006b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56470/0 (socket says 172.21.15.154:56470) 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad84b92640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fad800aeb80 0x7fad80160ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54662/0 (socket says 172.21.15.154:54662) 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad7ffff640 1 -- 172.21.15.154:0/1623543531 learned_addr learned my addr 172.21.15.154:0/1623543531 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.996+0000 7fad7f7fe640 1 --2- 172.21.15.154:0/1623543531 >> v2:172.21.15.194:3300/0 conn(0x7fad800ad640 0x7fad8006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7ffff640 1 -- 172.21.15.154:0/1623543531 >> v2:172.21.15.194:3300/0 conn(0x7fad800ad640 msgr2=0x7fad8006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:36.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7ffff640 1 --2- 172.21.15.154:0/1623543531 >> v2:172.21.15.194:3300/0 conn(0x7fad800ad640 0x7fad8006ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7ffff640 1 -- 172.21.15.154:0/1623543531 >> v1:172.21.15.154:6789/0 conn(0x7fad800aeb80 legacy=0x7fad80160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7effd640 1 -- 172.21.15.154:0/1623543531 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994202911 0 0) 0x7fad800adae0 con 0x7fad800aeb80 2023-11-27T22:30:37.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7ffff640 1 -- 172.21.15.154:0/1623543531 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800ae380 con 0x7fad8015d1d0 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7ffff640 1 --2- 172.21.15.154:0/1623543531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad8006b4e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fad800cc440 tx=0x7fad7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45150ec6bea72656 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7effd640 1 -- 172.21.15.154:0/1623543531 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70030860 con 0x7fad8015d1d0 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7effd640 1 -- 172.21.15.154:0/1623543531 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad700309c0 con 0x7fad8015d1d0 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.997+0000 7fad7effd640 1 -- 172.21.15.154:0/1623543531 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70030d50 con 0x7fad8015d1d0 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 -- 172.21.15.154:0/1623543531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 msgr2=0x7fad8006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 --2- 172.21.15.154:0/1623543531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad8006b4e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fad800cc440 tx=0x7fad7002b9a0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 -- 172.21.15.154:0/1623543531 shutdown_connections 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 --2- 172.21.15.154:0/1623543531 >> v2:172.21.15.194:3300/0 conn(0x7fad800ad640 0x7fad8006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.003 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 --2- 172.21.15.154:0/1623543531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad8006b4e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 -- 172.21.15.154:0/1623543531 >> 172.21.15.154:0/1623543531 conn(0x7fad80070e70 msgr2=0x7fad80071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 -- 172.21.15.154:0/1623543531 shutdown_connections 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.998+0000 7fad865f5640 1 -- 172.21.15.154:0/1623543531 wait complete. 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.999+0000 7fad865f5640 1 Processor -- start 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:36.999+0000 7fad865f5640 1 -- start start 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad865f5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800ad640 0x7fad80142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad865f5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad800aeb80 0x7fad801434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad865f5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad800c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad865f5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad80143240 con 0x7fad8015d1d0 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad865f5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad800ce3d0 con 0x7fad800ad640 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad865f5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad800cbc90 con 0x7fad800aeb80 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad84b92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad800c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad84b92640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad800c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56480/0 (socket says 172.21.15.154:56480) 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad84b92640 1 -- 172.21.15.154:0/703743863 learned_addr learned my addr 172.21.15.154:0/703743863 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad7ffff640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800ad640 0x7fad80142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad7f7fe640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad800aeb80 0x7fad801434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad84b92640 1 -- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad800aeb80 msgr2=0x7fad801434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad84b92640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad800aeb80 0x7fad801434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.000+0000 7fad84b92640 1 -- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800ad640 msgr2=0x7fad80142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad84b92640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800ad640 0x7fad80142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad84b92640 1 -- 172.21.15.154:0/703743863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad700094d0 con 0x7fad8015d1d0 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad7ffff640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800ad640 0x7fad80142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad7f7fe640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad800aeb80 0x7fad801434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad84b92640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad800c8470 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c7e0 tx=0x7fad7800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800a640 con 0x7fad8015d1d0 2023-11-27T22:30:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800a7c0 con 0x7fad8015d1d0 2023-11-27T22:30:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad800cdaa0 con 0x7fad8015d1d0 2023-11-27T22:30:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800ab70 con 0x7fad8015d1d0 2023-11-27T22:30:37.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.001+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad800ce060 con 0x7fad8015d1d0 2023-11-27T22:30:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.002+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad800ce510 con 0x7fad8015d1d0 2023-11-27T22:30:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.002+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fad7800acd0 con 0x7fad8015d1d0 2023-11-27T22:30:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.003+0000 7fad7cff9640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fad6c06b1f0 0x7fad6c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.003+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad78089020 con 0x7fad8015d1d0 2023-11-27T22:30:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.003+0000 7fad7ffff640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fad6c06b1f0 0x7fad6c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.003+0000 7fad7ffff640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fad6c06b1f0 0x7fad6c06d6b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad70036000 tx=0x7fad7003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.007+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fad78054010 con 0x7fad8015d1d0 2023-11-27T22:30:37.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.235+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fad800693e0 con 0x7fad8015d1d0 2023-11-27T22:30:37.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.237+0000 7fad7cff9640 1 -- 172.21.15.154:0/703743863 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad78018020 con 0x7fad8015d1d0 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fad6c06b1f0 msgr2=0x7fad6c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fad6c06b1f0 0x7fad6c06d6b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad70036000 tx=0x7fad7003b040 comp rx=0 tx=0).stop 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 msgr2=0x7fad800c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad800c8470 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fad7800c7e0 tx=0x7fad7800cca0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 shutdown_connections 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fad6c06b1f0 0x7fad6c06d6b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad8015d1d0 0x7fad800c8470 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fad800aeb80 0x7fad801434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 --2- 172.21.15.154:0/703743863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad800ad640 0x7fad80142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 >> 172.21.15.154:0/703743863 conn(0x7fad80070e70 msgr2=0x7fad800b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:37.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 shutdown_connections 2023-11-27T22:30:37.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.240+0000 7fad865f5640 1 -- 172.21.15.154:0/703743863 wait complete. 2023-11-27T22:30:37.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-27T22:30:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.352+0000 7f2c50010640 1 Processor -- start 2023-11-27T22:30:37.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.352+0000 7f2c50010640 1 -- start start 2023-11-27T22:30:37.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c50010640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2c4815d1d0 0x7f2c4806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c50010640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c48161ce0 con 0x7f2c480aeb80 2023-11-27T22:30:37.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c50010640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480adae0 con 0x7f2c480ad640 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c50010640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c480addc0 con 0x7f2c4815d1d0 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4e5ad640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f2c480aeb80 0x7f2c481615d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54666/0 (socket says 172.21.15.154:54666) 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4e5ad640 1 -- 172.21.15.154:0/1181118221 learned_addr learned my addr 172.21.15.154:0/1181118221 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4ddac640 1 --2- 172.21.15.154:0/1181118221 >> v2:172.21.15.194:3300/0 conn(0x7f2c4815d1d0 0x7f2c4806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4cdaa640 1 -- 172.21.15.154:0/1181118221 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610054035 0 0) 0x7f2c48161ce0 con 0x7f2c480aeb80 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4cdaa640 1 -- 172.21.15.154:0/1181118221 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c34003520 con 0x7f2c480aeb80 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4ddac640 1 -- 172.21.15.154:0/1181118221 >> v1:172.21.15.194:6789/0 conn(0x7f2c480ad640 legacy=0x7f2c48160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4cdaa640 1 -- 172.21.15.154:0/1181118221 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3490781063 0 0) 0x7f2c34003520 con 0x7f2c480aeb80 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4ddac640 1 -- 172.21.15.154:0/1181118221 >> v1:172.21.15.154:6789/0 conn(0x7f2c480aeb80 legacy=0x7f2c481615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.353+0000 7f2c4ddac640 1 -- 172.21.15.154:0/1181118221 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480ae0a0 con 0x7f2c4815d1d0 2023-11-27T22:30:37.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.354+0000 7f2c4ddac640 1 --2- 172.21.15.154:0/1181118221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c4815d1d0 0x7f2c4806b4e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c440097a0 tx=0x7f2c4402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc52f4db834a7c06 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.354+0000 7f2c4cdaa640 1 -- 172.21.15.154:0/1181118221 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4402f050 con 0x7f2c4815d1d0 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.354+0000 7f2c4cdaa640 1 -- 172.21.15.154:0/1181118221 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44031500 con 0x7f2c4815d1d0 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.354+0000 7f2c4cdaa640 1 -- 172.21.15.154:0/1181118221 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400019f0 con 0x7f2c4815d1d0 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 -- 172.21.15.154:0/1181118221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c4815d1d0 msgr2=0x7f2c4806b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 --2- 172.21.15.154:0/1181118221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c4815d1d0 0x7f2c4806b4e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c440097a0 tx=0x7f2c4402b820 comp rx=0 tx=0).stop 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 -- 172.21.15.154:0/1181118221 shutdown_connections 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 --2- 172.21.15.154:0/1181118221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c4815d1d0 0x7f2c4806b4e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 -- 172.21.15.154:0/1181118221 >> 172.21.15.154:0/1181118221 conn(0x7f2c48070e70 msgr2=0x7f2c48071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 -- 172.21.15.154:0/1181118221 shutdown_connections 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.355+0000 7f2c50010640 1 -- 172.21.15.154:0/1181118221 wait complete. 2023-11-27T22:30:37.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.356+0000 7f2c50010640 1 Processor -- start 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.356+0000 7f2c50010640 1 -- start start 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c50010640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 0x7f2c48151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c50010640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480aeb80 0x7f2c480c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c50010640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c4815d1d0 0x7f2c480cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c50010640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480cca60 con 0x7f2c480ad640 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c50010640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480ccd40 con 0x7f2c480aeb80 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c50010640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480cd020 con 0x7f2c4815d1d0 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 0x7f2c48151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 0x7f2c48151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56482/0 (socket says 172.21.15.154:56482) 2023-11-27T22:30:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 -- 172.21.15.154:0/228192198 learned_addr learned my addr 172.21.15.154:0/228192198 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4d5ab640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480aeb80 0x7f2c480c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4e5ad640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c4815d1d0 0x7f2c480cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 -- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c4815d1d0 msgr2=0x7f2c480cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c4815d1d0 0x7f2c480cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 -- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480aeb80 msgr2=0x7f2c480c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480aeb80 0x7f2c480c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 -- 172.21.15.154:0/228192198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009400 con 0x7f2c480ad640 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.357+0000 7f2c4ddac640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 0x7f2c48151010 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2c44036040 tx=0x7f2c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.358+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4403d940 con 0x7f2c480ad640 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.358+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4403daa0 con 0x7f2c480ad640 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.358+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c480cd300 con 0x7f2c480ad640 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.358+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4403de10 con 0x7f2c480ad640 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.358+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c480c6670 con 0x7f2c480ad640 2023-11-27T22:30:37.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.359+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c480cd7c0 con 0x7f2c480ad640 2023-11-27T22:30:37.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.359+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2c4403a040 con 0x7f2c480ad640 2023-11-27T22:30:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.359+0000 7f2c3e7fc640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2c2c06b1c0 0x7f2c2c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.360+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c440ab210 con 0x7f2c480ad640 2023-11-27T22:30:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.360+0000 7f2c4d5ab640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2c2c06b1c0 0x7f2c2c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.360+0000 7f2c4d5ab640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2c2c06b1c0 0x7f2c2c06d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c48152720 tx=0x7f2c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.364+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2c44076460 con 0x7f2c480ad640 2023-11-27T22:30:37.597 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.596+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f2c48069400 con 0x7f2c480ad640 2023-11-27T22:30:37.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.598+0000 7f2c3e7fc640 1 -- 172.21.15.154:0/228192198 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2c44079a80 con 0x7f2c480ad640 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2c2c06b1c0 msgr2=0x7f2c2c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2c2c06b1c0 0x7f2c2c06d680 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c48152720 tx=0x7f2c38009040 comp rx=0 tx=0).stop 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 msgr2=0x7f2c48151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 0x7f2c48151010 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2c44036040 tx=0x7f2c440046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 shutdown_connections 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c480aeb80 0x7f2c480c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f2c2c06b1c0 0x7f2c2c06d680 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2c4815d1d0 0x7f2c480cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 --2- 172.21.15.154:0/228192198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c480ad640 0x7f2c48151010 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 >> 172.21.15.154:0/228192198 conn(0x7f2c48070e70 msgr2=0x7f2c48152c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 shutdown_connections 2023-11-27T22:30:37.603 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.600+0000 7f2c50010640 1 -- 172.21.15.154:0/228192198 wait complete. 2023-11-27T22:30:37.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-27T22:30:37.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.711+0000 7f8e50973640 1 Processor -- start 2023-11-27T22:30:37.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.711+0000 7f8e50973640 1 -- start start 2023-11-27T22:30:37.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e50973640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0d3900 0x7f8e4c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e50973640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0b2b10 con 0x7f8e4c0d2910 2023-11-27T22:30:37.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e50973640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0d1590 con 0x7f8e4c15d330 2023-11-27T22:30:37.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e50973640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0d1870 con 0x7f8e4c0d3900 2023-11-27T22:30:37.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e4ad9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8e4c0d3900 0x7f8e4c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e49d9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f8e4c0d2910 0x7f8e4c0d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54680/0 (socket says 172.21.15.154:54680) 2023-11-27T22:30:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.712+0000 7f8e49d9b640 1 -- 172.21.15.154:0/3599220392 learned_addr learned my addr 172.21.15.154:0/3599220392 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.713+0000 7f8e4ad9d640 1 -- 172.21.15.154:0/3599220392 >> v1:172.21.15.194:6789/0 conn(0x7f8e4c15d330 legacy=0x7f8e4c0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.713+0000 7f8e4ad9d640 1 -- 172.21.15.154:0/3599220392 >> v1:172.21.15.154:6789/0 conn(0x7f8e4c0d2910 legacy=0x7f8e4c0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.713+0000 7f8e4959a640 1 -- 172.21.15.154:0/3599220392 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588636839 0 0) 0x7f8e4c0b2b10 con 0x7f8e4c0d2910 2023-11-27T22:30:37.718 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.713+0000 7f8e4ad9d640 1 -- 172.21.15.154:0/3599220392 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0d1b50 con 0x7f8e4c0d3900 2023-11-27T22:30:37.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.713+0000 7f8e4ad9d640 1 --2- 172.21.15.154:0/3599220392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c0b6390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009d90 tx=0x7f8e3c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65223d35c139c20 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e4959a640 1 -- 172.21.15.154:0/3599220392 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c02cc60 con 0x7f8e4c0d3900 2023-11-27T22:30:37.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e4959a640 1 -- 172.21.15.154:0/3599220392 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c02cdc0 con 0x7f8e4c0d3900 2023-11-27T22:30:37.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e4959a640 1 -- 172.21.15.154:0/3599220392 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c034660 con 0x7f8e4c0d3900 2023-11-27T22:30:37.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 -- 172.21.15.154:0/3599220392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 msgr2=0x7f8e4c0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 --2- 172.21.15.154:0/3599220392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c0b6390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009d90 tx=0x7f8e3c02beb0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 -- 172.21.15.154:0/3599220392 shutdown_connections 2023-11-27T22:30:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 --2- 172.21.15.154:0/3599220392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c0b6390 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 -- 172.21.15.154:0/3599220392 >> 172.21.15.154:0/3599220392 conn(0x7f8e4c072020 msgr2=0x7f8e4c072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 -- 172.21.15.154:0/3599220392 shutdown_connections 2023-11-27T22:30:37.721 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.714+0000 7f8e50973640 1 -- 172.21.15.154:0/3599220392 wait complete. 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 Processor -- start 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 -- start start 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e4c0d2910 0x7f8e4c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e4c15d330 0x7f8e4c0b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c15fce0 con 0x7f8e4c0d3900 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0ca910 con 0x7f8e4c15d330 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e50973640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0cabf0 con 0x7f8e4c0d2910 2023-11-27T22:30:37.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e49d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e49d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c15f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56506/0 (socket says 172.21.15.154:56506) 2023-11-27T22:30:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.716+0000 7f8e49d9b640 1 -- 172.21.15.154:0/841900723 learned_addr learned my addr 172.21.15.154:0/841900723 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e49d9b640 1 -- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e4c0d2910 msgr2=0x7f8e4c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e49d9b640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e4c0d2910 0x7f8e4c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e49d9b640 1 -- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e4c15d330 msgr2=0x7f8e4c0b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e4ad9d640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e4c15d330 0x7f8e4c0b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e49d9b640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e4c15d330 0x7f8e4c0b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e49d9b640 1 -- 172.21.15.154:0/841900723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c009a70 con 0x7f8e4c0d3900 2023-11-27T22:30:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e49d9b640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c15f7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400c4a0 tx=0x7f8e3400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340074e0 con 0x7f8e4c0d3900 2023-11-27T22:30:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34007640 con 0x7f8e4c0d3900 2023-11-27T22:30:37.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c0caed0 con 0x7f8e4c0d3900 2023-11-27T22:30:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34004a00 con 0x7f8e4c0d3900 2023-11-27T22:30:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.717+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0cb490 con 0x7f8e4c0d3900 2023-11-27T22:30:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.718+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c0ce310 con 0x7f8e4c0d3900 2023-11-27T22:30:37.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.718+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8e34004b60 con 0x7f8e4c0d3900 2023-11-27T22:30:37.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.719+0000 7f8e42ffd640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:37.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.719+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e34088bf0 con 0x7f8e4c0d3900 2023-11-27T22:30:37.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.719+0000 7f8e4a59c640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:37.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.719+0000 7f8e4a59c640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000f60 tx=0x7f8e440079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:37.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.723+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8e34053c70 con 0x7f8e4c0d3900 2023-11-27T22:30:37.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.953+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8e4c069400 con 0x7f8e4c0d3900 2023-11-27T22:30:37.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.955+0000 7f8e42ffd640 1 -- 172.21.15.154:0/841900723 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8e34018020 con 0x7f8e4c0d3900 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8e2c06b1c0 msgr2=0x7f8e2c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000f60 tx=0x7f8e440079b0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 msgr2=0x7f8e4c15f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c15f7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400c4a0 tx=0x7f8e3400c960 comp rx=0 tx=0).stop 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 shutdown_connections 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e4c15d330 0x7f8e4c0b8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8e2c06b1c0 0x7f8e2c06d680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.959 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e4c0d3900 0x7f8e4c15f7a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 --2- 172.21.15.154:0/841900723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e4c0d2910 0x7f8e4c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 >> 172.21.15.154:0/841900723 conn(0x7f8e4c072020 msgr2=0x7f8e4c0d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 shutdown_connections 2023-11-27T22:30:37.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:37.957+0000 7f8e50973640 1 -- 172.21.15.154:0/841900723 wait complete. 2023-11-27T22:30:37.970 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-27T22:30:38.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.070+0000 7f4ab444f640 1 Processor -- start 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.070+0000 7f4ab444f640 1 -- start start 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab444f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4aac150560 0x7f4aac0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab444f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4aac150940 0x7f4aac0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab444f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac0b49f0 con 0x7f4aac0b3390 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab444f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0b3de0 con 0x7f4aac150560 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab444f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0b40c0 con 0x7f4aac150940 2023-11-27T22:30:38.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab21eb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4aac150560 0x7f4aac0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab19ea640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4aac0b3390 0x7f4aac15d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:54682/0 (socket says 172.21.15.154:54682) 2023-11-27T22:30:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab21eb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4aac150560 0x7f4aac0b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56522/0 (socket says 172.21.15.154:56522) 2023-11-27T22:30:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab19ea640 1 -- 172.21.15.154:0/771442469 learned_addr learned my addr 172.21.15.154:0/771442469 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:38.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab29ec640 1 --2- 172.21.15.154:0/771442469 >> v2:172.21.15.194:3300/0 conn(0x7f4aac150940 0x7f4aac0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab21eb640 1 -- 172.21.15.154:0/771442469 >> v2:172.21.15.194:3300/0 conn(0x7f4aac150940 msgr2=0x7f4aac0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab21eb640 1 --2- 172.21.15.154:0/771442469 >> v2:172.21.15.194:3300/0 conn(0x7f4aac150940 0x7f4aac0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab21eb640 1 -- 172.21.15.154:0/771442469 >> v1:172.21.15.154:6789/0 conn(0x7f4aac0b3390 legacy=0x7f4aac15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab21eb640 1 -- 172.21.15.154:0/771442469 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0b43a0 con 0x7f4aac150560 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.071+0000 7f4ab11e9640 1 -- 172.21.15.154:0/771442469 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945003762 0 0) 0x7f4aac0b49f0 con 0x7f4aac0b3390 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.072+0000 7f4ab21eb640 1 --2- 172.21.15.154:0/771442469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac150560 0x7f4aac0b2e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4aac15d160 tx=0x7f4aa802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a6eeb99c736bd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.072+0000 7f4ab11e9640 1 -- 172.21.15.154:0/771442469 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8031830 con 0x7f4aac150560 2023-11-27T22:30:38.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.072+0000 7f4ab11e9640 1 -- 172.21.15.154:0/771442469 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa8031990 con 0x7f4aac150560 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.072+0000 7f4ab11e9640 1 -- 172.21.15.154:0/771442469 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8031d20 con 0x7f4aac150560 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.072+0000 7f4ab444f640 1 -- 172.21.15.154:0/771442469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac150560 msgr2=0x7f4aac0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.072+0000 7f4ab444f640 1 --2- 172.21.15.154:0/771442469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac150560 0x7f4aac0b2e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4aac15d160 tx=0x7f4aa802b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.073+0000 7f4ab444f640 1 -- 172.21.15.154:0/771442469 shutdown_connections 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.073+0000 7f4ab444f640 1 --2- 172.21.15.154:0/771442469 >> v2:172.21.15.194:3300/0 conn(0x7f4aac150940 0x7f4aac0ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.073+0000 7f4ab444f640 1 --2- 172.21.15.154:0/771442469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac150560 0x7f4aac0b2e50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.073+0000 7f4ab444f640 1 -- 172.21.15.154:0/771442469 >> 172.21.15.154:0/771442469 conn(0x7f4aac06a4d0 msgr2=0x7f4aac06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:38.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.073+0000 7f4ab444f640 1 -- 172.21.15.154:0/771442469 shutdown_connections 2023-11-27T22:30:38.079 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.073+0000 7f4ab444f640 1 -- 172.21.15.154:0/771442469 wait complete. 2023-11-27T22:30:38.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.074+0000 7f4ab444f640 1 Processor -- start 2023-11-27T22:30:38.081 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.074+0000 7f4ab444f640 1 -- start start 2023-11-27T22:30:38.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 0x7f4aac0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aac150560 0x7f4aac151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0adff0 0x7f4aac141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.082 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0adb60 con 0x7f4aac0b3390 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac14f090 con 0x7f4aac0adff0 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0acf50 con 0x7f4aac150560 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 0x7f4aac0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 0x7f4aac0ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56524/0 (socket says 172.21.15.154:56524) 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 -- 172.21.15.154:0/891666252 learned_addr learned my addr 172.21.15.154:0/891666252 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 -- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aac150560 msgr2=0x7f4aac151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.083 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab29ec640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0adff0 0x7f4aac141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aac150560 0x7f4aac151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 -- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0adff0 msgr2=0x7f4aac141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0adff0 0x7f4aac141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 -- 172.21.15.154:0/891666252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8009400 con 0x7f4aac0b3390 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab21eb640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 0x7f4aac0ac8e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009890 tx=0x7f4aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa803ba70 con 0x7f4aac0b3390 2023-11-27T22:30:38.084 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa803bbf0 con 0x7f4aac0b3390 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8045400 con 0x7f4aac0b3390 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac0ad230 con 0x7f4aac0b3390 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.075+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac0ad7f0 con 0x7f4aac0b3390 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.076+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac069400 con 0x7f4aac0b3390 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.077+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4aa804e440 con 0x7f4aac0b3390 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.077+0000 7f4aa2ffd640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4a9006b1f0 0x7f4a9006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.077+0000 7f4ab19ea640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4a9006b1f0 0x7f4a9006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.077+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4aa80ab970 con 0x7f4aac0b3390 2023-11-27T22:30:38.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.078+0000 7f4ab19ea640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4a9006b1f0 0x7f4a9006d6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c007fd0 tx=0x7f4a9c007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.086 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.082+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4aa8076a80 con 0x7f4aac0b3390 2023-11-27T22:30:38.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.314+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4aac0b1270 con 0x7f4aac0b3390 2023-11-27T22:30:38.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.317+0000 7f4aa2ffd640 1 -- 172.21.15.154:0/891666252 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4aa80350a0 con 0x7f4aac0b3390 2023-11-27T22:30:38.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4a9006b1f0 msgr2=0x7f4a9006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4a9006b1f0 0x7f4a9006d6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c007fd0 tx=0x7f4a9c007920 comp rx=0 tx=0).stop 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 msgr2=0x7f4aac0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 0x7f4aac0ac8e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009890 tx=0x7f4aa80046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 shutdown_connections 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4aac0adff0 0x7f4aac141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4a9006b1f0 0x7f4a9006d6b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4aac150560 0x7f4aac151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 --2- 172.21.15.154:0/891666252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac0b3390 0x7f4aac0ac8e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 >> 172.21.15.154:0/891666252 conn(0x7f4aac06a4d0 msgr2=0x7f4aac14f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:38.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 shutdown_connections 2023-11-27T22:30:38.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.319+0000 7f4ab444f640 1 -- 172.21.15.154:0/891666252 wait complete. 2023-11-27T22:30:38.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-27T22:30:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.430+0000 7f0da7ea6640 1 Processor -- start 2023-11-27T22:30:38.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.430+0000 7f0da7ea6640 1 -- start start 2023-11-27T22:30:38.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.431+0000 7f0da7ea6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0da00cebb0 0x7f0da00c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.431+0000 7f0da7ea6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00c7ee0 con 0x7f0da00c63c0 2023-11-27T22:30:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.431+0000 7f0da7ea6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da00cf330 con 0x7f0da015bbe0 2023-11-27T22:30:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.431+0000 7f0da7ea6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00c7920 con 0x7f0da00cebb0 2023-11-27T22:30:38.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.431+0000 7f0da6443640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0da00c63c0 0x7f0da015f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50122/0 (socket says 172.21.15.154:50122) 2023-11-27T22:30:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.431+0000 7f0da6443640 1 -- 172.21.15.154:0/4241910707 learned_addr learned my addr 172.21.15.154:0/4241910707 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111660947 0 0) 0x7f0da00c7ee0 con 0x7f0da00c63c0 2023-11-27T22:30:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d8c003520 con 0x7f0da00c63c0 2023-11-27T22:30:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 --2- 172.21.15.154:0/4241910707 >> v2:172.21.15.194:3300/0 conn(0x7f0da00cebb0 0x7f0da00c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1813238482 0 0) 0x7f0d8c003520 con 0x7f0da00c63c0 2023-11-27T22:30:38.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 >> v2:172.21.15.194:3300/0 conn(0x7f0da00cebb0 msgr2=0x7f0da00c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 --2- 172.21.15.154:0/4241910707 >> v2:172.21.15.194:3300/0 conn(0x7f0da00cebb0 0x7f0da00c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 >> v1:172.21.15.194:6789/0 conn(0x7f0da015bbe0 legacy=0x7f0da015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00c7c00 con 0x7f0da00c63c0 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f0d98001670 con 0x7f0da00c63c0 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 >> v1:172.21.15.154:6789/0 conn(0x7f0da00c63c0 legacy=0x7f0da015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c003970 0x7f0d8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8c0047c0 0x7f0d8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d8c0052a0 0x7f0d8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00c7920 con 0x7f0d8c0047c0 2023-11-27T22:30:38.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c00c170 con 0x7f0d8c003970 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c00c330 con 0x7f0d8c0052a0 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8c0047c0 0x7f0d8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5c42640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c003970 0x7f0d8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da6443640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d8c0052a0 0x7f0d8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 -- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d8c0052a0 msgr2=0x7f0d8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d8c0052a0 0x7f0d8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 -- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c003970 msgr2=0x7f0d8c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c003970 0x7f0d8c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da5441640 1 -- 172.21.15.154:0/4241910707 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c003520 con 0x7f0d8c0047c0 2023-11-27T22:30:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.432+0000 7f0da6443640 1 -- 172.21.15.154:0/4241910707 reap_dead start 2023-11-27T22:30:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.433+0000 7f0da5441640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8c0047c0 0x7f0d8c004c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009a90 tx=0x7f0d8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983f42ec618ac5a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.433+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9002c600 con 0x7f0d8c0047c0 2023-11-27T22:30:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.433+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9002c760 con 0x7f0d8c0047c0 2023-11-27T22:30:38.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.433+0000 7f0da4c40640 1 -- 172.21.15.154:0/4241910707 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9002caf0 con 0x7f0d8c0047c0 2023-11-27T22:30:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 -- 172.21.15.154:0/4241910707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8c0047c0 msgr2=0x7f0d8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8c0047c0 0x7f0d8c004c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009a90 tx=0x7f0d8c0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 -- 172.21.15.154:0/4241910707 shutdown_connections 2023-11-27T22:30:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/4241910707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8c0047c0 0x7f0d8c004c40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 -- 172.21.15.154:0/4241910707 >> 172.21.15.154:0/4241910707 conn(0x7f0da00b2c10 msgr2=0x7f0da00b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 -- 172.21.15.154:0/4241910707 shutdown_connections 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.434+0000 7f0da7ea6640 1 -- 172.21.15.154:0/4241910707 wait complete. 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.435+0000 7f0da7ea6640 1 Processor -- start 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.435+0000 7f0da7ea6640 1 -- start start 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c0047c0 0x7f0da0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 0x7f0da0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0da0157220 0x7f0da00c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0158390 con 0x7f0da0153480 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0157780 con 0x7f0d8c0047c0 2023-11-27T22:30:38.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0157a60 con 0x7f0da0157220 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 0x7f0da0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 0x7f0da0156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51280/0 (socket says 172.21.15.154:51280) 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 -- 172.21.15.154:0/2616666354 learned_addr learned my addr 172.21.15.154:0/2616666354 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da6443640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0da0157220 0x7f0da00c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5c42640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c0047c0 0x7f0da0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 -- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0da0157220 msgr2=0x7f0da00c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0da0157220 0x7f0da00c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 -- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c0047c0 msgr2=0x7f0da0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c0047c0 0x7f0da0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 -- 172.21.15.154:0/2616666354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da0157d40 con 0x7f0da0153480 2023-11-27T22:30:38.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da5441640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 0x7f0da0156ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0d9002c1a0 tx=0x7f0d90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003810 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90003970 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da0158020 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.436+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90003d00 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.437+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da0153c40 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.437+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da00c6f20 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.438+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f0d90034440 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.438+0000 7f0d967fc640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d8406b1f0 0x7f0d8406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.438+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0d900ab520 con 0x7f0da0153480 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.438+0000 7f0da5c42640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d8406b1f0 0x7f0d8406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.439+0000 7f0da5c42640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d8406b1f0 0x7f0d8406d6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c000f80 tx=0x7f0d9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.443+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f0d90076770 con 0x7f0da0153480 2023-11-27T22:30:38.673 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.672+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0da0069400 con 0x7f0da0153480 2023-11-27T22:30:38.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.673+0000 7f0d967fc640 1 -- 172.21.15.154:0/2616666354 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0d90003e60 con 0x7f0da0153480 2023-11-27T22:30:38.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.675+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d8406b1f0 msgr2=0x7f0d8406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.675+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d8406b1f0 0x7f0d8406d6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c000f80 tx=0x7f0d9c009040 comp rx=0 tx=0).stop 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.675+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 msgr2=0x7f0da0156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.675+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 0x7f0da0156ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0d9002c1a0 tx=0x7f0d90004730 comp rx=0 tx=0).stop 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 shutdown_connections 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f0d8406b1f0 0x7f0d8406d6b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0da0157220 0x7f0da00c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da0153480 0x7f0da0156ce0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 --2- 172.21.15.154:0/2616666354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d8c0047c0 0x7f0da0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 >> 172.21.15.154:0/2616666354 conn(0x7f0da00b2c10 msgr2=0x7f0da0154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:38.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 shutdown_connections 2023-11-27T22:30:38.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.676+0000 7f0da7ea6640 1 -- 172.21.15.154:0/2616666354 wait complete. 2023-11-27T22:30:38.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-27T22:30:38.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.788+0000 7f23155d5640 1 Processor -- start 2023-11-27T22:30:38.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.788+0000 7f23155d5640 1 -- start start 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f23155d5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231015d2d0 0x7f23100b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f23155d5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23100d1bb0 con 0x7f23100d2040 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f23155d5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231015d6b0 con 0x7f23100ce150 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f23155d5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100ce700 con 0x7f231015d2d0 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f230e7fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f23100d2040 0x7f23100cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50136/0 (socket says 172.21.15.154:50136) 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f230e7fc640 1 -- 172.21.15.154:0/2438587276 learned_addr learned my addr 172.21.15.154:0/2438587276 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f230effd640 1 --2- 172.21.15.154:0/2438587276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231015d2d0 0x7f23100b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.792 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545266489 0 0) 0x7f23100d1bb0 con 0x7f23100d2040 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.789+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f8003520 con 0x7f23100d2040 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134154784 0 0) 0x7f231015d6b0 con 0x7f23100ce150 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23100d1bb0 con 0x7f23100ce150 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761009948 0 0) 0x7f22f8003520 con 0x7f23100d2040 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230effd640 1 -- 172.21.15.154:0/2438587276 >> v1:172.21.15.194:6789/0 conn(0x7f23100ce150 legacy=0x7f23100b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230effd640 1 -- 172.21.15.154:0/2438587276 >> v1:172.21.15.154:6789/0 conn(0x7f23100d2040 legacy=0x7f23100cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230effd640 1 -- 172.21.15.154:0/2438587276 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23100d1280 con 0x7f231015d2d0 2023-11-27T22:30:38.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.790+0000 7f230effd640 1 --2- 172.21.15.154:0/2438587276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231015d2d0 0x7f23100b4c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2300009dc0 tx=0x7f230002bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfc5896d246fe61e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.796 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304001670 con 0x7f231015d2d0 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230002c910 con 0x7f231015d2d0 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f230dffb640 1 -- 172.21.15.154:0/2438587276 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230002cca0 con 0x7f231015d2d0 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 -- 172.21.15.154:0/2438587276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231015d2d0 msgr2=0x7f23100b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 --2- 172.21.15.154:0/2438587276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231015d2d0 0x7f23100b4c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2300009dc0 tx=0x7f230002bde0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 -- 172.21.15.154:0/2438587276 shutdown_connections 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 --2- 172.21.15.154:0/2438587276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f231015d2d0 0x7f23100b4c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 -- 172.21.15.154:0/2438587276 >> 172.21.15.154:0/2438587276 conn(0x7f2310072050 msgr2=0x7f2310072460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 -- 172.21.15.154:0/2438587276 shutdown_connections 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.791+0000 7f23155d5640 1 -- 172.21.15.154:0/2438587276 wait complete. 2023-11-27T22:30:38.797 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.792+0000 7f23155d5640 1 Processor -- start 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 -- start start 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 0x7f23101603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23100d2040 0x7f2310153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231015d2d0 0x7f231015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100cd140 con 0x7f23100ce150 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100cae80 con 0x7f231015d2d0 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f23155d5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100cb160 con 0x7f23100d2040 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f230effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 0x7f23101603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f230effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 0x7f23101603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51296/0 (socket says 172.21.15.154:51296) 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f230effd640 1 -- 172.21.15.154:0/200684846 learned_addr learned my addr 172.21.15.154:0/200684846 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f230f7fe640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231015d2d0 0x7f231015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.793+0000 7f230e7fc640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23100d2040 0x7f2310153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f230effd640 1 -- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23100d2040 msgr2=0x7f2310153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f230effd640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23100d2040 0x7f2310153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f230effd640 1 -- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231015d2d0 msgr2=0x7f231015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f230effd640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231015d2d0 0x7f231015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f230effd640 1 -- 172.21.15.154:0/200684846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009a70 con 0x7f23100ce150 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f230effd640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 0x7f23101603d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2300009ee0 tx=0x7f2300004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2300009450 con 0x7f23100ce150 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300040450 con 0x7f23100ce150 2023-11-27T22:30:38.799 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000407e0 con 0x7f23100ce150 2023-11-27T22:30:38.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23100cb440 con 0x7f23100ce150 2023-11-27T22:30:38.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.794+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231015dbf0 con 0x7f23100ce150 2023-11-27T22:30:38.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.795+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23100cb630 con 0x7f23100ce150 2023-11-27T22:30:38.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.796+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2300040940 con 0x7f23100ce150 2023-11-27T22:30:38.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.796+0000 7f22f77fe640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f22fc06b1c0 0x7f22fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:38.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.796+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23000abd90 con 0x7f23100ce150 2023-11-27T22:30:38.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.796+0000 7f230e7fc640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f22fc06b1c0 0x7f22fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:38.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.796+0000 7f230e7fc640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f22fc06b1c0 0x7f22fc06d680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f23100677e0 tx=0x7f23040016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:38.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:38.800+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f23100cb630 con 0x7f23100ce150 2023-11-27T22:30:38.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:38.996 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:39.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.055+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f23100cb630 con 0x7f23100ce150 2023-11-27T22:30:39.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.059+0000 7f22f77fe640 1 -- 172.21.15.154:0/200684846 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f23100cb630 con 0x7f23100ce150 2023-11-27T22:30:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f22fc06b1c0 msgr2=0x7f22fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f22fc06b1c0 0x7f22fc06d680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f23100677e0 tx=0x7f23040016f0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 msgr2=0x7f23101603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 0x7f23101603d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2300009ee0 tx=0x7f2300004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 shutdown_connections 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f231015d2d0 0x7f231015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f22fc06b1c0 0x7f22fc06d680 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23100d2040 0x7f2310153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 --2- 172.21.15.154:0/200684846 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23100ce150 0x7f23101603d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 >> 172.21.15.154:0/200684846 conn(0x7f2310072050 msgr2=0x7f23100b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 shutdown_connections 2023-11-27T22:30:39.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.061+0000 7f23155d5640 1 -- 172.21.15.154:0/200684846 wait complete. 2023-11-27T22:30:39.074 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:39.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.172+0000 7fe7472d3640 1 Processor -- start 2023-11-27T22:30:39.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.172+0000 7fe7472d3640 1 -- start start 2023-11-27T22:30:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe7472d3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe740143490 0x7fe7400b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe7472d3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74015e2a0 con 0x7fe74015e730 2023-11-27T22:30:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe7472d3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74015b240 con 0x7fe74015abf0 2023-11-27T22:30:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe7472d3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74015b520 con 0x7fe740143490 2023-11-27T22:30:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74506f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe740143490 0x7fe7400b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.175 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74486e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe74015e730 0x7fe74015a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50138/0 (socket says 172.21.15.154:50138) 2023-11-27T22:30:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74506f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe740143490 0x7fe7400b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51312/0 (socket says 172.21.15.154:51312) 2023-11-27T22:30:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74486e640 1 -- 172.21.15.154:0/2383685582 learned_addr learned my addr 172.21.15.154:0/2383685582 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74506f640 1 -- 172.21.15.154:0/2383685582 >> v1:172.21.15.194:6789/0 conn(0x7fe74015abf0 legacy=0x7fe7400b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74506f640 1 -- 172.21.15.154:0/2383685582 >> v1:172.21.15.154:6789/0 conn(0x7fe74015e730 legacy=0x7fe74015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe737fff640 1 -- 172.21.15.154:0/2383685582 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722387028 0 0) 0x7fe74015e2a0 con 0x7fe74015e730 2023-11-27T22:30:39.176 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.173+0000 7fe74506f640 1 -- 172.21.15.154:0/2383685582 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74015dc50 con 0x7fe740143490 2023-11-27T22:30:39.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.174+0000 7fe74506f640 1 --2- 172.21.15.154:0/2383685582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe7400b0cf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097a0 tx=0x7fe73c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2a2f0b9a46d724 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.174+0000 7fe737fff640 1 -- 172.21.15.154:0/2383685582 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c030610 con 0x7fe740143490 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.174+0000 7fe737fff640 1 -- 172.21.15.154:0/2383685582 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c030770 con 0x7fe740143490 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.174+0000 7fe737fff640 1 -- 172.21.15.154:0/2383685582 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c030b00 con 0x7fe740143490 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 -- 172.21.15.154:0/2383685582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 msgr2=0x7fe7400b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 --2- 172.21.15.154:0/2383685582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe7400b0cf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097a0 tx=0x7fe73c02b960 comp rx=0 tx=0).stop 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 -- 172.21.15.154:0/2383685582 shutdown_connections 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 --2- 172.21.15.154:0/2383685582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe7400b0cf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 -- 172.21.15.154:0/2383685582 >> 172.21.15.154:0/2383685582 conn(0x7fe74006a4d0 msgr2=0x7fe74006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 -- 172.21.15.154:0/2383685582 shutdown_connections 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.175+0000 7fe7472d3640 1 -- 172.21.15.154:0/2383685582 wait complete. 2023-11-27T22:30:39.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.176+0000 7fe7472d3640 1 Processor -- start 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.176+0000 7fe7472d3640 1 -- start start 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe74013f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe74015abf0 0x7fe74015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74015e730 0x7fe7400afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401f2f40 con 0x7fe740143490 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74013f870 con 0x7fe74015abf0 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74015bfd0 con 0x7fe74015e730 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe74013f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe74013f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51318/0 (socket says 172.21.15.154:51318) 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 -- 172.21.15.154:0/1380213674 learned_addr learned my addr 172.21.15.154:0/1380213674 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74486e640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe74015abf0 0x7fe74015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe745870640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74015e730 0x7fe7400afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 -- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74015e730 msgr2=0x7fe7400afe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74015e730 0x7fe7400afe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 -- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe74015abf0 msgr2=0x7fe74015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe74015abf0 0x7fe74015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 -- 172.21.15.154:0/1380213674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c009400 con 0x7fe740143490 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe745870640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74015e730 0x7fe7400afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe74506f640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe74013f330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000c00 tx=0x7fe73c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c039c90 con 0x7fe740143490 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c03f040 con 0x7fe740143490 2023-11-27T22:30:39.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c004030 con 0x7fe740143490 2023-11-27T22:30:39.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.177+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74015c2b0 con 0x7fe740143490 2023-11-27T22:30:39.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.178+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74015c870 con 0x7fe740143490 2023-11-27T22:30:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.179+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7401f3090 con 0x7fe740143490 2023-11-27T22:30:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.179+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fe73c004190 con 0x7fe740143490 2023-11-27T22:30:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.179+0000 7fe735ffb640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe72406b1c0 0x7fe72406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.179+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe73c0ab3f0 con 0x7fe740143490 2023-11-27T22:30:39.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.179+0000 7fe74486e640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe72406b1c0 0x7fe72406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.180+0000 7fe74486e640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe72406b1c0 0x7fe72406d680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe740143e10 tx=0x7fe730007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.183+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fe73c076500 con 0x7fe740143490 2023-11-27T22:30:39.353 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.352+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe740069400 con 0x7fe740143490 2023-11-27T22:30:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.353+0000 7fe735ffb640 1 -- 172.21.15.154:0/1380213674 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12882 (secure 0 0 0) 0x7fe73c079b20 con 0x7fe740143490 2023-11-27T22:30:39.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:39.354 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":30,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:36.497629+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe72406b1c0 msgr2=0x7fe72406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe72406b1c0 0x7fe72406d680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe740143e10 tx=0x7fe730007d00 comp rx=0 tx=0).stop 2023-11-27T22:30:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 msgr2=0x7fe74013f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe74013f330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000c00 tx=0x7fe73c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 shutdown_connections 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe74015abf0 0x7fe74015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.354+0000 7fe7472d3640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fe72406b1c0 0x7fe72406d680 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.355+0000 7fe7472d3640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe74015e730 0x7fe7400afe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.355+0000 7fe7472d3640 1 --2- 172.21.15.154:0/1380213674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe740143490 0x7fe74013f330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.355+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 >> 172.21.15.154:0/1380213674 conn(0x7fe74006a4d0 msgr2=0x7fe740070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.355+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 shutdown_connections 2023-11-27T22:30:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.355+0000 7fe7472d3640 1 -- 172.21.15.154:0/1380213674 wait complete. 2023-11-27T22:30:39.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T22:30:39.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T22:30:39.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.470+0000 7f14e18c2640 1 Processor -- start 2023-11-27T22:30:39.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.470+0000 7f14e18c2640 1 -- start start 2023-11-27T22:30:39.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14e18c2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f14dc0d3900 0x7f14dc0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14e18c2640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc0b2b10 con 0x7f14dc15d330 2023-11-27T22:30:39.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14e18c2640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc0d1590 con 0x7f14dc0d2910 2023-11-27T22:30:39.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14e18c2640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc0d1870 con 0x7f14dc0d3900 2023-11-27T22:30:39.473 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14daffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f14dc15d330 0x7f14dc0b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50154/0 (socket says 172.21.15.154:50154) 2023-11-27T22:30:39.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14daffd640 1 -- 172.21.15.154:0/1713469278 learned_addr learned my addr 172.21.15.154:0/1713469278 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:39.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.471+0000 7f14db7fe640 1 --2- 172.21.15.154:0/1713469278 >> v2:172.21.15.154:3300/0 conn(0x7f14dc0d3900 0x7f14dc0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.472+0000 7f14db7fe640 1 -- 172.21.15.154:0/1713469278 >> v1:172.21.15.194:6789/0 conn(0x7f14dc0d2910 legacy=0x7f14dc0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.472+0000 7f14db7fe640 1 -- 172.21.15.154:0/1713469278 >> v1:172.21.15.154:6789/0 conn(0x7f14dc15d330 legacy=0x7f14dc0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.472+0000 7f14d9ffb640 1 -- 172.21.15.154:0/1713469278 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682597354 0 0) 0x7f14dc0b2b10 con 0x7f14dc15d330 2023-11-27T22:30:39.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.472+0000 7f14db7fe640 1 -- 172.21.15.154:0/1713469278 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0d1b50 con 0x7f14dc0d3900 2023-11-27T22:30:39.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.472+0000 7f14db7fe640 1 --2- 172.21.15.154:0/1713469278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0d3900 0x7f14dc0b6390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009d90 tx=0x7f14d402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95f6fdccbe70f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14d9ffb640 1 -- 172.21.15.154:0/1713469278 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d402cc60 con 0x7f14dc0d3900 2023-11-27T22:30:39.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14d9ffb640 1 -- 172.21.15.154:0/1713469278 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d402cdc0 con 0x7f14dc0d3900 2023-11-27T22:30:39.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14d9ffb640 1 -- 172.21.15.154:0/1713469278 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4034660 con 0x7f14dc0d3900 2023-11-27T22:30:39.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 -- 172.21.15.154:0/1713469278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0d3900 msgr2=0x7f14dc0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 --2- 172.21.15.154:0/1713469278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0d3900 0x7f14dc0b6390 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009d90 tx=0x7f14d402beb0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 -- 172.21.15.154:0/1713469278 shutdown_connections 2023-11-27T22:30:39.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 --2- 172.21.15.154:0/1713469278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc0d3900 0x7f14dc0b6390 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 -- 172.21.15.154:0/1713469278 >> 172.21.15.154:0/1713469278 conn(0x7f14dc072020 msgr2=0x7f14dc072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 -- 172.21.15.154:0/1713469278 shutdown_connections 2023-11-27T22:30:39.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.473+0000 7f14e18c2640 1 -- 172.21.15.154:0/1713469278 wait complete. 2023-11-27T22:30:39.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.475+0000 7f14e18c2640 1 Processor -- start 2023-11-27T22:30:39.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.475+0000 7f14e18c2640 1 -- start start 2023-11-27T22:30:39.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.475+0000 7f14e18c2640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14dc0d2910 0x7f14dc15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14e18c2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0d3900 0x7f14dc0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14e18c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 0x7f14dc0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14e18c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc1e6de0 con 0x7f14dc15d330 2023-11-27T22:30:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14e18c2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc15bc30 con 0x7f14dc0d3900 2023-11-27T22:30:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14e18c2640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0cb220 con 0x7f14dc0d2910 2023-11-27T22:30:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 0x7f14dc0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 0x7f14dc0c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51332/0 (socket says 172.21.15.154:51332) 2023-11-27T22:30:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 -- 172.21.15.154:0/3356135587 learned_addr learned my addr 172.21.15.154:0/3356135587 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:39.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14da7fc640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0d3900 0x7f14dc0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14daffd640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14dc0d2910 0x7f14dc15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 -- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14dc0d2910 msgr2=0x7f14dc15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14dc0d2910 0x7f14dc15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 -- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0d3900 msgr2=0x7f14dc0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0d3900 0x7f14dc0c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 -- 172.21.15.154:0/3356135587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d4009a70 con 0x7f14dc15d330 2023-11-27T22:30:39.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14db7fe640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 0x7f14dc0c90b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009d90 tx=0x7f14d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.476+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4040450 con 0x7f14dc15d330 2023-11-27T22:30:39.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.477+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d40405d0 con 0x7f14dc15d330 2023-11-27T22:30:39.485 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.477+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc0cb500 con 0x7f14dc15d330 2023-11-27T22:30:39.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.477+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4040980 con 0x7f14dc15d330 2023-11-27T22:30:39.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.477+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc0cbac0 con 0x7f14dc15d330 2023-11-27T22:30:39.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.478+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc1e6f70 con 0x7f14dc15d330 2023-11-27T22:30:39.486 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.478+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f14d4040ae0 con 0x7f14dc15d330 2023-11-27T22:30:39.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.479+0000 7f14c3fff640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f14c806b1c0 0x7f14c806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.479+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f14d40ac110 con 0x7f14dc15d330 2023-11-27T22:30:39.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.479+0000 7f14daffd640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f14c806b1c0 0x7f14c806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.479+0000 7f14daffd640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f14c806b1c0 0x7f14c806d680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000f60 tx=0x7f14cc007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.483+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f14dc1e6f70 con 0x7f14dc15d330 2023-11-27T22:30:39.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.652+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14dc1e6f70 con 0x7f14dc15d330 2023-11-27T22:30:39.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.653+0000 7f14c3fff640 1 -- 172.21.15.154:0/3356135587 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14dc1e6f70 con 0x7f14dc15d330 2023-11-27T22:30:39.655 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f14c806b1c0 msgr2=0x7f14c806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f14c806b1c0 0x7f14c806d680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000f60 tx=0x7f14cc007e40 comp rx=0 tx=0).stop 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 msgr2=0x7f14dc0c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 0x7f14dc0c90b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009d90 tx=0x7f14d4004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 shutdown_connections 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc0d3900 0x7f14dc0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f14c806b1c0 0x7f14c806d680 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f14dc15d330 0x7f14dc0c90b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 --2- 172.21.15.154:0/3356135587 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f14dc0d2910 0x7f14dc15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 >> 172.21.15.154:0/3356135587 conn(0x7f14dc072020 msgr2=0x7f14dc0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 shutdown_connections 2023-11-27T22:30:39.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.655+0000 7f14e18c2640 1 -- 172.21.15.154:0/3356135587 wait complete. 2023-11-27T22:30:39.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T22:30:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.766+0000 7f07349dc640 1 Processor -- start 2023-11-27T22:30:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.766+0000 7f07349dc640 1 -- start start 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f07349dc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0730150560 0x7f07300b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f07349dc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0730150940 0x7f07300ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f07349dc640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300b49f0 con 0x7f07300b3390 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f07349dc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300b3de0 con 0x7f0730150560 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f07349dc640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300b40c0 con 0x7f0730150940 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0730150560 0x7f07300b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0730150560 0x7f07300b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51346/0 (socket says 172.21.15.154:51346) 2023-11-27T22:30:39.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 -- 172.21.15.154:0/2844690912 learned_addr learned my addr 172.21.15.154:0/2844690912 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 -- 172.21.15.154:0/2844690912 >> v2:172.21.15.194:3300/0 conn(0x7f0730150940 msgr2=0x7f07300ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 --2- 172.21.15.154:0/2844690912 >> v2:172.21.15.194:3300/0 conn(0x7f0730150940 0x7f07300ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 -- 172.21.15.154:0/2844690912 >> v1:172.21.15.194:6789/0 conn(0x7f07300b3390 legacy=0x7f073015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:39.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.767+0000 7f072e59c640 1 -- 172.21.15.154:0/2844690912 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300b43a0 con 0x7f0730150560 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.768+0000 7f072e59c640 1 --2- 172.21.15.154:0/2844690912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0730150560 0x7f07300b2e50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f073015d160 tx=0x7f072002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1929a3739817a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.768+0000 7f072d59a640 1 -- 172.21.15.154:0/2844690912 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720031870 con 0x7f0730150560 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.768+0000 7f072d59a640 1 -- 172.21.15.154:0/2844690912 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07200319d0 con 0x7f0730150560 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.768+0000 7f072d59a640 1 -- 172.21.15.154:0/2844690912 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720031d60 con 0x7f0730150560 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.768+0000 7f07349dc640 1 -- 172.21.15.154:0/2844690912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0730150560 msgr2=0x7f07300b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.768+0000 7f07349dc640 1 --2- 172.21.15.154:0/2844690912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0730150560 0x7f07300b2e50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f073015d160 tx=0x7f072002b910 comp rx=0 tx=0).stop 2023-11-27T22:30:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.769+0000 7f07349dc640 1 -- 172.21.15.154:0/2844690912 shutdown_connections 2023-11-27T22:30:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.769+0000 7f07349dc640 1 --2- 172.21.15.154:0/2844690912 >> v2:172.21.15.194:3300/0 conn(0x7f0730150940 0x7f07300ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.769+0000 7f07349dc640 1 --2- 172.21.15.154:0/2844690912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0730150560 0x7f07300b2e50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.769+0000 7f07349dc640 1 -- 172.21.15.154:0/2844690912 >> 172.21.15.154:0/2844690912 conn(0x7f073006a4d0 msgr2=0x7f073006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.769+0000 7f07349dc640 1 -- 172.21.15.154:0/2844690912 shutdown_connections 2023-11-27T22:30:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.769+0000 7f07349dc640 1 -- 172.21.15.154:0/2844690912 wait complete. 2023-11-27T22:30:39.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.770+0000 7f07349dc640 1 Processor -- start 2023-11-27T22:30:39.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.770+0000 7f07349dc640 1 -- start start 2023-11-27T22:30:39.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07300b3390 0x7f0730154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730150560 0x7f0730071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 0x7f0730071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730154fe0 con 0x7f07301572a0 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07301efd70 con 0x7f07300b3390 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07301ef1f0 con 0x7f0730150560 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 0x7f0730071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 0x7f0730071590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51356/0 (socket says 172.21.15.154:51356) 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 -- 172.21.15.154:0/3903707927 learned_addr learned my addr 172.21.15.154:0/3903707927 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072e59c640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07300b3390 0x7f0730154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072dd9b640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730150560 0x7f0730071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 -- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730150560 msgr2=0x7f0730071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730150560 0x7f0730071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 -- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07300b3390 msgr2=0x7f0730154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07300b3390 0x7f0730154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 -- 172.21.15.154:0/3903707927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200094d0 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072dd9b640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730150560 0x7f0730071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f072ed9d640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 0x7f0730071590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f072800b970 tx=0x7f072800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072800cb40 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800ccc0 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0728014680 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07301ef4d0 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.771+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07301efa90 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.772+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07301f0020 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.773+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f072801d3b0 con 0x7f07301572a0 2023-11-27T22:30:39.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.773+0000 7f071effd640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f071006b1c0 0x7f071006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.773+0000 7f072e59c640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f071006b1c0 0x7f071006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.773+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07280895c0 con 0x7f07301572a0 2023-11-27T22:30:39.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.774+0000 7f072e59c640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f071006b1c0 0x7f071006d680 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0720036000 tx=0x7f072003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:39.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.777+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f07280546d0 con 0x7f07301572a0 2023-11-27T22:30:39.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.946+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0730069400 con 0x7f07301572a0 2023-11-27T22:30:39.948 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.947+0000 7f071effd640 1 -- 172.21.15.154:0/3903707927 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0728019090 con 0x7f07301572a0 2023-11-27T22:30:39.948 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:39.948 INFO:teuthology.orchestra.run.smithi154.stdout:[ 2023-11-27T22:30:39.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2023-11-27T22:30:39.949 INFO:teuthology.orchestra.run.smithi154.stdout: "poolnum": 1, 2023-11-27T22:30:39.949 INFO:teuthology.orchestra.run.smithi154.stdout: "poolname": ".mgr" 2023-11-27T22:30:39.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:39.949 INFO:teuthology.orchestra.run.smithi154.stdout:] 2023-11-27T22:30:39.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f071006b1c0 msgr2=0x7f071006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.950 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f071006b1c0 0x7f071006d680 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0720036000 tx=0x7f072003c040 comp rx=0 tx=0).stop 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 msgr2=0x7f0730071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 0x7f0730071590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f072800b970 tx=0x7f072800be30 comp rx=0 tx=0).stop 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 shutdown_connections 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f071006b1c0 0x7f071006d680 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07301572a0 0x7f0730071590 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0730150560 0x7f0730071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 --2- 172.21.15.154:0/3903707927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07300b3390 0x7f0730154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.948+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 >> 172.21.15.154:0/3903707927 conn(0x7f073006a4d0 msgr2=0x7f073014fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.949+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 shutdown_connections 2023-11-27T22:30:39.951 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:39.949+0000 7f07349dc640 1 -- 172.21.15.154:0/3903707927 wait complete. 2023-11-27T22:30:39.961 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T22:30:39.961 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T22:30:40.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.064+0000 7f7fa9ee5640 1 Processor -- start 2023-11-27T22:30:40.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.065+0000 7f7fa9ee5640 1 -- start start 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.065+0000 7f7fa9ee5640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7fa40ceb70 0x7f7fa40cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.065+0000 7f7fa9ee5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa4071770 con 0x7f7fa4144980 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.065+0000 7f7fa9ee5640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa40ccdc0 con 0x7f7fa40b4370 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.065+0000 7f7fa9ee5640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa415ced0 con 0x7f7fa40ceb70 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa37fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7fa4144980 0x7f7fa415c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50170/0 (socket says 172.21.15.154:50170) 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa37fe640 1 -- 172.21.15.154:0/559933384 learned_addr learned my addr 172.21.15.154:0/559933384 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa2ffd640 1 --2- 172.21.15.154:0/559933384 >> v2:172.21.15.194:3300/0 conn(0x7f7fa40ceb70 0x7f7fa40cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474182106 0 0) 0x7f7fa4071770 con 0x7f7fa4144980 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c003520 con 0x7f7fa4144980 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669044185 0 0) 0x7f7f8c003520 con 0x7f7fa4144980 2023-11-27T22:30:40.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 >> v2:172.21.15.194:3300/0 conn(0x7f7fa40ceb70 msgr2=0x7f7fa40cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 --2- 172.21.15.154:0/559933384 >> v2:172.21.15.194:3300/0 conn(0x7f7fa40ceb70 0x7f7fa40cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 >> v1:172.21.15.194:6789/0 conn(0x7f7fa40b4370 legacy=0x7f7fa4071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40cd0a0 con 0x7f7fa4144980 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f7f94001670 con 0x7f7fa4144980 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 >> v1:172.21.15.154:6789/0 conn(0x7f7fa4144980 legacy=0x7f7fa415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f8c0047c0 0x7f7f8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f8c005180 0x7f7f8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa415ced0 con 0x7f7f8c003970 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00c020 con 0x7f7f8c005180 2023-11-27T22:30:40.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00c1e0 con 0x7f7f8c0047c0 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa2ffd640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f8c0047c0 0x7f7f8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.066+0000 7f7fa3fff640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f8c005180 0x7f7f8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa37fe640 1 -- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f8c0047c0 msgr2=0x7f7f8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f8c0047c0 0x7f7f8c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa37fe640 1 -- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f8c005180 msgr2=0x7f7f8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f8c005180 0x7f7f8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa37fe640 1 -- 172.21.15.154:0/559933384 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c003520 con 0x7f7f8c003970 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa3fff640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f8c005180 0x7f7f8c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa2ffd640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7f8c0047c0 0x7f7f8c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa3fff640 1 -- 172.21.15.154:0/559933384 reap_dead start 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c240 tx=0x7f7f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4ea7441a552669 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:40.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94005ad0 con 0x7f7f8c003970 2023-11-27T22:30:40.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f94005c50 con 0x7f7f8c003970 2023-11-27T22:30:40.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.067+0000 7f7fa27fc640 1 -- 172.21.15.154:0/559933384 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9402c8b0 con 0x7f7f8c003970 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/559933384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 msgr2=0x7f7f8c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c240 tx=0x7f7f8c0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/559933384 shutdown_connections 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/559933384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/559933384 >> 172.21.15.154:0/559933384 conn(0x7f7fa406a4d0 msgr2=0x7f7fa406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/559933384 shutdown_connections 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.068+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/559933384 wait complete. 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.069+0000 7f7fa9ee5640 1 Processor -- start 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.069+0000 7f7fa9ee5640 1 -- start start 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa9ee5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7fa4139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa9ee5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa4158110 0x7f7fa4139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa9ee5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa4140700 0x7f7fa40b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa9ee5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4157700 con 0x7f7f8c003970 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa9ee5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40b39f0 con 0x7f7fa4140700 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa9ee5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40b3cd0 con 0x7f7fa4158110 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7fa4139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7fa4139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51374/0 (socket says 172.21.15.154:51374) 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 -- 172.21.15.154:0/1532050752 learned_addr learned my addr 172.21.15.154:0/1532050752 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa2ffd640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa4158110 0x7f7fa4139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa3fff640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa4140700 0x7f7fa40b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 -- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa4158110 msgr2=0x7f7fa4139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa4158110 0x7f7fa4139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 -- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa4140700 msgr2=0x7f7fa40b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa4140700 0x7f7fa40b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 -- 172.21.15.154:0/1532050752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40b3fb0 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa3fff640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa4140700 0x7f7fa40b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.070+0000 7f7fa37fe640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7fa4139330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7f9402c450 tx=0x7f7f9402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.071+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9403c040 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.071+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9402cd80 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.071+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94007290 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.071+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa4157910 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.071+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa40b2910 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.071+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa4155b10 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.072+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7f94032070 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.072+0000 7f7f8bfff640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7f9006b1c0 0x7f7f9006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.072+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f940aa4f0 con 0x7f7f8c003970 2023-11-27T22:30:40.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.072+0000 7f7fa2ffd640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7f9006b1c0 0x7f7f9006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.073+0000 7f7fa2ffd640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7f9006b1c0 0x7f7f9006d680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ae4b0 tx=0x7f7f98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:40.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.077+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7f94075570 con 0x7f7f8c003970 2023-11-27T22:30:40.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.242+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7fa4069400 con 0x7f7f8c003970 2023-11-27T22:30:40.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.676+0000 7f7f8bfff640 1 -- 172.21.15.154:0/1532050752 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7f94078b90 con 0x7f7f8c003970 2023-11-27T22:30:40.679 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' created 2023-11-27T22:30:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7f9006b1c0 msgr2=0x7f7f9006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7f9006b1c0 0x7f7f9006d680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ae4b0 tx=0x7f7f98008040 comp rx=0 tx=0).stop 2023-11-27T22:30:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 msgr2=0x7f7fa4139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7fa4139330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7f9402c450 tx=0x7f7f9402e070 comp rx=0 tx=0).stop 2023-11-27T22:30:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 shutdown_connections 2023-11-27T22:30:40.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7fa4140700 0x7f7fa40b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7f9006b1c0 0x7f7f9006d680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7fa4158110 0x7f7fa4139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 --2- 172.21.15.154:0/1532050752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f8c003970 0x7f7fa4139330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 >> 172.21.15.154:0/1532050752 conn(0x7f7fa406a4d0 msgr2=0x7f7fa40cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 shutdown_connections 2023-11-27T22:30:40.682 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.679+0000 7f7fa9ee5640 1 -- 172.21.15.154:0/1532050752 wait complete. 2023-11-27T22:30:40.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T22:30:40.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 Processor -- start 2023-11-27T22:30:40.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 -- start start 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd14413d270 0x7fd1440b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd144140500 con 0x7fd14413fa10 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd144140740 con 0x7fd14413d270 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.800+0000 7fd149243640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415b690 con 0x7fd14413ce90 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd13a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd14413d270 0x7fd1440b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd14359e640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fd14413fa10 0x7fd14413fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50184/0 (socket says 172.21.15.154:50184) 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd13a59c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd14413d270 0x7fd1440b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51376/0 (socket says 172.21.15.154:51376) 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd14359e640 1 -- 172.21.15.154:0/2921245789 learned_addr learned my addr 172.21.15.154:0/2921245789 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:40.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd142d9d640 1 --2- 172.21.15.154:0/2921245789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd13a59c640 1 -- 172.21.15.154:0/2921245789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 msgr2=0x7fd1440b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd13a59c640 1 --2- 172.21.15.154:0/2921245789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd13a59c640 1 -- 172.21.15.154:0/2921245789 >> v1:172.21.15.154:6789/0 conn(0x7fd14413fa10 legacy=0x7fd14413fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd14259c640 1 -- 172.21.15.154:0/2921245789 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201948691 0 0) 0x7fd13c001490 con 0x7fd14413fa10 2023-11-27T22:30:40.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.801+0000 7fd13a59c640 1 -- 172.21.15.154:0/2921245789 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14415ebd0 con 0x7fd14413d270 2023-11-27T22:30:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd13a59c640 1 --2- 172.21.15.154:0/2921245789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413d270 0x7fd1440b1130 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00ba70 tx=0x7fd12c02e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa80fd364ade8fb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd14259c640 1 -- 172.21.15.154:0/2921245789 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c02ee30 con 0x7fd14413d270 2023-11-27T22:30:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd14259c640 1 -- 172.21.15.154:0/2921245789 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c036440 con 0x7fd14413d270 2023-11-27T22:30:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd14259c640 1 -- 172.21.15.154:0/2921245789 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0367d0 con 0x7fd14413d270 2023-11-27T22:30:40.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 -- 172.21.15.154:0/2921245789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413d270 msgr2=0x7fd1440b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 --2- 172.21.15.154:0/2921245789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413d270 0x7fd1440b1130 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00ba70 tx=0x7fd12c02e080 comp rx=0 tx=0).stop 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 -- 172.21.15.154:0/2921245789 shutdown_connections 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 --2- 172.21.15.154:0/2921245789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413d270 0x7fd1440b1130 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 --2- 172.21.15.154:0/2921245789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 -- 172.21.15.154:0/2921245789 >> 172.21.15.154:0/2921245789 conn(0x7fd14406d9c0 msgr2=0x7fd14406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 -- 172.21.15.154:0/2921245789 shutdown_connections 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.802+0000 7fd149243640 1 -- 172.21.15.154:0/2921245789 wait complete. 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.804+0000 7fd149243640 1 Processor -- start 2023-11-27T22:30:40.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.804+0000 7fd149243640 1 -- start start 2023-11-27T22:30:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd14413d270 0x7fd1440b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.808 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 0x7fd14413c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144153070 con 0x7fd14413fa10 2023-11-27T22:30:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144153350 con 0x7fd14413d270 2023-11-27T22:30:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd144153630 con 0x7fd14413ce90 2023-11-27T22:30:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 0x7fd14413c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 0x7fd14413c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51378/0 (socket says 172.21.15.154:51378) 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 -- 172.21.15.154:0/449169585 learned_addr learned my addr 172.21.15.154:0/449169585 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd13a59c640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd14413d270 0x7fd1440b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd142d9d640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 -- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 msgr2=0x7fd1440b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 -- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd14413d270 msgr2=0x7fd1440b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd14413d270 0x7fd1440b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:40.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 -- 172.21.15.154:0/449169585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c00b6a0 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd13a59c640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd14413d270 0x7fd1440b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd14359e640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 0x7fd14413c640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c7f0 tx=0x7fd13c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00a5e0 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00a760 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00ab50 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd144153910 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.805+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14413cb80 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.806+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14415da70 con 0x7fd14413fa10 2023-11-27T22:30:40.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.807+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd13c00acb0 con 0x7fd14413fa10 2023-11-27T22:30:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.807+0000 7fd13bfff640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd12406b1f0 0x7fd12406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.807+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd13c088a90 con 0x7fd14413fa10 2023-11-27T22:30:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.807+0000 7fd142d9d640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd12406b1f0 0x7fd12406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:40.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.808+0000 7fd142d9d640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd12406b1f0 0x7fd12406d6b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd134006fd0 tx=0x7fd134008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:40.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.812+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd13c0539a0 con 0x7fd14413fa10 2023-11-27T22:30:40.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:40.981+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd144153e30 con 0x7fd14413fa10 2023-11-27T22:30:41.683 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.682+0000 7fd13bfff640 1 -- 172.21.15.154:0/449169585 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd144153e30 con 0x7fd14413fa10 2023-11-27T22:30:41.684 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' created 2023-11-27T22:30:41.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.684+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd12406b1f0 msgr2=0x7fd12406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.684+0000 7fd149243640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd12406b1f0 0x7fd12406d6b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd134006fd0 tx=0x7fd134008040 comp rx=0 tx=0).stop 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.684+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 msgr2=0x7fd14413c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.684+0000 7fd149243640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 0x7fd14413c640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00c7f0 tx=0x7fd13c00ccb0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 shutdown_connections 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd14413d270 0x7fd1440b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd12406b1f0 0x7fd12406d6b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd14413fa10 0x7fd14413c640 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 --2- 172.21.15.154:0/449169585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd14413ce90 0x7fd1440b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 >> 172.21.15.154:0/449169585 conn(0x7fd14406d9c0 msgr2=0x7fd1440ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 shutdown_connections 2023-11-27T22:30:41.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.685+0000 7fd149243640 1 -- 172.21.15.154:0/449169585 wait complete. 2023-11-27T22:30:41.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T22:30:41.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.810+0000 7efc5e626640 1 Processor -- start 2023-11-27T22:30:41.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.810+0000 7efc5e626640 1 -- start start 2023-11-27T22:30:41.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5e626640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc580d3900 0x7efc580b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:41.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5e626640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc580b2b10 con 0x7efc580d2910 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5e626640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc580d1590 con 0x7efc5815d330 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5e626640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580d1870 con 0x7efc580d3900 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5cbc3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc580d3900 0x7efc580b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5cbc3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efc580d3900 0x7efc580b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51384/0 (socket says 172.21.15.154:51384) 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc577fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7efc580d2910 0x7efc580d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50190/0 (socket says 172.21.15.154:50190) 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.811+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1990001968 learned_addr learned my addr 172.21.15.154:0/1990001968 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.812+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1990001968 >> v1:172.21.15.194:6789/0 conn(0x7efc5815d330 legacy=0x7efc580b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.812+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1990001968 >> v1:172.21.15.154:6789/0 conn(0x7efc580d2910 legacy=0x7efc580d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.812+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1990001968 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc580d1b50 con 0x7efc580d3900 2023-11-27T22:30:41.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.812+0000 7efc56ffd640 1 -- 172.21.15.154:0/1990001968 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656597044 0 0) 0x7efc580b2b10 con 0x7efc580d2910 2023-11-27T22:30:41.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.812+0000 7efc5cbc3640 1 --2- 172.21.15.154:0/1990001968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc580d3900 0x7efc580b6390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc50009e50 tx=0x7efc5002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c74e101a8ed7fd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:41.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc56ffd640 1 -- 172.21.15.154:0/1990001968 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5002cb20 con 0x7efc580d3900 2023-11-27T22:30:41.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc56ffd640 1 -- 172.21.15.154:0/1990001968 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5002cc80 con 0x7efc580d3900 2023-11-27T22:30:41.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc56ffd640 1 -- 172.21.15.154:0/1990001968 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500343f0 con 0x7efc580d3900 2023-11-27T22:30:41.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 -- 172.21.15.154:0/1990001968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc580d3900 msgr2=0x7efc580b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 --2- 172.21.15.154:0/1990001968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc580d3900 0x7efc580b6390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc50009e50 tx=0x7efc5002bf80 comp rx=0 tx=0).stop 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 -- 172.21.15.154:0/1990001968 shutdown_connections 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 --2- 172.21.15.154:0/1990001968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc580d3900 0x7efc580b6390 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 -- 172.21.15.154:0/1990001968 >> 172.21.15.154:0/1990001968 conn(0x7efc58072020 msgr2=0x7efc58072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 -- 172.21.15.154:0/1990001968 shutdown_connections 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.813+0000 7efc5e626640 1 -- 172.21.15.154:0/1990001968 wait complete. 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.814+0000 7efc5e626640 1 Processor -- start 2023-11-27T22:30:41.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.814+0000 7efc5e626640 1 -- start start 2023-11-27T22:30:41.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5e626640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc580d2910 0x7efc581574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:41.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5e626640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc580d3900 0x7efc58153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:41.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5e626640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 0x7efc580cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5e626640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc58157a20 con 0x7efc5815d330 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5e626640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc58153cd0 con 0x7efc580d3900 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5e626640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc581f63f0 con 0x7efc580d2910 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5cbc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 0x7efc580cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5cbc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 0x7efc580cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51390/0 (socket says 172.21.15.154:51390) 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1429705000 learned_addr learned my addr 172.21.15.154:0/1429705000 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc577fe640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc580d3900 0x7efc58153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.815+0000 7efc57fff640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc580d2910 0x7efc581574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc580d2910 msgr2=0x7efc581574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5cbc3640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc580d2910 0x7efc581574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc580d3900 msgr2=0x7efc58153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5cbc3640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc580d3900 0x7efc58153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5cbc3640 1 -- 172.21.15.154:0/1429705000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50009b30 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5cbc3640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 0x7efc580cbf60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc50036040 tx=0x7efc50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50009510 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5003e450 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc581f66b0 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5003e600 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.816+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc581f6c70 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.817+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc580cf570 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.817+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efc5003e760 con 0x7efc5815d330 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.818+0000 7efc54ff9640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc4406b1c0 0x7efc4406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:41.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.818+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efc500ac3f0 con 0x7efc5815d330 2023-11-27T22:30:41.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.818+0000 7efc57fff640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc4406b1c0 0x7efc4406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:41.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.818+0000 7efc57fff640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc4406b1c0 0x7efc4406d680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efc48000f60 tx=0x7efc48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:41.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:41.822+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efc50077050 con 0x7efc5815d330 2023-11-27T22:30:42.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.025+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efc58069400 con 0x7efc5815d330 2023-11-27T22:30:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.688+0000 7efc54ff9640 1 -- 172.21.15.154:0/1429705000 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7efc5007a670 con 0x7efc5815d330 2023-11-27T22:30:42.690 INFO:teuthology.orchestra.run.smithi154.stderr:new fs with metadata pool 4 and data pool 5 2023-11-27T22:30:42.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.700+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc4406b1c0 msgr2=0x7efc4406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:42.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc4406b1c0 0x7efc4406d680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efc48000f60 tx=0x7efc48009040 comp rx=0 tx=0).stop 2023-11-27T22:30:42.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 msgr2=0x7efc580cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:42.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 0x7efc580cbf60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc50036040 tx=0x7efc50004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:42.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 shutdown_connections 2023-11-27T22:30:42.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc580d3900 0x7efc58153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc4406b1c0 0x7efc4406d680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efc5815d330 0x7efc580cbf60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.701+0000 7efc5e626640 1 --2- 172.21.15.154:0/1429705000 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc580d2910 0x7efc581574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.702+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 >> 172.21.15.154:0/1429705000 conn(0x7efc58072020 msgr2=0x7efc58072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:42.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.703+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 shutdown_connections 2023-11-27T22:30:42.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.704+0000 7efc5e626640 1 -- 172.21.15.154:0/1429705000 wait complete. 2023-11-27T22:30:42.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.824+0000 7f7eeb8bb640 1 Processor -- start 2023-11-27T22:30:42.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.824+0000 7f7eeb8bb640 1 -- start start 2023-11-27T22:30:42.826 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7eeb8bb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee40b1400 0x7f7ee415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7eeb8bb640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ee415e730 0x7f7ee415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7eeb8bb640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee415e2a0 con 0x7f7ee4143490 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7eeb8bb640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee415b520 con 0x7f7ee415e730 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7eeb8bb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4143870 con 0x7f7ee40b1400 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ee415e730 0x7f7ee415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7ee415e730 0x7f7ee415aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51404/0 (socket says 172.21.15.154:51404) 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 -- 172.21.15.154:0/2597329355 learned_addr learned my addr 172.21.15.154:0/2597329355 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9657640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f7ee4143490 0x7f7ee40b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50198/0 (socket says 172.21.15.154:50198) 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 -- 172.21.15.154:0/2597329355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee40b1400 msgr2=0x7f7ee415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 --2- 172.21.15.154:0/2597329355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee40b1400 0x7f7ee415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.827 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 -- 172.21.15.154:0/2597329355 >> v1:172.21.15.154:6789/0 conn(0x7f7ee4143490 legacy=0x7f7ee40b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7ee9e58640 1 -- 172.21.15.154:0/2597329355 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee415b240 con 0x7f7ee415e730 2023-11-27T22:30:42.828 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.825+0000 7f7edbfff640 1 -- 172.21.15.154:0/2597329355 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036462263 0 0) 0x7f7ee415e2a0 con 0x7f7ee4143490 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7ee9e58640 1 --2- 172.21.15.154:0/2597329355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415e730 0x7f7ee415aa20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009e50 tx=0x7f7ee002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e03186942636b6f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7edbfff640 1 -- 172.21.15.154:0/2597329355 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee002ed10 con 0x7f7ee415e730 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7edbfff640 1 -- 172.21.15.154:0/2597329355 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee002ee70 con 0x7f7ee415e730 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7edbfff640 1 -- 172.21.15.154:0/2597329355 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00365f0 con 0x7f7ee415e730 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/2597329355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415e730 msgr2=0x7f7ee415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/2597329355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415e730 0x7f7ee415aa20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009e50 tx=0x7f7ee002e170 comp rx=0 tx=0).stop 2023-11-27T22:30:42.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/2597329355 shutdown_connections 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/2597329355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee415e730 0x7f7ee415aa20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/2597329355 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee40b1400 0x7f7ee415a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.826+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/2597329355 >> 172.21.15.154:0/2597329355 conn(0x7f7ee406a4d0 msgr2=0x7f7ee406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.827+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/2597329355 shutdown_connections 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.827+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/2597329355 wait complete. 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 Processor -- start 2023-11-27T22:30:42.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 -- start start 2023-11-27T22:30:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 0x7f7ee4138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee4143490 0x7f7ee415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:42.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ee415e730 0x7f7ee415d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4139190 con 0x7f7ee40b1400 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4140890 con 0x7f7ee415e730 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7eeb8bb640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee413c630 con 0x7f7ee4143490 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.828+0000 7f7ee9657640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 0x7f7ee4138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 0x7f7ee4138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51416/0 (socket says 172.21.15.154:51416) 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 -- 172.21.15.154:0/4255909739 learned_addr learned my addr 172.21.15.154:0/4255909739 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9e58640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ee415e730 0x7f7ee415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 -- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee4143490 msgr2=0x7f7ee415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee4143490 0x7f7ee415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 -- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ee415e730 msgr2=0x7f7ee415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:42.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ee415e730 0x7f7ee415d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 -- 172.21.15.154:0/4255909739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009b30 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ee9657640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 0x7f7ee4138c50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c4d0 tx=0x7f7edc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0074e0 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc007660 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee413c070 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004a20 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.829+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee4140520 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.830+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee4069400 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.831+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7edc004b80 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.831+0000 7f7ed9ffb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7ec806b1c0 0x7f7ec806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.831+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7edc088f40 con 0x7f7ee40b1400 2023-11-27T22:30:42.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.831+0000 7f7ee8e56640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7ec806b1c0 0x7f7ec806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:42.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.832+0000 7f7ee8e56640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7ec806b1c0 0x7f7ec806d680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ee406af90 tx=0x7f7ed4006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:42.837 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:42.836+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7edc053c70 con 0x7f7ee40b1400 2023-11-27T22:30:43.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.003+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ee40b2820 con 0x7f7ee40b1400 2023-11-27T22:30:43.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.004+0000 7f7ed9ffb640 1 -- 172.21.15.154:0/4255909739 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f7edc018020 con 0x7f7ee40b1400 2023-11-27T22:30:43.007 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:43.007 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:42.026337+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:30:40.260897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T22:30:40.999879+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:43.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7ec806b1c0 msgr2=0x7f7ec806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7ec806b1c0 0x7f7ec806d680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ee406af90 tx=0x7f7ed4006c90 comp rx=0 tx=0).stop 2023-11-27T22:30:43.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 msgr2=0x7f7ee4138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 0x7f7ee4138c50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7edc00c4d0 tx=0x7f7edc00c990 comp rx=0 tx=0).stop 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 shutdown_connections 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ee415e730 0x7f7ee415d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7ec806b1c0 0x7f7ec806d680 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ee4143490 0x7f7ee415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 --2- 172.21.15.154:0/4255909739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7ee40b1400 0x7f7ee4138c50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 >> 172.21.15.154:0/4255909739 conn(0x7f7ee406a4d0 msgr2=0x7f7ee40cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 shutdown_connections 2023-11-27T22:30:43.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.006+0000 7f7eeb8bb640 1 -- 172.21.15.154:0/4255909739 wait complete. 2023-11-27T22:30:43.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:43.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.117+0000 7f6b54fd7640 1 Processor -- start 2023-11-27T22:30:43.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.118+0000 7f6b54fd7640 1 -- start start 2023-11-27T22:30:43.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.118+0000 7f6b54fd7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b50144980 0x7f6b5015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.118+0000 7f6b54fd7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b500b4370 0x7f6b500b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.118+0000 7f6b54fd7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b50071770 con 0x7f6b500ceb70 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.118+0000 7f6b54fd7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b500b4d20 con 0x7f6b500b4370 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.118+0000 7f6b54fd7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500ccb60 con 0x7f6b50144980 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b500b4370 0x7f6b500b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b500b4370 0x7f6b500b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51422/0 (socket says 172.21.15.154:51422) 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/477369794 learned_addr learned my addr 172.21.15.154:0/477369794 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:43.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4e59c640 1 --2- 172.21.15.154:0/477369794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b50144980 0x7f6b5015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/477369794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b50144980 msgr2=0x7f6b5015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:43.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 --2- 172.21.15.154:0/477369794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b50144980 0x7f6b5015c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/477369794 >> v1:172.21.15.194:6789/0 conn(0x7f6b500ceb70 legacy=0x7f6b500cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.119+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/477369794 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500ccdc0 con 0x7f6b500b4370 2023-11-27T22:30:43.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b4ed9d640 1 --2- 172.21.15.154:0/477369794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500b4370 0x7f6b500b47e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009e50 tx=0x7f6b4802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1515169ee2ac3e3d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b4d59a640 1 -- 172.21.15.154:0/477369794 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4802cb00 con 0x7f6b500b4370 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b4d59a640 1 -- 172.21.15.154:0/477369794 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4802cc60 con 0x7f6b500b4370 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b4d59a640 1 -- 172.21.15.154:0/477369794 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480343f0 con 0x7f6b500b4370 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 -- 172.21.15.154:0/477369794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500b4370 msgr2=0x7f6b500b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/477369794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500b4370 0x7f6b500b47e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009e50 tx=0x7f6b4802bf60 comp rx=0 tx=0).stop 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 -- 172.21.15.154:0/477369794 shutdown_connections 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/477369794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500b4370 0x7f6b500b47e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/477369794 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b50144980 0x7f6b5015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 -- 172.21.15.154:0/477369794 >> 172.21.15.154:0/477369794 conn(0x7f6b5006a4d0 msgr2=0x7f6b5006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 -- 172.21.15.154:0/477369794 shutdown_connections 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.120+0000 7f6b54fd7640 1 -- 172.21.15.154:0/477369794 wait complete. 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 Processor -- start 2023-11-27T22:30:43.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 -- start start 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b500b4370 0x7f6b50154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b500ceb70 0x7f6b5013a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 0x7f6b5013ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b50154f80 con 0x7f6b50144980 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500b1890 con 0x7f6b500ceb70 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.122+0000 7f6b54fd7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b50156440 con 0x7f6b500b4370 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 0x7f6b5013ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 0x7f6b5013ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51436/0 (socket says 172.21.15.154:51436) 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/3056024132 learned_addr learned my addr 172.21.15.154:0/3056024132 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4dd9b640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b500ceb70 0x7f6b5013a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4e59c640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b500b4370 0x7f6b50154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.137 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b500b4370 msgr2=0x7f6b50154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b500b4370 0x7f6b50154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b500ceb70 msgr2=0x7f6b5013a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b500ceb70 0x7f6b5013a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 -- 172.21.15.154:0/3056024132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48009b30 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b4ed9d640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 0x7f6b5013ab80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009e50 tx=0x7f6b48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48009510 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4803e450 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b50156720 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4803e800 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.123+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b50156ce0 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.124+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b50156ed0 con 0x7f6b50144980 2023-11-27T22:30:43.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.125+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6b4803e960 con 0x7f6b50144980 2023-11-27T22:30:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.125+0000 7f6b3effd640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b3006b1f0 0x7f6b3006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.125+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b480ac450 con 0x7f6b50144980 2023-11-27T22:30:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.125+0000 7f6b4e59c640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b3006b1f0 0x7f6b3006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.125+0000 7f6b4e59c640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b3006b1f0 0x7f6b3006d6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6b44006fd0 tx=0x7f6b44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.129+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6b48077210 con 0x7f6b50144980 2023-11-27T22:30:43.297 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.295+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b50069400 con 0x7f6b50144980 2023-11-27T22:30:43.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.296+0000 7f6b3effd640 1 -- 172.21.15.154:0/3056024132 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16607 (secure 0 0 0) 0x7f6b4807a830 con 0x7f6b50144980 2023-11-27T22:30:43.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:43.298 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":33,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:42.026337+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:30:40.260897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T22:30:40.999879+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b3006b1f0 msgr2=0x7f6b3006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b3006b1f0 0x7f6b3006d6b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6b44006fd0 tx=0x7f6b44008040 comp rx=0 tx=0).stop 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 msgr2=0x7f6b5013ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 0x7f6b5013ab80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009e50 tx=0x7f6b48004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 shutdown_connections 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b500ceb70 0x7f6b5013a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b3006b1f0 0x7f6b3006d6b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b50144980 0x7f6b5013ab80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.300 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 --2- 172.21.15.154:0/3056024132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b500b4370 0x7f6b50154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 >> 172.21.15.154:0/3056024132 conn(0x7f6b5006a4d0 msgr2=0x7f6b50071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:43.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 shutdown_connections 2023-11-27T22:30:43.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.298+0000 7f6b54fd7640 1 -- 172.21.15.154:0/3056024132 wait complete. 2023-11-27T22:30:43.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T22:30:43.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 Processor -- start 2023-11-27T22:30:43.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 -- start start 2023-11-27T22:30:43.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68a015e730 0x7f68a015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a015e2a0 con 0x7f68a0143490 2023-11-27T22:30:43.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a015b520 con 0x7f68a015e730 2023-11-27T22:30:43.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.413+0000 7f68a6c4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0143870 con 0x7f68a00b1400 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f689ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68a015e730 0x7f68a015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68a015e730 0x7f68a015aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:49190/0 (socket says 172.21.15.154:49190) 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 -- 172.21.15.154:0/3406470036 learned_addr learned my addr 172.21.15.154:0/3406470036 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a49eb640 1 --1- 172.21.15.154:0/3406470036 >> v1:172.21.15.194:6789/0 conn(0x7f68a0143490 0x7f68a00b0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:47412/0 (socket says 172.21.15.154:47412) 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 -- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 msgr2=0x7f68a015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 --2- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 -- 172.21.15.154:0/3406470036 >> v1:172.21.15.194:6789/0 conn(0x7f68a0143490 legacy=0x7f68a00b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f68a51ec640 1 -- 172.21.15.154:0/3406470036 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a015b240 con 0x7f68a015e730 2023-11-27T22:30:43.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.414+0000 7f689ffff640 1 --2- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.415+0000 7f68a51ec640 1 --2- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a015aa20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6898009e50 tx=0x7f689802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23497d0c4e3bf0f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.415+0000 7f689f7fe640 1 -- 172.21.15.154:0/3406470036 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689802cb00 con 0x7f68a015e730 2023-11-27T22:30:43.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.415+0000 7f689f7fe640 1 -- 172.21.15.154:0/3406470036 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689802cc60 con 0x7f68a015e730 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.415+0000 7f689f7fe640 1 -- 172.21.15.154:0/3406470036 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980343f0 con 0x7f68a015e730 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 -- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 msgr2=0x7f68a015aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a015aa20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6898009e50 tx=0x7f689802bf60 comp rx=0 tx=0).stop 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 -- 172.21.15.154:0/3406470036 shutdown_connections 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a015aa20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/3406470036 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 -- 172.21.15.154:0/3406470036 >> 172.21.15.154:0/3406470036 conn(0x7f68a006a4d0 msgr2=0x7f68a006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 -- 172.21.15.154:0/3406470036 shutdown_connections 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.416+0000 7f68a6c4f640 1 -- 172.21.15.154:0/3406470036 wait complete. 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.417+0000 7f68a6c4f640 1 Processor -- start 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.417+0000 7f68a6c4f640 1 -- start start 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a6c4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a00a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a6c4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 0x7f68a00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a6c4f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a00af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a6c4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0165f00 con 0x7f68a0143490 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a6c4f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0071ae0 con 0x7f68a015e730 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a6c4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0165980 con 0x7f68a00b1400 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 0x7f68a00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 0x7f68a00715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51442/0 (socket says 172.21.15.154:51442) 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 -- 172.21.15.154:0/2264873397 learned_addr learned my addr 172.21.15.154:0/2264873397 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a49eb640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a00a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f68a51ec640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a00af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 -- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 msgr2=0x7f68a00a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a00a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 -- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 msgr2=0x7f68a00af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a00af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.418+0000 7f689ffff640 1 -- 172.21.15.154:0/2264873397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6894009400 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.419+0000 7f689ffff640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 0x7f68a00715a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f689400ec10 tx=0x7f689400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.419+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894009760 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.419+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689400cc30 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.419+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6894013470 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.419+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6898009b30 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.419+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a0165c20 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.420+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a00b4380 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.420+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f68940135d0 con 0x7f68a0143490 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.421+0000 7f689d7fa640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f688c06b1c0 0x7f688c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.421+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6894089c60 con 0x7f68a0143490 2023-11-27T22:30:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.421+0000 7f68a49eb640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f688c06b1c0 0x7f688c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.421+0000 7f68a49eb640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f688c06b1c0 0x7f688c06d680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f68a00714c0 tx=0x7f6890007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.425+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6894054a50 con 0x7f68a0143490 2023-11-27T22:30:43.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.628+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f68a00aa0a0 con 0x7f68a0143490 2023-11-27T22:30:43.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.692+0000 7f689d7fa640 1 -- 172.21.15.154:0/2264873397 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6894058070 con 0x7f68a0143490 2023-11-27T22:30:43.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f688c06b1c0 msgr2=0x7f688c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f688c06b1c0 0x7f688c06d680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f68a00714c0 tx=0x7f6890007e80 comp rx=0 tx=0).stop 2023-11-27T22:30:43.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 msgr2=0x7f68a00715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 0x7f68a00715a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f689400ec10 tx=0x7f689400c520 comp rx=0 tx=0).stop 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 shutdown_connections 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68a015e730 0x7f68a00af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f688c06b1c0 0x7f688c06d680 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68a0143490 0x7f68a00715a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 --2- 172.21.15.154:0/2264873397 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68a00b1400 0x7f68a00a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.695+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 >> 172.21.15.154:0/2264873397 conn(0x7f68a006a4d0 msgr2=0x7f68a00aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.696+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 shutdown_connections 2023-11-27T22:30:43.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.696+0000 7f68a6c4f640 1 -- 172.21.15.154:0/2264873397 wait complete. 2023-11-27T22:30:43.708 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T22:30:43.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T22:30:43.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.810+0000 7fdc3b6d3640 1 Processor -- start 2023-11-27T22:30:43.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.810+0000 7fdc3b6d3640 1 -- start start 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc3b6d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc34144980 0x7fdc3415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc3b6d3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc340b4370 0x7fdc340b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc3b6d3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc34071770 con 0x7fdc340ceb70 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc3b6d3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc340b4d20 con 0x7fdc340b4370 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc3b6d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340ccb60 con 0x7fdc34144980 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc340b4370 0x7fdc340b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdc340b4370 0x7fdc340b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51446/0 (socket says 172.21.15.154:51446) 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 -- 172.21.15.154:0/2697784051 learned_addr learned my addr 172.21.15.154:0/2697784051 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:43.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 -- 172.21.15.154:0/2697784051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc34144980 msgr2=0x7fdc3415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:43.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc3946f640 1 --2- 172.21.15.154:0/2697784051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc34144980 0x7fdc3415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 --2- 172.21.15.154:0/2697784051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc34144980 0x7fdc3415c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 -- 172.21.15.154:0/2697784051 >> v1:172.21.15.194:6789/0 conn(0x7fdc340ceb70 legacy=0x7fdc340cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:43.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.811+0000 7fdc39c70640 1 -- 172.21.15.154:0/2697784051 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340ccdc0 con 0x7fdc340b4370 2023-11-27T22:30:43.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.812+0000 7fdc39c70640 1 --2- 172.21.15.154:0/2697784051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc340b4370 0x7fdc340b47e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009e50 tx=0x7fdc2c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febb7938913d0ce8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.815 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.812+0000 7fdc2bfff640 1 -- 172.21.15.154:0/2697784051 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c02ca70 con 0x7fdc340b4370 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.812+0000 7fdc2bfff640 1 -- 172.21.15.154:0/2697784051 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c02cbd0 con 0x7fdc340b4370 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.812+0000 7fdc2bfff640 1 -- 172.21.15.154:0/2697784051 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0343f0 con 0x7fdc340b4370 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2697784051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc340b4370 msgr2=0x7fdc340b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2697784051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc340b4370 0x7fdc340b47e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009e50 tx=0x7fdc2c02bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2697784051 shutdown_connections 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2697784051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc340b4370 0x7fdc340b47e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2697784051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc34144980 0x7fdc3415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2697784051 >> 172.21.15.154:0/2697784051 conn(0x7fdc3406a4d0 msgr2=0x7fdc3406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2697784051 shutdown_connections 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.813+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2697784051 wait complete. 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.814+0000 7fdc3b6d3640 1 Processor -- start 2023-11-27T22:30:43.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.814+0000 7fdc3b6d3640 1 -- start start 2023-11-27T22:30:43.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340b4370 0x7fdc3413b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc340ceb70 0x7fdc3415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 0x7fdc3415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341f65d0 con 0x7fdc34144980 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341f68b0 con 0x7fdc340b4370 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341f6b90 con 0x7fdc340ceb70 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 0x7fdc3415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 0x7fdc3415e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51452/0 (socket says 172.21.15.154:51452) 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 -- 172.21.15.154:0/2246387433 learned_addr learned my addr 172.21.15.154:0/2246387433 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3946f640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340b4370 0x7fdc3413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc38c6e640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc340ceb70 0x7fdc3415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 -- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc340ceb70 msgr2=0x7fdc3415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc340ceb70 0x7fdc3415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 -- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340b4370 msgr2=0x7fdc3413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:43.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340b4370 0x7fdc3413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 -- 172.21.15.154:0/2246387433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009b30 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3946f640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340b4370 0x7fdc3413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc38c6e640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc340ceb70 0x7fdc3415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc39c70640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 0x7fdc3415e2a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c036040 tx=0x7fdc2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c03e450 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c03e5d0 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc341f6e70 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.815+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c03e980 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.816+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3413bda0 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.817+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc341f7390 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.817+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdc2c03eae0 con 0x7fdc34144980 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.817+0000 7fdc29ffb640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdc1806b1c0 0x7fdc1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:43.821 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.817+0000 7fdc3946f640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdc1806b1c0 0x7fdc1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:43.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.818+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc2c0ac8e0 con 0x7fdc34144980 2023-11-27T22:30:43.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.818+0000 7fdc3946f640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdc1806b1c0 0x7fdc1806d680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc341556f0 tx=0x7fdc30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:43.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:43.822+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdc2c0776c0 con 0x7fdc34144980 2023-11-27T22:30:44.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.024+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc34069400 con 0x7fdc34144980 2023-11-27T22:30:44.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.693+0000 7fdc29ffb640 1 -- 172.21.15.154:0/2246387433 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc2c07ace0 con 0x7fdc34144980 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdc1806b1c0 msgr2=0x7fdc1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdc1806b1c0 0x7fdc1806d680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc341556f0 tx=0x7fdc30008040 comp rx=0 tx=0).stop 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 msgr2=0x7fdc3415e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 0x7fdc3415e2a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c036040 tx=0x7fdc2c004a40 comp rx=0 tx=0).stop 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 shutdown_connections 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdc1806b1c0 0x7fdc1806d680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc34144980 0x7fdc3415e2a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc340ceb70 0x7fdc3415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 --2- 172.21.15.154:0/2246387433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc340b4370 0x7fdc3413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 >> 172.21.15.154:0/2246387433 conn(0x7fdc3406a4d0 msgr2=0x7fdc34143c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:44.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 shutdown_connections 2023-11-27T22:30:44.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.696+0000 7fdc3b6d3640 1 -- 172.21.15.154:0/2246387433 wait complete. 2023-11-27T22:30:44.710 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T22:30:44.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:30:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.811+0000 7fa2ae7b6640 1 Processor -- start 2023-11-27T22:30:44.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.811+0000 7fa2ae7b6640 1 -- start start 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2ae7b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2a80b1400 0x7fa2a815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2ae7b6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a815e2a0 con 0x7fa2a815e730 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2ae7b6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a815b240 con 0x7fa2a8143490 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2ae7b6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a815b520 con 0x7fa2a80b1400 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2acd53640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa2a815e730 0x7fa2a815aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50212/0 (socket says 172.21.15.154:50212) 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2acd53640 1 -- 172.21.15.154:0/125321844 learned_addr learned my addr 172.21.15.154:0/125321844 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2a77fe640 1 --2- 172.21.15.154:0/125321844 >> v2:172.21.15.194:3300/0 conn(0x7fa2a80b1400 0x7fa2a815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436944636 0 0) 0x7fa2a815e2a0 con 0x7fa2a815e730 2023-11-27T22:30:44.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.812+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa290003520 con 0x7fa2a815e730 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330665972 0 0) 0x7fa290003520 con 0x7fa2a815e730 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 >> v2:172.21.15.194:3300/0 conn(0x7fa2a80b1400 msgr2=0x7fa2a815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 --2- 172.21.15.154:0/125321844 >> v2:172.21.15.194:3300/0 conn(0x7fa2a80b1400 0x7fa2a815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 >> v1:172.21.15.194:6789/0 conn(0x7fa2a8143490 legacy=0x7fa2a80b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a815dc50 con 0x7fa2a815e730 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7fa2a00019f0 con 0x7fa2a815e730 2023-11-27T22:30:44.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 >> v1:172.21.15.154:6789/0 conn(0x7fa2a815e730 legacy=0x7fa2a815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290003970 0x7fa290003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2900047c0 0x7fa290004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa290005180 0x7fa29000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a815b520 con 0x7fa290003970 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29000c020 con 0x7fa290005180 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29000c1e0 con 0x7fa2900047c0 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a7fff640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290003970 0x7fa290003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2acd53640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa290005180 0x7fa29000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a7fff640 1 -- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2900047c0 msgr2=0x7fa290004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a77fe640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2900047c0 0x7fa290004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a7fff640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2900047c0 0x7fa290004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a7fff640 1 -- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa290005180 msgr2=0x7fa29000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a7fff640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa290005180 0x7fa29000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2a7fff640 1 -- 172.21.15.154:0/125321844 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290003520 con 0x7fa290003970 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2acd53640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa290005180 0x7fa29000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.813+0000 7fa2acd53640 1 -- 172.21.15.154:0/125321844 reap_dead start 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.814+0000 7fa2a7fff640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290003970 0x7fa290003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa298001750 tx=0x7fa2900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c4ba0d36167ea3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.814+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980052d0 con 0x7fa290003970 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.814+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29802e050 con 0x7fa290003970 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.814+0000 7fa2a6ffd640 1 -- 172.21.15.154:0/125321844 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298003830 con 0x7fa290003970 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.814+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/125321844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290003970 msgr2=0x7fa290003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.814+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290003970 0x7fa290003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa298001750 tx=0x7fa2900057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.815+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/125321844 shutdown_connections 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.815+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/125321844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa290003970 0x7fa290003d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.815+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/125321844 >> 172.21.15.154:0/125321844 conn(0x7fa2a806a4d0 msgr2=0x7fa2a806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.815+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/125321844 shutdown_connections 2023-11-27T22:30:44.820 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.815+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/125321844 wait complete. 2023-11-27T22:30:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.816+0000 7fa2ae7b6640 1 Processor -- start 2023-11-27T22:30:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.816+0000 7fa2ae7b6640 1 -- start start 2023-11-27T22:30:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa290003970 0x7fa2a80ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 0x7fa2a8070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a80cace0 0x7fa2a80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.822 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80ac8d0 con 0x7fa2a80adb30 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80cb6a0 con 0x7fa2a80cace0 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80abc50 con 0x7fa290003970 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 0x7fa2a8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 0x7fa2a8070600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51476/0 (socket says 172.21.15.154:51476) 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 -- 172.21.15.154:0/3726359121 learned_addr learned my addr 172.21.15.154:0/3726359121 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 -- 172.21.15.154:0/3726359121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa290003970 msgr2=0x7fa2a80ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa290003970 0x7fa2a80ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 -- 172.21.15.154:0/3726359121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a80cace0 msgr2=0x7fa2a80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a80cace0 0x7fa2a80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:44.823 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 -- 172.21.15.154:0/3726359121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80abf30 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a77fe640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 0x7fa2a8070600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0108e0 tx=0x7fa29c010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00eae0 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00ec40 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a80ac210 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c01c400 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.817+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a80ab940 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.818+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a8069400 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.819+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa29c01c560 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.819+0000 7fa2a4ff9640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa29406b1c0 0x7fa29406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.819+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa29c089f00 con 0x7fa2a80adb30 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.819+0000 7fa2a7fff640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa29406b1c0 0x7fa29406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:44.824 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.820+0000 7fa2a7fff640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa29406b1c0 0x7fa29406d680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa298033000 tx=0x7fa29802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:44.825 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:44.824+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa29c054d70 con 0x7fa2a80adb30 2023-11-27T22:30:45.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.025+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a80b2820 con 0x7fa2a80adb30 2023-11-27T22:30:45.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.025+0000 7fa2a4ff9640 1 -- 172.21.15.154:0/3726359121 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fa29c058390 con 0x7fa2a80adb30 2023-11-27T22:30:45.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:45.028 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:30:42.026663+0000","modified":"2023-11-27T22:30:44.025219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1494168994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1494168994},{"type":"v1","addr":"172.21.15.154:6837","nonce":1494168994}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T22:30:45.028 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 12 2023-11-27T22:30:45.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa29406b1c0 msgr2=0x7fa29406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa29406b1c0 0x7fa29406d680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa298033000 tx=0x7fa29802f000 comp rx=0 tx=0).stop 2023-11-27T22:30:45.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 msgr2=0x7fa2a8070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 0x7fa2a8070600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0108e0 tx=0x7fa29c010da0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 shutdown_connections 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a80cace0 0x7fa2a80cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa29406b1c0 0x7fa29406d680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2a80adb30 0x7fa2a8070600 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 --2- 172.21.15.154:0/3726359121 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa290003970 0x7fa2a80ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.027+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 >> 172.21.15.154:0/3726359121 conn(0x7fa2a806a4d0 msgr2=0x7fa2a80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.028+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 shutdown_connections 2023-11-27T22:30:45.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.028+0000 7fa2ae7b6640 1 -- 172.21.15.154:0/3726359121 wait complete. 2023-11-27T22:30:45.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T22:30:45.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.138+0000 7f9a7a900640 1 Processor -- start 2023-11-27T22:30:45.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a7a900640 1 -- start start 2023-11-27T22:30:45.149 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a7a900640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9a7415d330 0x7f9a740b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a7a900640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a740d2910 0x7f9a740d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a7a900640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a740b2b10 con 0x7f9a740d3730 2023-11-27T22:30:45.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a7a900640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a740d3bc0 con 0x7f9a740d2910 2023-11-27T22:30:45.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a7a900640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a740d1590 con 0x7f9a7415d330 2023-11-27T22:30:45.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.139+0000 7f9a737fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a740d2910 0x7f9a740d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a737fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9a740d2910 0x7f9a740d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51478/0 (socket says 172.21.15.154:51478) 2023-11-27T22:30:45.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a737fe640 1 -- 172.21.15.154:0/795822168 learned_addr learned my addr 172.21.15.154:0/795822168 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:45.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a73fff640 1 --2- 172.21.15.154:0/795822168 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415d330 0x7f9a740b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a737fe640 1 -- 172.21.15.154:0/795822168 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415d330 msgr2=0x7f9a740b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a737fe640 1 --2- 172.21.15.154:0/795822168 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415d330 0x7f9a740b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a737fe640 1 -- 172.21.15.154:0/795822168 >> v1:172.21.15.154:6789/0 conn(0x7f9a740d3730 legacy=0x7f9a740b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a72ffd640 1 -- 172.21.15.154:0/795822168 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509130744 0 0) 0x7f9a740b2b10 con 0x7f9a740d3730 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.140+0000 7f9a737fe640 1 -- 172.21.15.154:0/795822168 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740d1870 con 0x7f9a740d2910 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a737fe640 1 --2- 172.21.15.154:0/795822168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740d31f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9a740d0d10 tx=0x7f9a6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8a02630b1f1f8e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a72ffd640 1 -- 172.21.15.154:0/795822168 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68031870 con 0x7f9a740d2910 2023-11-27T22:30:45.152 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a72ffd640 1 -- 172.21.15.154:0/795822168 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a680319d0 con 0x7f9a740d2910 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a72ffd640 1 -- 172.21.15.154:0/795822168 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68031d60 con 0x7f9a740d2910 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 -- 172.21.15.154:0/795822168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 msgr2=0x7f9a740d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 --2- 172.21.15.154:0/795822168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740d31f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9a740d0d10 tx=0x7f9a6802b910 comp rx=0 tx=0).stop 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 -- 172.21.15.154:0/795822168 shutdown_connections 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 --2- 172.21.15.154:0/795822168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740d31f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 --2- 172.21.15.154:0/795822168 >> v2:172.21.15.194:3300/0 conn(0x7f9a7415d330 0x7f9a740b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 -- 172.21.15.154:0/795822168 >> 172.21.15.154:0/795822168 conn(0x7f9a74072020 msgr2=0x7f9a74072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 -- 172.21.15.154:0/795822168 shutdown_connections 2023-11-27T22:30:45.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.141+0000 7f9a7a900640 1 -- 172.21.15.154:0/795822168 wait complete. 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.142+0000 7f9a7a900640 1 Processor -- start 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 -- start start 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a740d3730 0x7f9a74149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a7415d330 0x7f9a74160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a74149a90 con 0x7f9a740d2910 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a74160690 con 0x7f9a7415d330 2023-11-27T22:30:45.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a7a900640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740c9060 con 0x7f9a740d3730 2023-11-27T22:30:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51486/0 (socket says 172.21.15.154:51486) 2023-11-27T22:30:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.143+0000 7f9a73fff640 1 -- 172.21.15.154:0/2470420567 learned_addr learned my addr 172.21.15.154:0/2470420567 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a73fff640 1 -- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a740d3730 msgr2=0x7f9a74149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a73fff640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a740d3730 0x7f9a74149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a73fff640 1 -- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a7415d330 msgr2=0x7f9a74160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a78e9d640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a7415d330 0x7f9a74160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a73fff640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a7415d330 0x7f9a74160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a73fff640 1 -- 172.21.15.154:0/2470420567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680094d0 con 0x7f9a740d2910 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a73fff640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740c89a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d620 tx=0x7f9a6400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400b620 con 0x7f9a740d2910 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6400b780 con 0x7f9a740d2910 2023-11-27T22:30:45.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400bb30 con 0x7f9a740d2910 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a740c9340 con 0x7f9a740d2910 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.144+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a740c9900 con 0x7f9a740d2910 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.145+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a74069400 con 0x7f9a740d2910 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.146+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9a6400bc90 con 0x7f9a740d2910 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.146+0000 7f9a70ff9640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9a6006b1f0 0x7f9a6006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.146+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a64089e30 con 0x7f9a740d2910 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.146+0000 7f9a737fe640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9a6006b1f0 0x7f9a6006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.147+0000 7f9a737fe640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9a6006b1f0 0x7f9a6006d6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a68036000 tx=0x7f9a68030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.150+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f9a64054bf0 con 0x7f9a740d2910 2023-11-27T22:30:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.317+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a740cb380 con 0x7f9a740d2910 2023-11-27T22:30:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.318+0000 7f9a70ff9640 1 -- 172.21.15.154:0/2470420567 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f9a64058210 con 0x7f9a740d2910 2023-11-27T22:30:45.320 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:45.320 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:43.689582+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:30:40.260897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T22:30:40.999879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T22:30:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9a6006b1f0 msgr2=0x7f9a6006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9a6006b1f0 0x7f9a6006d6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a68036000 tx=0x7f9a68030000 comp rx=0 tx=0).stop 2023-11-27T22:30:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 msgr2=0x7f9a740c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740c89a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d620 tx=0x7f9a6400dae0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 shutdown_connections 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a7415d330 0x7f9a74160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9a6006b1f0 0x7f9a6006d6b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9a740d3730 0x7f9a74149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 --2- 172.21.15.154:0/2470420567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9a740d2910 0x7f9a740c89a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 >> 172.21.15.154:0/2470420567 conn(0x7f9a74072020 msgr2=0x7f9a740cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 shutdown_connections 2023-11-27T22:30:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.320+0000 7f9a7a900640 1 -- 172.21.15.154:0/2470420567 wait complete. 2023-11-27T22:30:45.333 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T22:30:45.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:30:45.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.433+0000 7f4db4183640 1 Processor -- start 2023-11-27T22:30:45.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.433+0000 7f4db4183640 1 -- start start 2023-11-27T22:30:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db4183640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 0x7f4dac0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db4183640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac071770 con 0x7f4dac144980 2023-11-27T22:30:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db4183640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0ccb60 con 0x7f4dac0ceb70 2023-11-27T22:30:45.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db4183640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac15ced0 con 0x7f4dac0b4370 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db1f1f640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4dac144980 0x7f4dac15c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50226/0 (socket says 172.21.15.154:50226) 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db1f1f640 1 -- 172.21.15.154:0/2469207789 learned_addr learned my addr 172.21.15.154:0/2469207789 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db2720640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 0x7f4dac0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268964124 0 0) 0x7f4dac071770 con 0x7f4dac144980 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d98003520 con 0x7f4dac144980 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849040568 0 0) 0x7f4dac0ccb60 con 0x7f4dac0ceb70 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dac071770 con 0x7f4dac0ceb70 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 960687692 0 0) 0x7f4d98003520 con 0x7f4dac144980 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 msgr2=0x7f4dac0b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 0x7f4dac0b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 >> v1:172.21.15.194:6789/0 conn(0x7f4dac0ceb70 legacy=0x7f4dac0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0b4ce0 con 0x7f4dac144980 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f4da8001670 con 0x7f4dac144980 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 >> v1:172.21.15.154:6789/0 conn(0x7f4dac144980 legacy=0x7f4dac15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 0x7f4d98003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4d980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d98004d00 0x7f4d98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac15ced0 con 0x7f4d98004100 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9800bac0 con 0x7f4d98004d00 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.434+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9800bc80 con 0x7f4dac0b4370 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db171e640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4d980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db2720640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d98004d00 0x7f4d98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db1f1f640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 0x7f4d98003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db171e640 1 -- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 msgr2=0x7f4d98003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db171e640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0b4370 0x7f4d98003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db171e640 1 -- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d98004d00 msgr2=0x7f4d98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db171e640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d98004d00 0x7f4d98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.435+0000 7f4db171e640 1 -- 172.21.15.154:0/2469207789 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98003520 con 0x7f4d98004100 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db171e640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4d980047c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0018d0 tx=0x7f4d980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc470ea60a4a1a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c02f050 con 0x7f4d98004100 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c0052d0 con 0x7f4d98004100 2023-11-27T22:30:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db0f1d640 1 -- 172.21.15.154:0/2469207789 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c003810 con 0x7f4d98004100 2023-11-27T22:30:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db4183640 1 -- 172.21.15.154:0/2469207789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 msgr2=0x7f4d980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db4183640 1 --2- 172.21.15.154:0/2469207789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4d980047c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0018d0 tx=0x7f4d980057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db2720640 1 -- 172.21.15.154:0/2469207789 reap_dead start 2023-11-27T22:30:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db4183640 1 -- 172.21.15.154:0/2469207789 shutdown_connections 2023-11-27T22:30:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db4183640 1 -- 172.21.15.154:0/2469207789 >> 172.21.15.154:0/2469207789 conn(0x7f4dac06a4d0 msgr2=0x7f4dac06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db4183640 1 -- 172.21.15.154:0/2469207789 shutdown_connections 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.436+0000 7f4db4183640 1 -- 172.21.15.154:0/2469207789 wait complete. 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 Processor -- start 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 -- start start 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4dac1344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dac141ee0 0x7f4dac0acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0af5c0 0x7f4dac0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0affb0 con 0x7f4d98004100 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac158440 con 0x7f4dac141ee0 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db4183640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac1349e0 con 0x7f4dac0af5c0 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db1f1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4dac1344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db1f1f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4dac1344a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51514/0 (socket says 172.21.15.154:51514) 2023-11-27T22:30:45.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.438+0000 7f4db1f1f640 1 -- 172.21.15.154:0/2043135987 learned_addr learned my addr 172.21.15.154:0/2043135987 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db171e640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dac141ee0 0x7f4dac0acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db2720640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0af5c0 0x7f4dac0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db1f1f640 1 -- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0af5c0 msgr2=0x7f4dac0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db1f1f640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0af5c0 0x7f4dac0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db1f1f640 1 -- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dac141ee0 msgr2=0x7f4dac0acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db1f1f640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dac141ee0 0x7f4dac0acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db1f1f640 1 -- 172.21.15.154:0/2043135987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac157830 con 0x7f4d98004100 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db2720640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0af5c0 0x7f4dac0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db1f1f640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4dac1344a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4da8007290 tx=0x7f4da8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8001620 con 0x7f4d98004100 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da800f9c0 con 0x7f4d98004100 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac157b10 con 0x7f4d98004100 2023-11-27T22:30:45.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da800fd70 con 0x7f4d98004100 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.439+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac1580d0 con 0x7f4d98004100 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.440+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac0cbc20 con 0x7f4d98004100 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.440+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4da801d460 con 0x7f4d98004100 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.441+0000 7f4da27fc640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d9006b1c0 0x7f4d9006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.441+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4da8089ac0 con 0x7f4d98004100 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.441+0000 7f4db171e640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d9006b1c0 0x7f4d9006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.441+0000 7f4db171e640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d9006b1c0 0x7f4d9006d680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c034000 tx=0x7f4d9c031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.445+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4da80547f0 con 0x7f4d98004100 2023-11-27T22:30:45.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.608+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4dac0cd380 con 0x7f4d9006b1c0 2023-11-27T22:30:45.616 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.615+0000 7f4da27fc640 1 -- 172.21.15.154:0/2043135987 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277714 (secure 0 0 0) 0x7f4d9c0050d0 con 0x7f4d9006b1c0 2023-11-27T22:30:45.619 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:45.620 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d9006b1c0 msgr2=0x7f4d9006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d9006b1c0 0x7f4d9006d680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c034000 tx=0x7f4d9c031000 comp rx=0 tx=0).stop 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 msgr2=0x7f4dac1344a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4dac1344a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4da8007290 tx=0x7f4da8007750 comp rx=0 tx=0).stop 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 shutdown_connections 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dac141ee0 0x7f4dac0acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d9006b1c0 0x7f4d9006d680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dac0af5c0 0x7f4dac0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 --2- 172.21.15.154:0/2043135987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d98004100 0x7f4dac1344a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 >> 172.21.15.154:0/2043135987 conn(0x7f4dac06a4d0 msgr2=0x7f4dac0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 shutdown_connections 2023-11-27T22:30:45.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.618+0000 7f4db4183640 1 -- 172.21.15.154:0/2043135987 wait complete. 2023-11-27T22:30:45.630 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T22:30:44.974725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3874816,"data_stored":2201328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.296935"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680373+0000","last_change":"2023-11-27T22:30:40.680373+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680373+0000","last_undegraded":"2023-11-27T22:30:40.680373+0000","last_fullsized":"2023-11-27T22:30:40.680373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858830+0000","last_change":"2023-11-27T22:30:40.858830+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858830+0000","last_undegraded":"2023-11-27T22:30:40.858830+0000","last_fullsized":"2023-11-27T22:30:40.858830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682986+0000","last_change":"2023-11-27T22:30:40.682986+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682986+0000","last_undegraded":"2023-11-27T22:30:40.682986+0000","last_fullsized":"2023-11-27T22:30:40.682986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682753+0000","last_change":"2023-11-27T22:30:40.682753+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682753+0000","last_undegraded":"2023-11-27T22:30:40.682753+0000","last_fullsized":"2023-11-27T22:30:40.682753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681843+0000","last_change":"2023-11-27T22:30:40.681843+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681843+0000","last_undegraded":"2023-11-27T22:30:40.681843+0000","last_fullsized":"2023-11-27T22:30:40.681843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681086+0000","last_change":"2023-11-27T22:30:40.681086+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681086+0000","last_undegraded":"2023-11-27T22:30:40.681086+0000","last_fullsized":"2023-11-27T22:30:40.681086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683468+0000","last_change":"2023-11-27T22:30:40.683468+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683468+0000","last_undegraded":"2023-11-27T22:30:40.683468+0000","last_fullsized":"2023-11-27T22:30:40.683468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681615+0000","last_change":"2023-11-27T22:30:40.681615+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681615+0000","last_undegraded":"2023-11-27T22:30:40.681615+0000","last_fullsized":"2023-11-27T22:30:40.681615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683067+0000","last_change":"2023-11-27T22:30:40.683067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683067+0000","last_undegraded":"2023-11-27T22:30:40.683067+0000","last_fullsized":"2023-11-27T22:30:40.683067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858401+0000","last_change":"2023-11-27T22:30:40.858401+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858401+0000","last_undegraded":"2023-11-27T22:30:40.858401+0000","last_fullsized":"2023-11-27T22:30:40.858401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682940+0000","last_change":"2023-11-27T22:30:40.682940+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682940+0000","last_undegraded":"2023-11-27T22:30:40.682940+0000","last_fullsized":"2023-11-27T22:30:40.682940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682990+0000","last_change":"2023-11-27T22:30:40.682990+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682990+0000","last_undegraded":"2023-11-27T22:30:40.682990+0000","last_fullsized":"2023-11-27T22:30:40.682990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680402+0000","last_change":"2023-11-27T22:30:40.680402+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680402+0000","last_undegraded":"2023-11-27T22:30:40.680402+0000","last_fullsized":"2023-11-27T22:30:40.680402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680809+0000","last_change":"2023-11-27T22:30:40.680809+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680809+0000","last_undegraded":"2023-11-27T22:30:40.680809+0000","last_fullsized":"2023-11-27T22:30:40.680809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680855+0000","last_change":"2023-11-27T22:30:40.680855+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680855+0000","last_undegraded":"2023-11-27T22:30:40.680855+0000","last_fullsized":"2023-11-27T22:30:40.680855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681052+0000","last_change":"2023-11-27T22:30:40.681052+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681052+0000","last_undegraded":"2023-11-27T22:30:40.681052+0000","last_fullsized":"2023-11-27T22:30:40.681052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681405+0000","last_change":"2023-11-27T22:30:40.681405+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681405+0000","last_undegraded":"2023-11-27T22:30:40.681405+0000","last_fullsized":"2023-11-27T22:30:40.681405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681283+0000","last_change":"2023-11-27T22:30:40.681283+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681283+0000","last_undegraded":"2023-11-27T22:30:40.681283+0000","last_fullsized":"2023-11-27T22:30:40.681283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858480+0000","last_change":"2023-11-27T22:30:40.858480+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858480+0000","last_undegraded":"2023-11-27T22:30:40.858480+0000","last_fullsized":"2023-11-27T22:30:40.858480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680352+0000","last_change":"2023-11-27T22:30:40.680352+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680352+0000","last_undegraded":"2023-11-27T22:30:40.680352+0000","last_fullsized":"2023-11-27T22:30:40.680352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682067+0000","last_change":"2023-11-27T22:30:40.682067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682067+0000","last_undegraded":"2023-11-27T22:30:40.682067+0000","last_fullsized":"2023-11-27T22:30:40.682067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682806+0000","last_change":"2023-11-27T22:30:40.682806+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682806+0000","last_undegraded":"2023-11-27T22:30:40.682806+0000","last_fullsized":"2023-11-27T22:30:40.682806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680335+0000","last_change":"2023-11-27T22:30:40.680335+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680335+0000","last_undegraded":"2023-11-27T22:30:40.680335+0000","last_fullsized":"2023-11-27T22:30:40.680335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680969+0000","last_change":"2023-11-27T22:30:40.680969+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680969+0000","last_undegraded":"2023-11-27T22:30:40.680969+0000","last_fullsized":"2023-11-27T22:30:40.680969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683353+0000","last_change":"2023-11-27T22:30:40.683353+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683353+0000","last_undegraded":"2023-11-27T22:30:40.683353+0000","last_fullsized":"2023-11-27T22:30:40.683353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681025+0000","last_change":"2023-11-27T22:30:40.681025+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681025+0000","last_undegraded":"2023-11-27T22:30:40.681025+0000","last_fullsized":"2023-11-27T22:30:40.681025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T22:30:36.638841+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:30:36.638841+0000","last_peered":"2023-11-27T22:30:36.638841+0000","last_clean":"2023-11-27T22:30:36.638841+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:30:36.638841+0000","last_undegraded":"2023-11-27T22:30:36.638841+0000","last_fullsized":"2023-11-27T22:30:36.638841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.434},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.76000000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65300000000000002}]},{"osd":3,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.375},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.41999999999999998}]},{"osd":7,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.498}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.371}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.501}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.748},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.375}]},{"osd":2,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.248},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.28100000000000003}]},{"osd":3,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31}]},{"osd":4,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.432}]},{"osd":7,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.441}]},{"osd":3,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":4,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.627}]},{"osd":7,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:30:45.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:30:45.651 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-27T22:30:45.650+0000 7f17f0db3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T22:30:45.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.750+0000 7f63ec69b640 1 Processor -- start 2023-11-27T22:30:45.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.750+0000 7f63ec69b640 1 -- start start 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63ec69b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f63e4150560 0x7f63e40b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63ec69b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63e40b3390 0x7f63e415d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63ec69b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e40b49f0 con 0x7f63e4150940 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63ec69b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e40b3de0 con 0x7f63e40b3390 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63ec69b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e40b40c0 con 0x7f63e4150560 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63e40b3390 0x7f63e415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f63e40b3390 0x7f63e415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51530/0 (socket says 172.21.15.154:51530) 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63eac38640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f63e4150940 0x7f63e40ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:50236/0 (socket says 172.21.15.154:50236) 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 -- 172.21.15.154:0/650629813 learned_addr learned my addr 172.21.15.154:0/650629813 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63ea437640 1 --2- 172.21.15.154:0/650629813 >> v2:172.21.15.194:3300/0 conn(0x7f63e4150560 0x7f63e40b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 -- 172.21.15.154:0/650629813 >> v2:172.21.15.194:3300/0 conn(0x7f63e4150560 msgr2=0x7f63e40b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 --2- 172.21.15.154:0/650629813 >> v2:172.21.15.194:3300/0 conn(0x7f63e4150560 0x7f63e40b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 -- 172.21.15.154:0/650629813 >> v1:172.21.15.154:6789/0 conn(0x7f63e4150940 legacy=0x7f63e40ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9c36640 1 -- 172.21.15.154:0/650629813 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40b43a0 con 0x7f63e40b3390 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.751+0000 7f63e9435640 1 -- 172.21.15.154:0/650629813 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345130153 0 0) 0x7f63e40b49f0 con 0x7f63e4150940 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.752+0000 7f63e9c36640 1 --2- 172.21.15.154:0/650629813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e40b3390 0x7f63e415d200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f63e4072840 tx=0x7f63d402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca6cbe78290c33c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.752+0000 7f63e9435640 1 -- 172.21.15.154:0/650629813 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4036440 con 0x7f63e40b3390 2023-11-27T22:30:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.752+0000 7f63e9435640 1 -- 172.21.15.154:0/650629813 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d40365a0 con 0x7f63e40b3390 2023-11-27T22:30:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.752+0000 7f63e9435640 1 -- 172.21.15.154:0/650629813 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4036930 con 0x7f63e40b3390 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 -- 172.21.15.154:0/650629813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e40b3390 msgr2=0x7f63e415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 --2- 172.21.15.154:0/650629813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e40b3390 0x7f63e415d200 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f63e4072840 tx=0x7f63d402e170 comp rx=0 tx=0).stop 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 -- 172.21.15.154:0/650629813 shutdown_connections 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 --2- 172.21.15.154:0/650629813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e40b3390 0x7f63e415d200 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 --2- 172.21.15.154:0/650629813 >> v2:172.21.15.194:3300/0 conn(0x7f63e4150560 0x7f63e40b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 -- 172.21.15.154:0/650629813 >> 172.21.15.154:0/650629813 conn(0x7f63e406a4d0 msgr2=0x7f63e406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 -- 172.21.15.154:0/650629813 shutdown_connections 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.753+0000 7f63ec69b640 1 -- 172.21.15.154:0/650629813 wait complete. 2023-11-27T22:30:45.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.754+0000 7f63ec69b640 1 Processor -- start 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.754+0000 7f63ec69b640 1 -- start start 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ec69b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63e40b3390 0x7f63e4158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ec69b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 0x7f63e4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ec69b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63e414ec60 0x7f63e4070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ec69b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e41519b0 con 0x7f63e4150560 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ec69b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e4158540 con 0x7f63e414ec60 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ec69b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e4157160 con 0x7f63e40b3390 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 0x7f63e4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 0x7f63e4156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51534/0 (socket says 172.21.15.154:51534) 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 -- 172.21.15.154:0/461157630 learned_addr learned my addr 172.21.15.154:0/461157630 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63eac38640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63e414ec60 0x7f63e4070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63ea437640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63e40b3390 0x7f63e4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 -- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63e40b3390 msgr2=0x7f63e4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63e40b3390 0x7f63e4158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 -- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63e414ec60 msgr2=0x7f63e4070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63e414ec60 0x7f63e4070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 -- 172.21.15.154:0/461157630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d400b770 con 0x7f63e4150560 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63eac38640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63e414ec60 0x7f63e4070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.755+0000 7f63e9c36640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 0x7f63e4156c20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f63d4000c00 tx=0x7f63d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.756+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4036440 con 0x7f63e4150560 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.756+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d4034b00 con 0x7f63e4150560 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.756+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e4150d30 con 0x7f63e4150560 2023-11-27T22:30:45.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.756+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4041440 con 0x7f63e4150560 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.756+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e41512f0 con 0x7f63e4150560 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.757+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e4069400 con 0x7f63e4150560 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.757+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f63d403d040 con 0x7f63e4150560 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.757+0000 7f63daffd640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f63c806b1f0 0x7f63c806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.757+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63d40ae7c0 con 0x7f63e4150560 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.757+0000 7f63ea437640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f63c806b1f0 0x7f63c806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:45.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.758+0000 7f63ea437640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f63c806b1f0 0x7f63c806d6b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009f30 tx=0x7f63e000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:45.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.762+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f63d40794f0 con 0x7f63e4150560 2023-11-27T22:30:45.925 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.924+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63e40b4e80 con 0x7f63c806b1f0 2023-11-27T22:30:45.932 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.930+0000 7f63daffd640 1 -- 172.21.15.154:0/461157630 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277714 (secure 0 0 0) 0x7f63e0009b20 con 0x7f63c806b1f0 2023-11-27T22:30:45.935 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:45.936 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:30:45.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f63c806b1f0 msgr2=0x7f63c806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.937 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f63c806b1f0 0x7f63c806d6b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009f30 tx=0x7f63e000b040 comp rx=0 tx=0).stop 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 msgr2=0x7f63e4156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 0x7f63e4156c20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f63d4000c00 tx=0x7f63d40046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 shutdown_connections 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63e414ec60 0x7f63e4070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f63c806b1f0 0x7f63c806d6b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63e4150560 0x7f63e4156c20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 --2- 172.21.15.154:0/461157630 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63e40b3390 0x7f63e4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 >> 172.21.15.154:0/461157630 conn(0x7f63e406a4d0 msgr2=0x7f63e40cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 shutdown_connections 2023-11-27T22:30:45.938 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:45.934+0000 7f63ec69b640 1 -- 172.21.15.154:0/461157630 wait complete. 2023-11-27T22:30:45.946 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T22:30:44.974725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3874816,"data_stored":2201328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.296935"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680373+0000","last_change":"2023-11-27T22:30:40.680373+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680373+0000","last_undegraded":"2023-11-27T22:30:40.680373+0000","last_fullsized":"2023-11-27T22:30:40.680373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858830+0000","last_change":"2023-11-27T22:30:40.858830+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858830+0000","last_undegraded":"2023-11-27T22:30:40.858830+0000","last_fullsized":"2023-11-27T22:30:40.858830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682986+0000","last_change":"2023-11-27T22:30:40.682986+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682986+0000","last_undegraded":"2023-11-27T22:30:40.682986+0000","last_fullsized":"2023-11-27T22:30:40.682986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682753+0000","last_change":"2023-11-27T22:30:40.682753+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682753+0000","last_undegraded":"2023-11-27T22:30:40.682753+0000","last_fullsized":"2023-11-27T22:30:40.682753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681843+0000","last_change":"2023-11-27T22:30:40.681843+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681843+0000","last_undegraded":"2023-11-27T22:30:40.681843+0000","last_fullsized":"2023-11-27T22:30:40.681843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681086+0000","last_change":"2023-11-27T22:30:40.681086+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681086+0000","last_undegraded":"2023-11-27T22:30:40.681086+0000","last_fullsized":"2023-11-27T22:30:40.681086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683468+0000","last_change":"2023-11-27T22:30:40.683468+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683468+0000","last_undegraded":"2023-11-27T22:30:40.683468+0000","last_fullsized":"2023-11-27T22:30:40.683468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681615+0000","last_change":"2023-11-27T22:30:40.681615+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681615+0000","last_undegraded":"2023-11-27T22:30:40.681615+0000","last_fullsized":"2023-11-27T22:30:40.681615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683067+0000","last_change":"2023-11-27T22:30:40.683067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683067+0000","last_undegraded":"2023-11-27T22:30:40.683067+0000","last_fullsized":"2023-11-27T22:30:40.683067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858401+0000","last_change":"2023-11-27T22:30:40.858401+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858401+0000","last_undegraded":"2023-11-27T22:30:40.858401+0000","last_fullsized":"2023-11-27T22:30:40.858401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682940+0000","last_change":"2023-11-27T22:30:40.682940+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682940+0000","last_undegraded":"2023-11-27T22:30:40.682940+0000","last_fullsized":"2023-11-27T22:30:40.682940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682990+0000","last_change":"2023-11-27T22:30:40.682990+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682990+0000","last_undegraded":"2023-11-27T22:30:40.682990+0000","last_fullsized":"2023-11-27T22:30:40.682990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680402+0000","last_change":"2023-11-27T22:30:40.680402+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680402+0000","last_undegraded":"2023-11-27T22:30:40.680402+0000","last_fullsized":"2023-11-27T22:30:40.680402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680809+0000","last_change":"2023-11-27T22:30:40.680809+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680809+0000","last_undegraded":"2023-11-27T22:30:40.680809+0000","last_fullsized":"2023-11-27T22:30:40.680809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680855+0000","last_change":"2023-11-27T22:30:40.680855+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680855+0000","last_undegraded":"2023-11-27T22:30:40.680855+0000","last_fullsized":"2023-11-27T22:30:40.680855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681052+0000","last_change":"2023-11-27T22:30:40.681052+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681052+0000","last_undegraded":"2023-11-27T22:30:40.681052+0000","last_fullsized":"2023-11-27T22:30:40.681052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681405+0000","last_change":"2023-11-27T22:30:40.681405+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681405+0000","last_undegraded":"2023-11-27T22:30:40.681405+0000","last_fullsized":"2023-11-27T22:30:40.681405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681283+0000","last_change":"2023-11-27T22:30:40.681283+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681283+0000","last_undegraded":"2023-11-27T22:30:40.681283+0000","last_fullsized":"2023-11-27T22:30:40.681283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858480+0000","last_change":"2023-11-27T22:30:40.858480+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858480+0000","last_undegraded":"2023-11-27T22:30:40.858480+0000","last_fullsized":"2023-11-27T22:30:40.858480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680352+0000","last_change":"2023-11-27T22:30:40.680352+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680352+0000","last_undegraded":"2023-11-27T22:30:40.680352+0000","last_fullsized":"2023-11-27T22:30:40.680352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682067+0000","last_change":"2023-11-27T22:30:40.682067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682067+0000","last_undegraded":"2023-11-27T22:30:40.682067+0000","last_fullsized":"2023-11-27T22:30:40.682067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682806+0000","last_change":"2023-11-27T22:30:40.682806+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682806+0000","last_undegraded":"2023-11-27T22:30:40.682806+0000","last_fullsized":"2023-11-27T22:30:40.682806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680335+0000","last_change":"2023-11-27T22:30:40.680335+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680335+0000","last_undegraded":"2023-11-27T22:30:40.680335+0000","last_fullsized":"2023-11-27T22:30:40.680335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680969+0000","last_change":"2023-11-27T22:30:40.680969+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680969+0000","last_undegraded":"2023-11-27T22:30:40.680969+0000","last_fullsized":"2023-11-27T22:30:40.680969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683353+0000","last_change":"2023-11-27T22:30:40.683353+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683353+0000","last_undegraded":"2023-11-27T22:30:40.683353+0000","last_fullsized":"2023-11-27T22:30:40.683353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681025+0000","last_change":"2023-11-27T22:30:40.681025+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681025+0000","last_undegraded":"2023-11-27T22:30:40.681025+0000","last_fullsized":"2023-11-27T22:30:40.681025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T22:30:36.638841+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:30:36.638841+0000","last_peered":"2023-11-27T22:30:36.638841+0000","last_clean":"2023-11-27T22:30:36.638841+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:30:36.638841+0000","last_undegraded":"2023-11-27T22:30:36.638841+0000","last_fullsized":"2023-11-27T22:30:36.638841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.434},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.76000000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65300000000000002}]},{"osd":3,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.375},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.41999999999999998}]},{"osd":7,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.498}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.371}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.501}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.748},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.375}]},{"osd":2,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.248},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.28100000000000003}]},{"osd":3,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31}]},{"osd":4,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.432}]},{"osd":7,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.441}]},{"osd":3,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":4,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.627}]},{"osd":7,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:30:45.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:30:46.088 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.087+0000 7f55becd0640 1 Processor -- start 2023-11-27T22:30:46.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.087+0000 7f55becd0640 1 -- start start 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.087+0000 7f55becd0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55becd0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55b80b4370 0x7f55b80b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55becd0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b8071770 con 0x7f55b80ceb70 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55becd0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80b4d20 con 0x7f55b80b4370 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55becd0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80ccb60 con 0x7f55b8144980 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55b80b4370 0x7f55b80b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f55b80b4370 0x7f55b80b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51550/0 (socket says 172.21.15.154:51550) 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 -- 172.21.15.154:0/1147233112 learned_addr learned my addr 172.21.15.154:0/1147233112 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 -- 172.21.15.154:0/1147233112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 msgr2=0x7f55b815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:46.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 --2- 172.21.15.154:0/1147233112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 -- 172.21.15.154:0/1147233112 >> v1:172.21.15.194:6789/0 conn(0x7f55b80ceb70 legacy=0x7f55b80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:46.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.088+0000 7f55bd26d640 1 -- 172.21.15.154:0/1147233112 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b80ccdc0 con 0x7f55b80b4370 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55bd26d640 1 --2- 172.21.15.154:0/1147233112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80b4370 0x7f55b80b47e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009e50 tx=0x7f55b002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1767d324e7b7a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55b77fe640 1 -- 172.21.15.154:0/1147233112 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b002ca70 con 0x7f55b80b4370 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55b77fe640 1 -- 172.21.15.154:0/1147233112 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b002cbd0 con 0x7f55b80b4370 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55b77fe640 1 -- 172.21.15.154:0/1147233112 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00343f0 con 0x7f55b80b4370 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 -- 172.21.15.154:0/1147233112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80b4370 msgr2=0x7f55b80b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 --2- 172.21.15.154:0/1147233112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80b4370 0x7f55b80b47e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009e50 tx=0x7f55b002bed0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 -- 172.21.15.154:0/1147233112 shutdown_connections 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 --2- 172.21.15.154:0/1147233112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80b4370 0x7f55b80b47e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 --2- 172.21.15.154:0/1147233112 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 -- 172.21.15.154:0/1147233112 >> 172.21.15.154:0/1147233112 conn(0x7f55b806a4d0 msgr2=0x7f55b806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:46.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 -- 172.21.15.154:0/1147233112 shutdown_connections 2023-11-27T22:30:46.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.089+0000 7f55becd0640 1 -- 172.21.15.154:0/1147233112 wait complete. 2023-11-27T22:30:46.094 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.091+0000 7f55becd0640 1 Processor -- start 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.091+0000 7f55becd0640 1 -- start start 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.091+0000 7f55becd0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55b80b4370 0x7f55b812fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 0x7f55b81e3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b812f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b81e4070 con 0x7f55b80ceb70 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b81e3dd0 con 0x7f55b80b4370 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b812d360 con 0x7f55b8144980 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 0x7f55b81e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 0x7f55b81e3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51562/0 (socket says 172.21.15.154:51562) 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 -- 172.21.15.154:0/1437777718 learned_addr learned my addr 172.21.15.154:0/1437777718 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55bd26d640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b812f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.095 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55bca6c640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55b80b4370 0x7f55b812fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 -- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 msgr2=0x7f55b812f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b812f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 -- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55b80b4370 msgr2=0x7f55b812fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55b80b4370 0x7f55b812fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 -- 172.21.15.154:0/1437777718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0009b30 con 0x7f55b80ceb70 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b7fff640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 0x7f55b81e3890 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f55a400c400 tx=0x7f55a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4011790 con 0x7f55b80ceb70 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a4011930 con 0x7f55b80ceb70 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a4011ce0 con 0x7f55b80ceb70 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b812d640 con 0x7f55b80ceb70 2023-11-27T22:30:46.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.092+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b812dc00 con 0x7f55b80ceb70 2023-11-27T22:30:46.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.093+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b812de20 con 0x7f55b80ceb70 2023-11-27T22:30:46.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.094+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f55a401c460 con 0x7f55b80ceb70 2023-11-27T22:30:46.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.094+0000 7f55b57fa640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f559c06b1f0 0x7f559c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.094+0000 7f55bca6c640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f559c06b1f0 0x7f559c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.094+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55a40899e0 con 0x7f55b80ceb70 2023-11-27T22:30:46.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.095+0000 7f55bca6c640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f559c06b1f0 0x7f559c06d6b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00b810 tx=0x7f55ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.099+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f55a4054680 con 0x7f55b80ceb70 2023-11-27T22:30:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.260+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55b8071400 con 0x7f559c06b1f0 2023-11-27T22:30:46.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.267+0000 7f55b57fa640 1 -- 172.21.15.154:0/1437777718 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277714 (secure 0 0 0) 0x7f55ac00b400 con 0x7f559c06b1f0 2023-11-27T22:30:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:46.272 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f559c06b1f0 msgr2=0x7f559c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f559c06b1f0 0x7f559c06d6b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00b810 tx=0x7f55ac008040 comp rx=0 tx=0).stop 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 msgr2=0x7f55b81e3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 0x7f55b81e3890 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f55a400c400 tx=0x7f55a400c8c0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 shutdown_connections 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f559c06b1f0 0x7f559c06d6b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.274 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55b8144980 0x7f55b812f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55b80ceb70 0x7f55b81e3890 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 --2- 172.21.15.154:0/1437777718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55b80b4370 0x7f55b812fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 >> 172.21.15.154:0/1437777718 conn(0x7f55b806a4d0 msgr2=0x7f55b806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 shutdown_connections 2023-11-27T22:30:46.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.270+0000 7f55becd0640 1 -- 172.21.15.154:0/1437777718 wait complete. 2023-11-27T22:30:46.283 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T22:30:44.974725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3874816,"data_stored":2201328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.296935"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680373+0000","last_change":"2023-11-27T22:30:40.680373+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680373+0000","last_undegraded":"2023-11-27T22:30:40.680373+0000","last_fullsized":"2023-11-27T22:30:40.680373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858830+0000","last_change":"2023-11-27T22:30:40.858830+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858830+0000","last_undegraded":"2023-11-27T22:30:40.858830+0000","last_fullsized":"2023-11-27T22:30:40.858830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682986+0000","last_change":"2023-11-27T22:30:40.682986+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682986+0000","last_undegraded":"2023-11-27T22:30:40.682986+0000","last_fullsized":"2023-11-27T22:30:40.682986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682753+0000","last_change":"2023-11-27T22:30:40.682753+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682753+0000","last_undegraded":"2023-11-27T22:30:40.682753+0000","last_fullsized":"2023-11-27T22:30:40.682753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681843+0000","last_change":"2023-11-27T22:30:40.681843+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681843+0000","last_undegraded":"2023-11-27T22:30:40.681843+0000","last_fullsized":"2023-11-27T22:30:40.681843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681086+0000","last_change":"2023-11-27T22:30:40.681086+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681086+0000","last_undegraded":"2023-11-27T22:30:40.681086+0000","last_fullsized":"2023-11-27T22:30:40.681086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683468+0000","last_change":"2023-11-27T22:30:40.683468+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683468+0000","last_undegraded":"2023-11-27T22:30:40.683468+0000","last_fullsized":"2023-11-27T22:30:40.683468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681615+0000","last_change":"2023-11-27T22:30:40.681615+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681615+0000","last_undegraded":"2023-11-27T22:30:40.681615+0000","last_fullsized":"2023-11-27T22:30:40.681615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683067+0000","last_change":"2023-11-27T22:30:40.683067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683067+0000","last_undegraded":"2023-11-27T22:30:40.683067+0000","last_fullsized":"2023-11-27T22:30:40.683067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858401+0000","last_change":"2023-11-27T22:30:40.858401+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858401+0000","last_undegraded":"2023-11-27T22:30:40.858401+0000","last_fullsized":"2023-11-27T22:30:40.858401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682940+0000","last_change":"2023-11-27T22:30:40.682940+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682940+0000","last_undegraded":"2023-11-27T22:30:40.682940+0000","last_fullsized":"2023-11-27T22:30:40.682940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682990+0000","last_change":"2023-11-27T22:30:40.682990+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682990+0000","last_undegraded":"2023-11-27T22:30:40.682990+0000","last_fullsized":"2023-11-27T22:30:40.682990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680402+0000","last_change":"2023-11-27T22:30:40.680402+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680402+0000","last_undegraded":"2023-11-27T22:30:40.680402+0000","last_fullsized":"2023-11-27T22:30:40.680402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680809+0000","last_change":"2023-11-27T22:30:40.680809+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680809+0000","last_undegraded":"2023-11-27T22:30:40.680809+0000","last_fullsized":"2023-11-27T22:30:40.680809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680855+0000","last_change":"2023-11-27T22:30:40.680855+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680855+0000","last_undegraded":"2023-11-27T22:30:40.680855+0000","last_fullsized":"2023-11-27T22:30:40.680855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681052+0000","last_change":"2023-11-27T22:30:40.681052+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681052+0000","last_undegraded":"2023-11-27T22:30:40.681052+0000","last_fullsized":"2023-11-27T22:30:40.681052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681405+0000","last_change":"2023-11-27T22:30:40.681405+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681405+0000","last_undegraded":"2023-11-27T22:30:40.681405+0000","last_fullsized":"2023-11-27T22:30:40.681405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681283+0000","last_change":"2023-11-27T22:30:40.681283+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681283+0000","last_undegraded":"2023-11-27T22:30:40.681283+0000","last_fullsized":"2023-11-27T22:30:40.681283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858480+0000","last_change":"2023-11-27T22:30:40.858480+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858480+0000","last_undegraded":"2023-11-27T22:30:40.858480+0000","last_fullsized":"2023-11-27T22:30:40.858480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680352+0000","last_change":"2023-11-27T22:30:40.680352+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680352+0000","last_undegraded":"2023-11-27T22:30:40.680352+0000","last_fullsized":"2023-11-27T22:30:40.680352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682067+0000","last_change":"2023-11-27T22:30:40.682067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682067+0000","last_undegraded":"2023-11-27T22:30:40.682067+0000","last_fullsized":"2023-11-27T22:30:40.682067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682806+0000","last_change":"2023-11-27T22:30:40.682806+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682806+0000","last_undegraded":"2023-11-27T22:30:40.682806+0000","last_fullsized":"2023-11-27T22:30:40.682806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680335+0000","last_change":"2023-11-27T22:30:40.680335+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680335+0000","last_undegraded":"2023-11-27T22:30:40.680335+0000","last_fullsized":"2023-11-27T22:30:40.680335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680969+0000","last_change":"2023-11-27T22:30:40.680969+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680969+0000","last_undegraded":"2023-11-27T22:30:40.680969+0000","last_fullsized":"2023-11-27T22:30:40.680969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683353+0000","last_change":"2023-11-27T22:30:40.683353+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683353+0000","last_undegraded":"2023-11-27T22:30:40.683353+0000","last_fullsized":"2023-11-27T22:30:40.683353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681025+0000","last_change":"2023-11-27T22:30:40.681025+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681025+0000","last_undegraded":"2023-11-27T22:30:40.681025+0000","last_fullsized":"2023-11-27T22:30:40.681025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T22:30:36.638841+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:30:36.638841+0000","last_peered":"2023-11-27T22:30:36.638841+0000","last_clean":"2023-11-27T22:30:36.638841+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:30:36.638841+0000","last_undegraded":"2023-11-27T22:30:36.638841+0000","last_fullsized":"2023-11-27T22:30:36.638841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.434},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.76000000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65300000000000002}]},{"osd":3,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.375},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.41999999999999998}]},{"osd":7,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.498}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.371}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.501}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.748},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.375}]},{"osd":2,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.248},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.28100000000000003}]},{"osd":3,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31}]},{"osd":4,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.432}]},{"osd":7,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.441}]},{"osd":3,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":4,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.627}]},{"osd":7,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:30:46.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-27T22:30:46.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-27T22:30:46.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-27T22:30:46.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-27T22:30:46.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-27T22:30:46.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680373+0000', 'last_change': '2023-11-27T22:30:40.680373+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680373+0000', 'last_undegraded': '2023-11-27T22:30:40.680373+0000', 'last_fullsized': '2023-11-27T22:30:40.680373+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.858830+0000', 'last_change': '2023-11-27T22:30:40.858830+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.858830+0000', 'last_undegraded': '2023-11-27T22:30:40.858830+0000', 'last_fullsized': '2023-11-27T22:30:40.858830+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682986+0000', 'last_change': '2023-11-27T22:30:40.682986+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682986+0000', 'last_undegraded': '2023-11-27T22:30:40.682986+0000', 'last_fullsized': '2023-11-27T22:30:40.682986+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682753+0000', 'last_change': '2023-11-27T22:30:40.682753+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682753+0000', 'last_undegraded': '2023-11-27T22:30:40.682753+0000', 'last_fullsized': '2023-11-27T22:30:40.682753+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T22:30:46.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681843+0000', 'last_change': '2023-11-27T22:30:40.681843+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681843+0000', 'last_undegraded': '2023-11-27T22:30:40.681843+0000', 'last_fullsized': '2023-11-27T22:30:40.681843+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681086+0000', 'last_change': '2023-11-27T22:30:40.681086+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681086+0000', 'last_undegraded': '2023-11-27T22:30:40.681086+0000', 'last_fullsized': '2023-11-27T22:30:40.681086+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.683468+0000', 'last_change': '2023-11-27T22:30:40.683468+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.683468+0000', 'last_undegraded': '2023-11-27T22:30:40.683468+0000', 'last_fullsized': '2023-11-27T22:30:40.683468+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681615+0000', 'last_change': '2023-11-27T22:30:40.681615+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681615+0000', 'last_undegraded': '2023-11-27T22:30:40.681615+0000', 'last_fullsized': '2023-11-27T22:30:40.681615+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-27T22:30:46.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.683067+0000', 'last_change': '2023-11-27T22:30:40.683067+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.683067+0000', 'last_undegraded': '2023-11-27T22:30:40.683067+0000', 'last_fullsized': '2023-11-27T22:30:40.683067+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.858401+0000', 'last_change': '2023-11-27T22:30:40.858401+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.858401+0000', 'last_undegraded': '2023-11-27T22:30:40.858401+0000', 'last_fullsized': '2023-11-27T22:30:40.858401+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-27T22:30:46.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682940+0000', 'last_change': '2023-11-27T22:30:40.682940+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682940+0000', 'last_undegraded': '2023-11-27T22:30:40.682940+0000', 'last_fullsized': '2023-11-27T22:30:40.682940+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682990+0000', 'last_change': '2023-11-27T22:30:40.682990+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682990+0000', 'last_undegraded': '2023-11-27T22:30:40.682990+0000', 'last_fullsized': '2023-11-27T22:30:40.682990+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680402+0000', 'last_change': '2023-11-27T22:30:40.680402+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680402+0000', 'last_undegraded': '2023-11-27T22:30:40.680402+0000', 'last_fullsized': '2023-11-27T22:30:40.680402+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-27T22:30:46.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680809+0000', 'last_change': '2023-11-27T22:30:40.680809+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680809+0000', 'last_undegraded': '2023-11-27T22:30:40.680809+0000', 'last_fullsized': '2023-11-27T22:30:40.680809+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682923+0000', 'last_change': '2023-11-27T22:30:40.682923+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682923+0000', 'last_undegraded': '2023-11-27T22:30:40.682923+0000', 'last_fullsized': '2023-11-27T22:30:40.682923+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-27T22:30:46.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682923+0000', 'last_change': '2023-11-27T22:30:40.682923+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682923+0000', 'last_undegraded': '2023-11-27T22:30:40.682923+0000', 'last_fullsized': '2023-11-27T22:30:40.682923+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680855+0000', 'last_change': '2023-11-27T22:30:40.680855+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680855+0000', 'last_undegraded': '2023-11-27T22:30:40.680855+0000', 'last_fullsized': '2023-11-27T22:30:40.680855+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681052+0000', 'last_change': '2023-11-27T22:30:40.681052+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681052+0000', 'last_undegraded': '2023-11-27T22:30:40.681052+0000', 'last_fullsized': '2023-11-27T22:30:40.681052+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-27T22:30:46.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681405+0000', 'last_change': '2023-11-27T22:30:40.681405+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681405+0000', 'last_undegraded': '2023-11-27T22:30:40.681405+0000', 'last_fullsized': '2023-11-27T22:30:40.681405+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681283+0000', 'last_change': '2023-11-27T22:30:40.681283+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681283+0000', 'last_undegraded': '2023-11-27T22:30:40.681283+0000', 'last_fullsized': '2023-11-27T22:30:40.681283+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-27T22:30:46.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.858480+0000', 'last_change': '2023-11-27T22:30:40.858480+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.858480+0000', 'last_undegraded': '2023-11-27T22:30:40.858480+0000', 'last_fullsized': '2023-11-27T22:30:40.858480+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680352+0000', 'last_change': '2023-11-27T22:30:40.680352+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680352+0000', 'last_undegraded': '2023-11-27T22:30:40.680352+0000', 'last_fullsized': '2023-11-27T22:30:40.680352+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682067+0000', 'last_change': '2023-11-27T22:30:40.682067+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682067+0000', 'last_undegraded': '2023-11-27T22:30:40.682067+0000', 'last_fullsized': '2023-11-27T22:30:40.682067+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-27T22:30:46.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.682806+0000', 'last_change': '2023-11-27T22:30:40.682806+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.682806+0000', 'last_undegraded': '2023-11-27T22:30:40.682806+0000', 'last_fullsized': '2023-11-27T22:30:40.682806+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680335+0000', 'last_change': '2023-11-27T22:30:40.680335+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680335+0000', 'last_undegraded': '2023-11-27T22:30:40.680335+0000', 'last_fullsized': '2023-11-27T22:30:40.680335+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.857943+0000', 'last_change': '2023-11-27T22:30:40.857943+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.857943+0000', 'last_undegraded': '2023-11-27T22:30:40.857943+0000', 'last_fullsized': '2023-11-27T22:30:40.857943+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T22:30:46.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680290+0000', 'last_change': '2023-11-27T22:30:40.680290+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680290+0000', 'last_undegraded': '2023-11-27T22:30:40.680290+0000', 'last_fullsized': '2023-11-27T22:30:40.680290+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.857943+0000', 'last_change': '2023-11-27T22:30:40.857943+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.857943+0000', 'last_undegraded': '2023-11-27T22:30:40.857943+0000', 'last_fullsized': '2023-11-27T22:30:40.857943+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680290+0000', 'last_change': '2023-11-27T22:30:40.680290+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680290+0000', 'last_undegraded': '2023-11-27T22:30:40.680290+0000', 'last_fullsized': '2023-11-27T22:30:40.680290+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.680969+0000', 'last_change': '2023-11-27T22:30:40.680969+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.680969+0000', 'last_undegraded': '2023-11-27T22:30:40.680969+0000', 'last_fullsized': '2023-11-27T22:30:40.680969+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.683353+0000', 'last_change': '2023-11-27T22:30:40.683353+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.683353+0000', 'last_undegraded': '2023-11-27T22:30:40.683353+0000', 'last_fullsized': '2023-11-27T22:30:40.683353+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T22:30:46.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-27T22:30:46.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T22:30:41.677825+0000', 'last_change': '2023-11-27T22:30:41.677825+0000', 'last_active': '2023-11-27T22:30:41.677825+0000', 'last_peered': '2023-11-27T22:30:41.677825+0000', 'last_clean': '2023-11-27T22:30:41.677825+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:41.677825+0000', 'last_undegraded': '2023-11-27T22:30:41.677825+0000', 'last_fullsized': '2023-11-27T22:30:41.677825+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:41.677825+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T22:30:46.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-27T22:30:46.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2023-11-27T22:30:40.681025+0000', 'last_change': '2023-11-27T22:30:40.681025+0000', 'last_active': '2023-11-27T22:30:40.675607+0000', 'last_peered': '2023-11-27T22:30:40.675607+0000', 'last_clean': '2023-11-27T22:30:40.675607+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T22:30:40.681025+0000', 'last_undegraded': '2023-11-27T22:30:40.681025+0000', 'last_fullsized': '2023-11-27T22:30:40.681025+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'last_clean_scrub_stamp': '2023-11-27T22:30:40.675607+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T22:30:46.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T22:30:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 Processor -- start 2023-11-27T22:30:46.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 -- start start 2023-11-27T22:30:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68bc15d330 0x7f68bc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68bc0d2910 0x7f68bc0d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc0b2b10 con 0x7f68bc0d3730 2023-11-27T22:30:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0d3bc0 con 0x7f68bc15d330 2023-11-27T22:30:46.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.422+0000 7f68c171d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc0d1590 con 0x7f68bc0d2910 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68bc15d330 0x7f68bc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68bc15d330 0x7f68bc0b8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51574/0 (socket says 172.21.15.154:51574) 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 -- 172.21.15.154:0/3310174717 learned_addr learned my addr 172.21.15.154:0/3310174717 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68ba7fc640 1 --2- 172.21.15.154:0/3310174717 >> v2:172.21.15.194:3300/0 conn(0x7f68bc0d2910 0x7f68bc0d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 -- 172.21.15.154:0/3310174717 >> v2:172.21.15.194:3300/0 conn(0x7f68bc0d2910 msgr2=0x7f68bc0d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 --2- 172.21.15.154:0/3310174717 >> v2:172.21.15.194:3300/0 conn(0x7f68bc0d2910 0x7f68bc0d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 -- 172.21.15.154:0/3310174717 >> v1:172.21.15.194:6789/0 conn(0x7f68bc0d3730 legacy=0x7f68bc0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68baffd640 1 -- 172.21.15.154:0/3310174717 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0d1870 con 0x7f68bc15d330 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.423+0000 7f68ba7fc640 1 --2- 172.21.15.154:0/3310174717 >> v2:172.21.15.194:3300/0 conn(0x7f68bc0d2910 0x7f68bc0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68baffd640 1 --2- 172.21.15.154:0/3310174717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc15d330 0x7f68bc0b8b80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0d1540 tx=0x7f68b402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ba960bf8b8e0fa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68b9ffb640 1 -- 172.21.15.154:0/3310174717 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40317e0 con 0x7f68bc15d330 2023-11-27T22:30:46.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68b9ffb640 1 -- 172.21.15.154:0/3310174717 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4031940 con 0x7f68bc15d330 2023-11-27T22:30:46.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68b9ffb640 1 -- 172.21.15.154:0/3310174717 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4031cd0 con 0x7f68bc15d330 2023-11-27T22:30:46.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 -- 172.21.15.154:0/3310174717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc15d330 msgr2=0x7f68bc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 --2- 172.21.15.154:0/3310174717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc15d330 0x7f68bc0b8b80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0d1540 tx=0x7f68b402b880 comp rx=0 tx=0).stop 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 -- 172.21.15.154:0/3310174717 shutdown_connections 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 --2- 172.21.15.154:0/3310174717 >> v2:172.21.15.194:3300/0 conn(0x7f68bc0d2910 0x7f68bc0d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 --2- 172.21.15.154:0/3310174717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc15d330 0x7f68bc0b8b80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 -- 172.21.15.154:0/3310174717 >> 172.21.15.154:0/3310174717 conn(0x7f68bc072020 msgr2=0x7f68bc072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 -- 172.21.15.154:0/3310174717 shutdown_connections 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.424+0000 7f68c171d640 1 -- 172.21.15.154:0/3310174717 wait complete. 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 Processor -- start 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 -- start start 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 0x7f68bc160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68bc0d3730 0x7f68bc0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68bc15d330 0x7f68bc15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc15fbe0 con 0x7f68bc0d2910 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc1546b0 con 0x7f68bc15d330 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68c171d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc153ea0 con 0x7f68bc0d3730 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68baffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 0x7f68bc160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68baffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 0x7f68bc160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51584/0 (socket says 172.21.15.154:51584) 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.426+0000 7f68baffd640 1 -- 172.21.15.154:0/2109179891 learned_addr learned my addr 172.21.15.154:0/2109179891 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68bb7fe640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68bc15d330 0x7f68bc15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.431 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68baffd640 1 -- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68bc0d3730 msgr2=0x7f68bc0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68baffd640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68bc0d3730 0x7f68bc0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68baffd640 1 -- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68bc15d330 msgr2=0x7f68bc15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68baffd640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68bc15d330 0x7f68bc15e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68baffd640 1 -- 172.21.15.154:0/2109179891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40094d0 con 0x7f68bc0d2910 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68baffd640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 0x7f68bc160600 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f68b402b8c0 tx=0x7f68b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40329c0 con 0x7f68bc0d2910 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4032b40 con 0x7f68bc0d2910 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40453f0 con 0x7f68bc0d2910 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc15f890 con 0x7f68bc0d2910 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.427+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc1540f0 con 0x7f68bc0d2910 2023-11-27T22:30:46.432 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.428+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc15fd20 con 0x7f68bc0d2910 2023-11-27T22:30:46.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.428+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f68b404d3f0 con 0x7f68bc0d2910 2023-11-27T22:30:46.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.429+0000 7f68b37fe640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f689c06b1c0 0x7f689c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.429+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68b40ab890 con 0x7f68bc0d2910 2023-11-27T22:30:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.429+0000 7f68ba7fc640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f689c06b1c0 0x7f689c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.429+0000 7f68ba7fc640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f689c06b1c0 0x7f689c06d680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68a4006fd0 tx=0x7f68a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.433+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f68bc15fd20 con 0x7f68bc0d2910 2023-11-27T22:30:46.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.663+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f68bc15fd20 con 0x7f68bc0d2910 2023-11-27T22:30:46.665 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.663+0000 7f68b37fe640 1 -- 172.21.15.154:0/2109179891 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1269 (secure 0 0 0) 0x7f68bc15fd20 con 0x7f68bc0d2910 2023-11-27T22:30:46.665 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:46.665 INFO:teuthology.orchestra.run.smithi154.stdout:{"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":91,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1701124165,"num_in_osds":8,"osd_in_since":1701124157,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225243136,"bytes_avail":772868870144,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":12,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5229}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-11-27T22:30:34.973294+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f689c06b1c0 msgr2=0x7f689c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f689c06b1c0 0x7f689c06d680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68a4006fd0 tx=0x7f68a4008040 comp rx=0 tx=0).stop 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 msgr2=0x7f68bc160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 0x7f68bc160600 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f68b402b8c0 tx=0x7f68b40046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 shutdown_connections 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68bc15d330 0x7f68bc15e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f689c06b1c0 0x7f689c06d680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68bc0d3730 0x7f68bc0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 --2- 172.21.15.154:0/2109179891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68bc0d2910 0x7f68bc160600 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 >> 172.21.15.154:0/2109179891 conn(0x7f68bc072020 msgr2=0x7f68bc0b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:46.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 shutdown_connections 2023-11-27T22:30:46.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.665+0000 7f68c171d640 1 -- 172.21.15.154:0/2109179891 wait complete. 2023-11-27T22:30:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T22:30:46.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:30:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.777+0000 7f5666eee640 1 Processor -- start 2023-11-27T22:30:46.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.777+0000 7f5666eee640 1 -- start start 2023-11-27T22:30:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f5666eee640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5660143490 0x7f56600b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f5666eee640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f566015e730 0x7f56600b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f5666eee640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566015e2a0 con 0x7f566015a4e0 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f5666eee640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566015b520 con 0x7f566015e730 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f5666eee640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5660143870 con 0x7f5660143490 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f565ffff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f566015e730 0x7f56600b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f5664c8a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5660143490 0x7f56600b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f565ffff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f566015e730 0x7f56600b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:49308/0 (socket says 172.21.15.154:49308) 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.778+0000 7f565ffff640 1 -- 172.21.15.154:0/1587099137 learned_addr learned my addr 172.21.15.154:0/1587099137 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.779+0000 7f565f7fe640 1 -- 172.21.15.154:0/1587099137 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871615952 0 0) 0x7f566015e2a0 con 0x7f566015a4e0 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.779+0000 7f565f7fe640 1 -- 172.21.15.154:0/1587099137 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564c003520 con 0x7f566015a4e0 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.779+0000 7f5664c8a640 1 -- 172.21.15.154:0/1587099137 >> v2:172.21.15.194:3300/0 conn(0x7f566015e730 msgr2=0x7f56600b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.779+0000 7f5664c8a640 1 --2- 172.21.15.154:0/1587099137 >> v2:172.21.15.194:3300/0 conn(0x7f566015e730 0x7f56600b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.779+0000 7f5664c8a640 1 -- 172.21.15.154:0/1587099137 >> v1:172.21.15.194:6789/0 conn(0x7f566015a4e0 legacy=0x7f566015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.779+0000 7f5664c8a640 1 -- 172.21.15.154:0/1587099137 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566015b240 con 0x7f5660143490 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5664c8a640 1 --2- 172.21.15.154:0/1587099137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5660143490 0x7f56600b0cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56480097a0 tx=0x7f564802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a243cf2b9a9fd8b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f565f7fe640 1 -- 172.21.15.154:0/1587099137 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648031830 con 0x7f5660143490 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f565f7fe640 1 -- 172.21.15.154:0/1587099137 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648031990 con 0x7f5660143490 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f565f7fe640 1 -- 172.21.15.154:0/1587099137 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648031d00 con 0x7f5660143490 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 -- 172.21.15.154:0/1587099137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5660143490 msgr2=0x7f56600b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 --2- 172.21.15.154:0/1587099137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5660143490 0x7f56600b0cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56480097a0 tx=0x7f564802b8d0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 -- 172.21.15.154:0/1587099137 shutdown_connections 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 --2- 172.21.15.154:0/1587099137 >> v2:172.21.15.194:3300/0 conn(0x7f566015e730 0x7f56600b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.783 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 --2- 172.21.15.154:0/1587099137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5660143490 0x7f56600b0cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 -- 172.21.15.154:0/1587099137 >> 172.21.15.154:0/1587099137 conn(0x7f566006a4d0 msgr2=0x7f566006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:46.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 -- 172.21.15.154:0/1587099137 shutdown_connections 2023-11-27T22:30:46.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.780+0000 7f5666eee640 1 -- 172.21.15.154:0/1587099137 wait complete. 2023-11-27T22:30:46.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.781+0000 7f5666eee640 1 Processor -- start 2023-11-27T22:30:46.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 -- start start 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5660143490 0x7f56601f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 0x7f56601e4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015e730 0x7f5660141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601e4840 con 0x7f566015a4e0 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56601f1600 con 0x7f5660143490 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.782+0000 7f5666eee640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56601f18e0 con 0x7f566015e730 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 0x7f56601e4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 0x7f56601e4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51600/0 (socket says 172.21.15.154:51600) 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 -- 172.21.15.154:0/558316887 learned_addr learned my addr 172.21.15.154:0/558316887 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:46.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f5664c8a640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5660143490 0x7f56601f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f566548b640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015e730 0x7f5660141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 -- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015e730 msgr2=0x7f5660141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015e730 0x7f5660141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 -- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5660143490 msgr2=0x7f56601f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5660143490 0x7f56601f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 -- 172.21.15.154:0/558316887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648009400 con 0x7f566015a4e0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f566548b640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015e730 0x7f5660141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565ffff640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 0x7f56601e4300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f565000e840 tx=0x7f565000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000c8e0 con 0x7f566015a4e0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000ca40 con 0x7f566015a4e0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565000cdf0 con 0x7f566015a4e0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56601f1bc0 con 0x7f566015a4e0 2023-11-27T22:30:46.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.783+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56601f2180 con 0x7f566015a4e0 2023-11-27T22:30:46.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.784+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56601f2340 con 0x7f566015a4e0 2023-11-27T22:30:46.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.785+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5650013470 con 0x7f566015a4e0 2023-11-27T22:30:46.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.785+0000 7f565d7fa640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f564006b1c0 0x7f564006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:46.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.785+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5650089a20 con 0x7f566015a4e0 2023-11-27T22:30:46.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.785+0000 7f5664c8a640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f564006b1c0 0x7f564006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:46.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.786+0000 7f5664c8a640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f564006b1c0 0x7f564006d680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5648036000 tx=0x7f564803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:46.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.789+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5650054800 con 0x7f566015a4e0 2023-11-27T22:30:46.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.952+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56600b1a50 con 0x7f564006b1c0 2023-11-27T22:30:46.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.959+0000 7f565d7fa640 1 -- 172.21.15.154:0/558316887 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277714 (secure 0 0 0) 0x7f56600b1a50 con 0x7f564006b1c0 2023-11-27T22:30:46.965 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:46.967 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:30:46.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f564006b1c0 msgr2=0x7f564006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f564006b1c0 0x7f564006d680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5648036000 tx=0x7f564803c040 comp rx=0 tx=0).stop 2023-11-27T22:30:46.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 msgr2=0x7f56601e4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:46.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 0x7f56601e4300 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f565000e840 tx=0x7f565000ed00 comp rx=0 tx=0).stop 2023-11-27T22:30:46.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 shutdown_connections 2023-11-27T22:30:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f564006b1c0 0x7f564006d680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f566015e730 0x7f5660141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f566015a4e0 0x7f56601e4300 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 --2- 172.21.15.154:0/558316887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5660143490 0x7f56601f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 >> 172.21.15.154:0/558316887 conn(0x7f566006a4d0 msgr2=0x7f566015a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:46.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 shutdown_connections 2023-11-27T22:30:46.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:46.962+0000 7f5666eee640 1 -- 172.21.15.154:0/558316887 wait complete. 2023-11-27T22:30:46.974 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-27T22:30:44.974725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219964,"kb_used_data":3784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754756,"statfs":{"total":773094113280,"available":772868870144,"internally_reserved":0,"allocated":3874816,"data_stored":2201328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.296935"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680373+0000","last_change":"2023-11-27T22:30:40.680373+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680373+0000","last_undegraded":"2023-11-27T22:30:40.680373+0000","last_fullsized":"2023-11-27T22:30:40.680373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858830+0000","last_change":"2023-11-27T22:30:40.858830+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858830+0000","last_undegraded":"2023-11-27T22:30:40.858830+0000","last_fullsized":"2023-11-27T22:30:40.858830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682986+0000","last_change":"2023-11-27T22:30:40.682986+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682986+0000","last_undegraded":"2023-11-27T22:30:40.682986+0000","last_fullsized":"2023-11-27T22:30:40.682986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682753+0000","last_change":"2023-11-27T22:30:40.682753+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682753+0000","last_undegraded":"2023-11-27T22:30:40.682753+0000","last_fullsized":"2023-11-27T22:30:40.682753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681843+0000","last_change":"2023-11-27T22:30:40.681843+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681843+0000","last_undegraded":"2023-11-27T22:30:40.681843+0000","last_fullsized":"2023-11-27T22:30:40.681843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681086+0000","last_change":"2023-11-27T22:30:40.681086+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681086+0000","last_undegraded":"2023-11-27T22:30:40.681086+0000","last_fullsized":"2023-11-27T22:30:40.681086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683468+0000","last_change":"2023-11-27T22:30:40.683468+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683468+0000","last_undegraded":"2023-11-27T22:30:40.683468+0000","last_fullsized":"2023-11-27T22:30:40.683468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681615+0000","last_change":"2023-11-27T22:30:40.681615+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681615+0000","last_undegraded":"2023-11-27T22:30:40.681615+0000","last_fullsized":"2023-11-27T22:30:40.681615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683067+0000","last_change":"2023-11-27T22:30:40.683067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683067+0000","last_undegraded":"2023-11-27T22:30:40.683067+0000","last_fullsized":"2023-11-27T22:30:40.683067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858401+0000","last_change":"2023-11-27T22:30:40.858401+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858401+0000","last_undegraded":"2023-11-27T22:30:40.858401+0000","last_fullsized":"2023-11-27T22:30:40.858401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682940+0000","last_change":"2023-11-27T22:30:40.682940+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682940+0000","last_undegraded":"2023-11-27T22:30:40.682940+0000","last_fullsized":"2023-11-27T22:30:40.682940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682990+0000","last_change":"2023-11-27T22:30:40.682990+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682990+0000","last_undegraded":"2023-11-27T22:30:40.682990+0000","last_fullsized":"2023-11-27T22:30:40.682990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680402+0000","last_change":"2023-11-27T22:30:40.680402+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680402+0000","last_undegraded":"2023-11-27T22:30:40.680402+0000","last_fullsized":"2023-11-27T22:30:40.680402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680809+0000","last_change":"2023-11-27T22:30:40.680809+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680809+0000","last_undegraded":"2023-11-27T22:30:40.680809+0000","last_fullsized":"2023-11-27T22:30:40.680809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682923+0000","last_change":"2023-11-27T22:30:40.682923+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682923+0000","last_undegraded":"2023-11-27T22:30:40.682923+0000","last_fullsized":"2023-11-27T22:30:40.682923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680855+0000","last_change":"2023-11-27T22:30:40.680855+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680855+0000","last_undegraded":"2023-11-27T22:30:40.680855+0000","last_fullsized":"2023-11-27T22:30:40.680855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681052+0000","last_change":"2023-11-27T22:30:40.681052+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681052+0000","last_undegraded":"2023-11-27T22:30:40.681052+0000","last_fullsized":"2023-11-27T22:30:40.681052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681405+0000","last_change":"2023-11-27T22:30:40.681405+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681405+0000","last_undegraded":"2023-11-27T22:30:40.681405+0000","last_fullsized":"2023-11-27T22:30:40.681405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681283+0000","last_change":"2023-11-27T22:30:40.681283+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681283+0000","last_undegraded":"2023-11-27T22:30:40.681283+0000","last_fullsized":"2023-11-27T22:30:40.681283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.858480+0000","last_change":"2023-11-27T22:30:40.858480+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.858480+0000","last_undegraded":"2023-11-27T22:30:40.858480+0000","last_fullsized":"2023-11-27T22:30:40.858480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680352+0000","last_change":"2023-11-27T22:30:40.680352+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680352+0000","last_undegraded":"2023-11-27T22:30:40.680352+0000","last_fullsized":"2023-11-27T22:30:40.680352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682067+0000","last_change":"2023-11-27T22:30:40.682067+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682067+0000","last_undegraded":"2023-11-27T22:30:40.682067+0000","last_fullsized":"2023-11-27T22:30:40.682067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.682806+0000","last_change":"2023-11-27T22:30:40.682806+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.682806+0000","last_undegraded":"2023-11-27T22:30:40.682806+0000","last_fullsized":"2023-11-27T22:30:40.682806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680335+0000","last_change":"2023-11-27T22:30:40.680335+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680335+0000","last_undegraded":"2023-11-27T22:30:40.680335+0000","last_fullsized":"2023-11-27T22:30:40.680335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.857943+0000","last_change":"2023-11-27T22:30:40.857943+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.857943+0000","last_undegraded":"2023-11-27T22:30:40.857943+0000","last_fullsized":"2023-11-27T22:30:40.857943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680290+0000","last_change":"2023-11-27T22:30:40.680290+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680290+0000","last_undegraded":"2023-11-27T22:30:40.680290+0000","last_fullsized":"2023-11-27T22:30:40.680290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.680969+0000","last_change":"2023-11-27T22:30:40.680969+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.680969+0000","last_undegraded":"2023-11-27T22:30:40.680969+0000","last_fullsized":"2023-11-27T22:30:40.680969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.683353+0000","last_change":"2023-11-27T22:30:40.683353+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.683353+0000","last_undegraded":"2023-11-27T22:30:40.683353+0000","last_fullsized":"2023-11-27T22:30:40.683353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T22:30:41.677825+0000","last_change":"2023-11-27T22:30:41.677825+0000","last_active":"2023-11-27T22:30:41.677825+0000","last_peered":"2023-11-27T22:30:41.677825+0000","last_clean":"2023-11-27T22:30:41.677825+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:41.677825+0000","last_undegraded":"2023-11-27T22:30:41.677825+0000","last_fullsized":"2023-11-27T22:30:41.677825+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-27T22:30:40.681025+0000","last_change":"2023-11-27T22:30:40.681025+0000","last_active":"2023-11-27T22:30:40.675607+0000","last_peered":"2023-11-27T22:30:40.675607+0000","last_clean":"2023-11-27T22:30:40.675607+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T22:30:40.681025+0000","last_undegraded":"2023-11-27T22:30:40.681025+0000","last_fullsized":"2023-11-27T22:30:40.681025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T22:30:36.638841+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:30:36.638841+0000","last_peered":"2023-11-27T22:30:36.638841+0000","last_clean":"2023-11-27T22:30:36.638841+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:30:36.638841+0000","last_undegraded":"2023-11-27T22:30:36.638841+0000","last_fullsized":"2023-11-27T22:30:36.638841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59899999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.55500000000000005}]},{"osd":2,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.434},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52300000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.35899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.435}]},{"osd":1,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.76000000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.64800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51900000000000002}]},{"osd":7,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.626}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.67000000000000004}]},{"osd":1,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.63500000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65300000000000002}]},{"osd":3,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.73999999999999999}]},{"osd":4,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.375},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.41999999999999998}]},{"osd":7,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.498}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54000000000000004}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42899999999999999}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.40300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.371}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.501}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.56399999999999995}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.748},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.68400000000000005}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.375}]},{"osd":2,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.248},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.28100000000000003}]},{"osd":3,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.31}]},{"osd":4,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.432}]},{"osd":7,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.441}]},{"osd":3,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.38}]},{"osd":4,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.66600000000000004}]},{"osd":5,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.627}]},{"osd":7,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:30:49.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T22:30:50.096 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.094+0000 7f5ad73de640 1 Processor -- start 2023-11-27T22:30:50.097 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.094+0000 7f5ad73de640 1 -- start start 2023-11-27T22:30:50.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad73de640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5ad0144980 0x7f5ad015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad73de640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad0071770 con 0x7f5ad00b4370 2023-11-27T22:30:50.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad73de640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad00ccb60 con 0x7f5ad00ceb70 2023-11-27T22:30:50.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad73de640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad00ccdc0 con 0x7f5ad0144980 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad597b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f5ad00b4370 0x7f5ad0071c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35600/0 (socket says 172.21.15.154:35600) 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad597b640 1 -- 172.21.15.154:0/3704320736 learned_addr learned my addr 172.21.15.154:0/3704320736 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ad517a640 1 --2- 172.21.15.154:0/3704320736 >> v2:172.21.15.194:3300/0 conn(0x7f5ad0144980 0x7f5ad015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.095+0000 7f5ac7fff640 1 -- 172.21.15.154:0/3704320736 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078755349 0 0) 0x7f5ad0071770 con 0x7f5ad00b4370 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.096+0000 7f5ac7fff640 1 -- 172.21.15.154:0/3704320736 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc003520 con 0x7f5ad00b4370 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.096+0000 7f5ac7fff640 1 -- 172.21.15.154:0/3704320736 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263052911 0 0) 0x7f5abc003520 con 0x7f5ad00b4370 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.096+0000 7f5ad517a640 1 -- 172.21.15.154:0/3704320736 >> v1:172.21.15.194:6789/0 conn(0x7f5ad00ceb70 legacy=0x7f5ad00cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.096+0000 7f5ad517a640 1 -- 172.21.15.154:0/3704320736 >> v1:172.21.15.154:6789/0 conn(0x7f5ad00b4370 legacy=0x7f5ad0071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.096+0000 7f5ad517a640 1 -- 172.21.15.154:0/3704320736 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00cd0a0 con 0x7f5ad0144980 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad517a640 1 --2- 172.21.15.154:0/3704320736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad0144980 0x7f5ad015c7c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097a0 tx=0x7f5acc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13adc2d21aec1c8a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ac7fff640 1 -- 172.21.15.154:0/3704320736 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc02f050 con 0x7f5ad0144980 2023-11-27T22:30:50.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ac7fff640 1 -- 172.21.15.154:0/3704320736 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc031500 con 0x7f5ad0144980 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ac7fff640 1 -- 172.21.15.154:0/3704320736 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80019f0 con 0x7f5ad0144980 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad73de640 1 -- 172.21.15.154:0/3704320736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad0144980 msgr2=0x7f5ad015c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad73de640 1 --2- 172.21.15.154:0/3704320736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad0144980 0x7f5ad015c7c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097a0 tx=0x7f5acc02b820 comp rx=0 tx=0).stop 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad73de640 1 -- 172.21.15.154:0/3704320736 shutdown_connections 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad73de640 1 --2- 172.21.15.154:0/3704320736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad0144980 0x7f5ad015c7c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad73de640 1 -- 172.21.15.154:0/3704320736 >> 172.21.15.154:0/3704320736 conn(0x7f5ad006a4d0 msgr2=0x7f5ad006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.097+0000 7f5ad73de640 1 -- 172.21.15.154:0/3704320736 shutdown_connections 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.098+0000 7f5ad73de640 1 -- 172.21.15.154:0/3704320736 wait complete. 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 Processor -- start 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 -- start start 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 0x7f5ad00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad00ceb70 0x7f5ad00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad0144980 0x7f5ad0157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad0143e40 con 0x7f5ad00b4370 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00c47b0 con 0x7f5ad00ceb70 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad73de640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad00add80 con 0x7f5ad0144980 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad517a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 0x7f5ad00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.099+0000 7f5ad517a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 0x7f5ad00ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53498/0 (socket says 172.21.15.154:53498) 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 -- 172.21.15.154:0/2612631479 learned_addr learned my addr 172.21.15.154:0/2612631479 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad597b640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad0144980 0x7f5ad0157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad4979640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad00ceb70 0x7f5ad00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 -- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad0144980 msgr2=0x7f5ad0157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad0144980 0x7f5ad0157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 -- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad00ceb70 msgr2=0x7f5ad00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad00ceb70 0x7f5ad00ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 -- 172.21.15.154:0/2612631479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc009400 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad597b640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad0144980 0x7f5ad0157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad4979640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad00ceb70 0x7f5ad00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad517a640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 0x7f5ad00ca540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5acc036040 tx=0x7f5acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc03d940 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc03daa0 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad00c44d0 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc03de10 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.100+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad00aed70 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.101+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad0069400 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.102+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5acc03a040 con 0x7f5ad00b4370 2023-11-27T22:30:50.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.102+0000 7f5ac5ffb640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5ab406b1c0 0x7f5ab406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.102+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5acc0ab690 con 0x7f5ad00b4370 2023-11-27T22:30:50.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.102+0000 7f5ad4979640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5ab406b1c0 0x7f5ab406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.103+0000 7f5ad4979640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5ab406b1c0 0x7f5ab406d680 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00cad70 tx=0x7f5ac0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.107+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5acc076470 con 0x7f5ad00b4370 2023-11-27T22:30:50.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.271+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ad0144d60 con 0x7f5ab406b1c0 2023-11-27T22:30:50.280 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.278+0000 7f5ac5ffb640 1 -- 172.21.15.154:0/2612631479 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289882 (secure 0 0 0) 0x7f5ac00013e0 con 0x7f5ab406b1c0 2023-11-27T22:30:50.284 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:50.285 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5ab406b1c0 msgr2=0x7f5ab406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5ab406b1c0 0x7f5ab406d680 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00cad70 tx=0x7f5ac0009040 comp rx=0 tx=0).stop 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 msgr2=0x7f5ad00ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 0x7f5ad00ca540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5acc036040 tx=0x7f5acc0046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 shutdown_connections 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ad00ceb70 0x7f5ad00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5ab406b1c0 0x7f5ab406d680 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.287 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ad0144980 0x7f5ad0157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 --2- 172.21.15.154:0/2612631479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ad00b4370 0x7f5ad00ca540 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 >> 172.21.15.154:0/2612631479 conn(0x7f5ad006a4d0 msgr2=0x7f5ad00b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:50.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 shutdown_connections 2023-11-27T22:30:50.288 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.282+0000 7f5ad73de640 1 -- 172.21.15.154:0/2612631479 wait complete. 2023-11-27T22:30:50.294 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-11-27T22:30:48.975710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220424,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754296,"statfs":{"total":773094113280,"available":772868399104,"internally_reserved":0,"allocated":4333568,"data_stored":2407420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.292301"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147479+0000","last_change":"2023-11-27T22:30:42.698692+0000","last_active":"2023-11-27T22:30:44.147479+0000","last_peered":"2023-11-27T22:30:44.147479+0000","last_clean":"2023-11-27T22:30:44.147479+0000","last_became_active":"2023-11-27T22:30:42.698447+0000","last_became_peered":"2023-11-27T22:30:42.698447+0000","last_unstale":"2023-11-27T22:30:44.147479+0000","last_undegraded":"2023-11-27T22:30:44.147479+0000","last_fullsized":"2023-11-27T22:30:44.147479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:33.219884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696120+0000","last_change":"2023-11-27T22:30:42.698286+0000","last_active":"2023-11-27T22:30:43.696120+0000","last_peered":"2023-11-27T22:30:43.696120+0000","last_clean":"2023-11-27T22:30:43.696120+0000","last_became_active":"2023-11-27T22:30:42.698048+0000","last_became_peered":"2023-11-27T22:30:42.698048+0000","last_unstale":"2023-11-27T22:30:43.696120+0000","last_undegraded":"2023-11-27T22:30:43.696120+0000","last_fullsized":"2023-11-27T22:30:43.696120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:59.945497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147151+0000","last_change":"2023-11-27T22:30:42.701845+0000","last_active":"2023-11-27T22:30:44.147151+0000","last_peered":"2023-11-27T22:30:44.147151+0000","last_clean":"2023-11-27T22:30:44.147151+0000","last_became_active":"2023-11-27T22:30:42.701596+0000","last_became_peered":"2023-11-27T22:30:42.701596+0000","last_unstale":"2023-11-27T22:30:44.147151+0000","last_undegraded":"2023-11-27T22:30:44.147151+0000","last_fullsized":"2023-11-27T22:30:44.147151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:30:08.816900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695380+0000","last_change":"2023-11-27T22:30:42.703334+0000","last_active":"2023-11-27T22:30:43.695380+0000","last_peered":"2023-11-27T22:30:43.695380+0000","last_clean":"2023-11-27T22:30:43.695380+0000","last_became_active":"2023-11-27T22:30:42.703074+0000","last_became_peered":"2023-11-27T22:30:42.703074+0000","last_unstale":"2023-11-27T22:30:43.695380+0000","last_undegraded":"2023-11-27T22:30:43.695380+0000","last_fullsized":"2023-11-27T22:30:43.695380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:38:18.792145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073043+0000","last_change":"2023-11-27T22:30:42.696989+0000","last_active":"2023-11-27T22:30:44.073043+0000","last_peered":"2023-11-27T22:30:44.073043+0000","last_clean":"2023-11-27T22:30:44.073043+0000","last_became_active":"2023-11-27T22:30:42.696540+0000","last_became_peered":"2023-11-27T22:30:42.696540+0000","last_unstale":"2023-11-27T22:30:44.073043+0000","last_undegraded":"2023-11-27T22:30:44.073043+0000","last_fullsized":"2023-11-27T22:30:44.073043+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:53:37.298844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695646+0000","last_change":"2023-11-27T22:30:42.700182+0000","last_active":"2023-11-27T22:30:43.695646+0000","last_peered":"2023-11-27T22:30:43.695646+0000","last_clean":"2023-11-27T22:30:43.695646+0000","last_became_active":"2023-11-27T22:30:42.699944+0000","last_became_peered":"2023-11-27T22:30:42.699944+0000","last_unstale":"2023-11-27T22:30:43.695646+0000","last_undegraded":"2023-11-27T22:30:43.695646+0000","last_fullsized":"2023-11-27T22:30:43.695646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:40:17.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695642+0000","last_change":"2023-11-27T22:30:42.700308+0000","last_active":"2023-11-27T22:30:43.695642+0000","last_peered":"2023-11-27T22:30:43.695642+0000","last_clean":"2023-11-27T22:30:43.695642+0000","last_became_active":"2023-11-27T22:30:42.700039+0000","last_became_peered":"2023-11-27T22:30:42.700039+0000","last_unstale":"2023-11-27T22:30:43.695642+0000","last_undegraded":"2023-11-27T22:30:43.695642+0000","last_fullsized":"2023-11-27T22:30:43.695642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:21:02.329609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695418+0000","last_change":"2023-11-27T22:30:42.701365+0000","last_active":"2023-11-27T22:30:43.695418+0000","last_peered":"2023-11-27T22:30:43.695418+0000","last_clean":"2023-11-27T22:30:43.695418+0000","last_became_active":"2023-11-27T22:30:42.701114+0000","last_became_peered":"2023-11-27T22:30:42.701114+0000","last_unstale":"2023-11-27T22:30:43.695418+0000","last_undegraded":"2023-11-27T22:30:43.695418+0000","last_fullsized":"2023-11-27T22:30:43.695418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:07:13.195881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146695+0000","last_change":"2023-11-27T22:30:42.702571+0000","last_active":"2023-11-27T22:30:44.146695+0000","last_peered":"2023-11-27T22:30:44.146695+0000","last_clean":"2023-11-27T22:30:44.146695+0000","last_became_active":"2023-11-27T22:30:42.702270+0000","last_became_peered":"2023-11-27T22:30:42.702270+0000","last_unstale":"2023-11-27T22:30:44.146695+0000","last_undegraded":"2023-11-27T22:30:44.146695+0000","last_fullsized":"2023-11-27T22:30:44.146695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:26.079062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695188+0000","last_change":"2023-11-27T22:30:42.708711+0000","last_active":"2023-11-27T22:30:43.695188+0000","last_peered":"2023-11-27T22:30:43.695188+0000","last_clean":"2023-11-27T22:30:43.695188+0000","last_became_active":"2023-11-27T22:30:42.708316+0000","last_became_peered":"2023-11-27T22:30:42.708316+0000","last_unstale":"2023-11-27T22:30:43.695188+0000","last_undegraded":"2023-11-27T22:30:43.695188+0000","last_fullsized":"2023-11-27T22:30:43.695188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:34.381239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695854+0000","last_change":"2023-11-27T22:30:42.702054+0000","last_active":"2023-11-27T22:30:43.695854+0000","last_peered":"2023-11-27T22:30:43.695854+0000","last_clean":"2023-11-27T22:30:43.695854+0000","last_became_active":"2023-11-27T22:30:42.701777+0000","last_became_peered":"2023-11-27T22:30:42.701777+0000","last_unstale":"2023-11-27T22:30:43.695854+0000","last_undegraded":"2023-11-27T22:30:43.695854+0000","last_fullsized":"2023-11-27T22:30:43.695854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147136+0000","last_change":"2023-11-27T22:30:42.702709+0000","last_active":"2023-11-27T22:30:44.147136+0000","last_peered":"2023-11-27T22:30:44.147136+0000","last_clean":"2023-11-27T22:30:44.147136+0000","last_became_active":"2023-11-27T22:30:42.702470+0000","last_became_peered":"2023-11-27T22:30:42.702470+0000","last_unstale":"2023-11-27T22:30:44.147136+0000","last_undegraded":"2023-11-27T22:30:44.147136+0000","last_fullsized":"2023-11-27T22:30:44.147136+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:41.041234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073048+0000","last_change":"2023-11-27T22:30:42.700340+0000","last_active":"2023-11-27T22:30:44.073048+0000","last_peered":"2023-11-27T22:30:44.073048+0000","last_clean":"2023-11-27T22:30:44.073048+0000","last_became_active":"2023-11-27T22:30:42.700045+0000","last_became_peered":"2023-11-27T22:30:42.700045+0000","last_unstale":"2023-11-27T22:30:44.073048+0000","last_undegraded":"2023-11-27T22:30:44.073048+0000","last_fullsized":"2023-11-27T22:30:44.073048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:12:25.055958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695761+0000","last_change":"2023-11-27T22:30:42.696035+0000","last_active":"2023-11-27T22:30:43.695761+0000","last_peered":"2023-11-27T22:30:43.695761+0000","last_clean":"2023-11-27T22:30:43.695761+0000","last_became_active":"2023-11-27T22:30:42.695787+0000","last_became_peered":"2023-11-27T22:30:42.695787+0000","last_unstale":"2023-11-27T22:30:43.695761+0000","last_undegraded":"2023-11-27T22:30:43.695761+0000","last_fullsized":"2023-11-27T22:30:43.695761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:18:52.031736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146363+0000","last_change":"2023-11-27T22:30:42.697634+0000","last_active":"2023-11-27T22:30:44.146363+0000","last_peered":"2023-11-27T22:30:44.146363+0000","last_clean":"2023-11-27T22:30:44.146363+0000","last_became_active":"2023-11-27T22:30:42.697370+0000","last_became_peered":"2023-11-27T22:30:42.697370+0000","last_unstale":"2023-11-27T22:30:44.146363+0000","last_undegraded":"2023-11-27T22:30:44.146363+0000","last_fullsized":"2023-11-27T22:30:44.146363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:58:16.384816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695684+0000","last_change":"2023-11-27T22:30:42.707815+0000","last_active":"2023-11-27T22:30:43.695684+0000","last_peered":"2023-11-27T22:30:43.695684+0000","last_clean":"2023-11-27T22:30:43.695684+0000","last_became_active":"2023-11-27T22:30:42.707512+0000","last_became_peered":"2023-11-27T22:30:42.707512+0000","last_unstale":"2023-11-27T22:30:43.695684+0000","last_undegraded":"2023-11-27T22:30:43.695684+0000","last_fullsized":"2023-11-27T22:30:43.695684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:18:52.031736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695897+0000","last_change":"2023-11-27T22:30:42.698082+0000","last_active":"2023-11-27T22:30:43.695897+0000","last_peered":"2023-11-27T22:30:43.695897+0000","last_clean":"2023-11-27T22:30:43.695897+0000","last_became_active":"2023-11-27T22:30:42.697772+0000","last_became_peered":"2023-11-27T22:30:42.697772+0000","last_unstale":"2023-11-27T22:30:43.695897+0000","last_undegraded":"2023-11-27T22:30:43.695897+0000","last_fullsized":"2023-11-27T22:30:43.695897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:50:59.945497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696151+0000","last_change":"2023-11-27T22:30:42.705643+0000","last_active":"2023-11-27T22:30:43.696151+0000","last_peered":"2023-11-27T22:30:43.696151+0000","last_clean":"2023-11-27T22:30:43.696151+0000","last_became_active":"2023-11-27T22:30:42.705370+0000","last_became_peered":"2023-11-27T22:30:42.705370+0000","last_unstale":"2023-11-27T22:30:43.696151+0000","last_undegraded":"2023-11-27T22:30:43.696151+0000","last_fullsized":"2023-11-27T22:30:43.696151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:39:42.818198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696337+0000","last_change":"2023-11-27T22:30:42.706123+0000","last_active":"2023-11-27T22:30:43.696337+0000","last_peered":"2023-11-27T22:30:43.696337+0000","last_clean":"2023-11-27T22:30:43.696337+0000","last_became_active":"2023-11-27T22:30:42.705821+0000","last_became_peered":"2023-11-27T22:30:42.705821+0000","last_unstale":"2023-11-27T22:30:43.696337+0000","last_undegraded":"2023-11-27T22:30:43.696337+0000","last_fullsized":"2023-11-27T22:30:43.696337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:34:54.332367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073172+0000","last_change":"2023-11-27T22:30:42.701415+0000","last_active":"2023-11-27T22:30:44.073172+0000","last_peered":"2023-11-27T22:30:44.073172+0000","last_clean":"2023-11-27T22:30:44.073172+0000","last_became_active":"2023-11-27T22:30:42.701127+0000","last_became_peered":"2023-11-27T22:30:42.701127+0000","last_unstale":"2023-11-27T22:30:44.073172+0000","last_undegraded":"2023-11-27T22:30:44.073172+0000","last_fullsized":"2023-11-27T22:30:44.073172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:04:56.518414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146592+0000","last_change":"2023-11-27T22:30:42.709483+0000","last_active":"2023-11-27T22:30:44.146592+0000","last_peered":"2023-11-27T22:30:44.146592+0000","last_clean":"2023-11-27T22:30:44.146592+0000","last_became_active":"2023-11-27T22:30:42.709055+0000","last_became_peered":"2023-11-27T22:30:42.709055+0000","last_unstale":"2023-11-27T22:30:44.146592+0000","last_undegraded":"2023-11-27T22:30:44.146592+0000","last_fullsized":"2023-11-27T22:30:44.146592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:33:46.806102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147102+0000","last_change":"2023-11-27T22:30:42.700502+0000","last_active":"2023-11-27T22:30:44.147102+0000","last_peered":"2023-11-27T22:30:44.147102+0000","last_clean":"2023-11-27T22:30:44.147102+0000","last_became_active":"2023-11-27T22:30:42.700227+0000","last_became_peered":"2023-11-27T22:30:42.700227+0000","last_unstale":"2023-11-27T22:30:44.147102+0000","last_undegraded":"2023-11-27T22:30:44.147102+0000","last_fullsized":"2023-11-27T22:30:44.147102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:38:03.339803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.145825+0000","last_change":"2023-11-27T22:30:42.701633+0000","last_active":"2023-11-27T22:30:44.145825+0000","last_peered":"2023-11-27T22:30:44.145825+0000","last_clean":"2023-11-27T22:30:44.145825+0000","last_became_active":"2023-11-27T22:30:42.701368+0000","last_became_peered":"2023-11-27T22:30:42.701368+0000","last_unstale":"2023-11-27T22:30:44.145825+0000","last_undegraded":"2023-11-27T22:30:44.145825+0000","last_fullsized":"2023-11-27T22:30:44.145825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:33.219884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146157+0000","last_change":"2023-11-27T22:30:42.697264+0000","last_active":"2023-11-27T22:30:44.146157+0000","last_peered":"2023-11-27T22:30:44.146157+0000","last_clean":"2023-11-27T22:30:44.146157+0000","last_became_active":"2023-11-27T22:30:42.696994+0000","last_became_peered":"2023-11-27T22:30:42.696994+0000","last_unstale":"2023-11-27T22:30:44.146157+0000","last_undegraded":"2023-11-27T22:30:44.146157+0000","last_fullsized":"2023-11-27T22:30:44.146157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:38:18.792145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695597+0000","last_change":"2023-11-27T22:30:42.703597+0000","last_active":"2023-11-27T22:30:43.695597+0000","last_peered":"2023-11-27T22:30:43.695597+0000","last_clean":"2023-11-27T22:30:43.695597+0000","last_became_active":"2023-11-27T22:30:42.703322+0000","last_became_peered":"2023-11-27T22:30:42.703322+0000","last_unstale":"2023-11-27T22:30:43.695597+0000","last_undegraded":"2023-11-27T22:30:43.695597+0000","last_fullsized":"2023-11-27T22:30:43.695597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:35:47.983811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696232+0000","last_change":"2023-11-27T22:30:42.700890+0000","last_active":"2023-11-27T22:30:43.696232+0000","last_peered":"2023-11-27T22:30:43.696232+0000","last_clean":"2023-11-27T22:30:43.696232+0000","last_became_active":"2023-11-27T22:30:42.700312+0000","last_became_peered":"2023-11-27T22:30:42.700312+0000","last_unstale":"2023-11-27T22:30:43.696232+0000","last_undegraded":"2023-11-27T22:30:43.696232+0000","last_fullsized":"2023-11-27T22:30:43.696232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:05:39.535008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696082+0000","last_change":"2023-11-27T22:30:42.710052+0000","last_active":"2023-11-27T22:30:43.696082+0000","last_peered":"2023-11-27T22:30:43.696082+0000","last_clean":"2023-11-27T22:30:43.696082+0000","last_became_active":"2023-11-27T22:30:42.709638+0000","last_became_peered":"2023-11-27T22:30:42.709638+0000","last_unstale":"2023-11-27T22:30:43.696082+0000","last_undegraded":"2023-11-27T22:30:43.696082+0000","last_fullsized":"2023-11-27T22:30:43.696082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:07:13.195881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147275+0000","last_change":"2023-11-27T22:30:42.698191+0000","last_active":"2023-11-27T22:30:44.147275+0000","last_peered":"2023-11-27T22:30:44.147275+0000","last_clean":"2023-11-27T22:30:44.147275+0000","last_became_active":"2023-11-27T22:30:42.697755+0000","last_became_peered":"2023-11-27T22:30:42.697755+0000","last_unstale":"2023-11-27T22:30:44.147275+0000","last_undegraded":"2023-11-27T22:30:44.147275+0000","last_fullsized":"2023-11-27T22:30:44.147275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:21:02.329609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147083+0000","last_change":"2023-11-27T22:30:42.709325+0000","last_active":"2023-11-27T22:30:44.147083+0000","last_peered":"2023-11-27T22:30:44.147083+0000","last_clean":"2023-11-27T22:30:44.147083+0000","last_became_active":"2023-11-27T22:30:42.708200+0000","last_became_peered":"2023-11-27T22:30:42.708200+0000","last_unstale":"2023-11-27T22:30:44.147083+0000","last_undegraded":"2023-11-27T22:30:44.147083+0000","last_fullsized":"2023-11-27T22:30:44.147083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:02.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695531+0000","last_change":"2023-11-27T22:30:42.698675+0000","last_active":"2023-11-27T22:30:43.695531+0000","last_peered":"2023-11-27T22:30:43.695531+0000","last_clean":"2023-11-27T22:30:43.695531+0000","last_became_active":"2023-11-27T22:30:42.698331+0000","last_became_peered":"2023-11-27T22:30:42.698331+0000","last_unstale":"2023-11-27T22:30:43.695531+0000","last_undegraded":"2023-11-27T22:30:43.695531+0000","last_fullsized":"2023-11-27T22:30:43.695531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:41.041234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147168+0000","last_change":"2023-11-27T22:30:42.696078+0000","last_active":"2023-11-27T22:30:44.147168+0000","last_peered":"2023-11-27T22:30:44.147168+0000","last_clean":"2023-11-27T22:30:44.147168+0000","last_became_active":"2023-11-27T22:30:42.695807+0000","last_became_peered":"2023-11-27T22:30:42.695807+0000","last_unstale":"2023-11-27T22:30:44.147168+0000","last_undegraded":"2023-11-27T22:30:44.147168+0000","last_fullsized":"2023-11-27T22:30:44.147168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:47:37.676755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695403+0000","last_change":"2023-11-27T22:30:42.703157+0000","last_active":"2023-11-27T22:30:43.695403+0000","last_peered":"2023-11-27T22:30:43.695403+0000","last_clean":"2023-11-27T22:30:43.695403+0000","last_became_active":"2023-11-27T22:30:42.702897+0000","last_became_peered":"2023-11-27T22:30:42.702897+0000","last_unstale":"2023-11-27T22:30:43.695403+0000","last_undegraded":"2023-11-27T22:30:43.695403+0000","last_fullsized":"2023-11-27T22:30:43.695403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:35:47.983811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.145914+0000","last_change":"2023-11-27T22:30:42.702249+0000","last_active":"2023-11-27T22:30:44.145914+0000","last_peered":"2023-11-27T22:30:44.145914+0000","last_clean":"2023-11-27T22:30:44.145914+0000","last_became_active":"2023-11-27T22:30:42.701980+0000","last_became_peered":"2023-11-27T22:30:42.701980+0000","last_unstale":"2023-11-27T22:30:44.145914+0000","last_undegraded":"2023-11-27T22:30:44.145914+0000","last_fullsized":"2023-11-27T22:30:44.145914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:42:58.725908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.708840+0000","last_change":"2023-11-27T22:30:41.696626+0000","last_active":"2023-11-27T22:30:42.708840+0000","last_peered":"2023-11-27T22:30:42.708840+0000","last_clean":"2023-11-27T22:30:42.708840+0000","last_became_active":"2023-11-27T22:30:41.696356+0000","last_became_peered":"2023-11-27T22:30:41.696356+0000","last_unstale":"2023-11-27T22:30:42.708840+0000","last_undegraded":"2023-11-27T22:30:42.708840+0000","last_fullsized":"2023-11-27T22:30:42.708840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:45:11.483962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147488+0000","last_change":"2023-11-27T22:30:42.699879+0000","last_active":"2023-11-27T22:30:44.147488+0000","last_peered":"2023-11-27T22:30:44.147488+0000","last_clean":"2023-11-27T22:30:44.147488+0000","last_became_active":"2023-11-27T22:30:42.699650+0000","last_became_peered":"2023-11-27T22:30:42.699650+0000","last_unstale":"2023-11-27T22:30:44.147488+0000","last_undegraded":"2023-11-27T22:30:44.147488+0000","last_fullsized":"2023-11-27T22:30:44.147488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:26.079062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.712860+0000","last_change":"2023-11-27T22:30:41.698811+0000","last_active":"2023-11-27T22:30:42.712860+0000","last_peered":"2023-11-27T22:30:42.712860+0000","last_clean":"2023-11-27T22:30:42.712860+0000","last_became_active":"2023-11-27T22:30:41.698539+0000","last_became_peered":"2023-11-27T22:30:41.698539+0000","last_unstale":"2023-11-27T22:30:42.712860+0000","last_undegraded":"2023-11-27T22:30:42.712860+0000","last_fullsized":"2023-11-27T22:30:42.712860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:43:14.916249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146860+0000","last_change":"2023-11-27T22:30:42.707380+0000","last_active":"2023-11-27T22:30:44.146860+0000","last_peered":"2023-11-27T22:30:44.146860+0000","last_clean":"2023-11-27T22:30:44.146860+0000","last_became_active":"2023-11-27T22:30:42.707138+0000","last_became_peered":"2023-11-27T22:30:42.707138+0000","last_unstale":"2023-11-27T22:30:44.146860+0000","last_undegraded":"2023-11-27T22:30:44.146860+0000","last_fullsized":"2023-11-27T22:30:44.146860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:42:58.725908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.721082+0000","last_change":"2023-11-27T22:30:41.702691+0000","last_active":"2023-11-27T22:30:42.721082+0000","last_peered":"2023-11-27T22:30:42.721082+0000","last_clean":"2023-11-27T22:30:42.721082+0000","last_became_active":"2023-11-27T22:30:41.702416+0000","last_became_peered":"2023-11-27T22:30:41.702416+0000","last_unstale":"2023-11-27T22:30:42.721082+0000","last_undegraded":"2023-11-27T22:30:42.721082+0000","last_fullsized":"2023-11-27T22:30:42.721082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:35:46.981594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696085+0000","last_change":"2023-11-27T22:30:42.709884+0000","last_active":"2023-11-27T22:30:43.696085+0000","last_peered":"2023-11-27T22:30:43.696085+0000","last_clean":"2023-11-27T22:30:43.696085+0000","last_became_active":"2023-11-27T22:30:42.709190+0000","last_became_peered":"2023-11-27T22:30:42.709190+0000","last_unstale":"2023-11-27T22:30:43.696085+0000","last_undegraded":"2023-11-27T22:30:43.696085+0000","last_fullsized":"2023-11-27T22:30:43.696085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:18.951476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.713701+0000","last_change":"2023-11-27T22:30:41.702960+0000","last_active":"2023-11-27T22:30:42.713701+0000","last_peered":"2023-11-27T22:30:42.713701+0000","last_clean":"2023-11-27T22:30:42.713701+0000","last_became_active":"2023-11-27T22:30:41.702688+0000","last_became_peered":"2023-11-27T22:30:41.702688+0000","last_unstale":"2023-11-27T22:30:42.713701+0000","last_undegraded":"2023-11-27T22:30:42.713701+0000","last_fullsized":"2023-11-27T22:30:42.713701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:59:35.079364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695533+0000","last_change":"2023-11-27T22:30:42.705259+0000","last_active":"2023-11-27T22:30:43.695533+0000","last_peered":"2023-11-27T22:30:43.695533+0000","last_clean":"2023-11-27T22:30:43.695533+0000","last_became_active":"2023-11-27T22:30:42.704918+0000","last_became_peered":"2023-11-27T22:30:42.704918+0000","last_unstale":"2023-11-27T22:30:43.695533+0000","last_undegraded":"2023-11-27T22:30:43.695533+0000","last_fullsized":"2023-11-27T22:30:43.695533+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:30:08.816900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.721752+0000","last_change":"2023-11-27T22:30:41.701069+0000","last_active":"2023-11-27T22:30:42.721752+0000","last_peered":"2023-11-27T22:30:42.721752+0000","last_clean":"2023-11-27T22:30:42.721752+0000","last_became_active":"2023-11-27T22:30:41.700786+0000","last_became_peered":"2023-11-27T22:30:41.700786+0000","last_unstale":"2023-11-27T22:30:42.721752+0000","last_undegraded":"2023-11-27T22:30:42.721752+0000","last_fullsized":"2023-11-27T22:30:42.721752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:51:40.463432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146679+0000","last_change":"2023-11-27T22:30:42.701623+0000","last_active":"2023-11-27T22:30:44.146679+0000","last_peered":"2023-11-27T22:30:44.146679+0000","last_clean":"2023-11-27T22:30:44.146679+0000","last_became_active":"2023-11-27T22:30:42.701356+0000","last_became_peered":"2023-11-27T22:30:42.701356+0000","last_unstale":"2023-11-27T22:30:44.146679+0000","last_undegraded":"2023-11-27T22:30:44.146679+0000","last_fullsized":"2023-11-27T22:30:44.146679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:35:47.983811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.721807+0000","last_change":"2023-11-27T22:30:41.700960+0000","last_active":"2023-11-27T22:30:42.721807+0000","last_peered":"2023-11-27T22:30:42.721807+0000","last_clean":"2023-11-27T22:30:42.721807+0000","last_became_active":"2023-11-27T22:30:41.700677+0000","last_became_peered":"2023-11-27T22:30:41.700677+0000","last_unstale":"2023-11-27T22:30:42.721807+0000","last_undegraded":"2023-11-27T22:30:42.721807+0000","last_fullsized":"2023-11-27T22:30:42.721807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:11:43.242287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146615+0000","last_change":"2023-11-27T22:30:42.701389+0000","last_active":"2023-11-27T22:30:44.146615+0000","last_peered":"2023-11-27T22:30:44.146615+0000","last_clean":"2023-11-27T22:30:44.146615+0000","last_became_active":"2023-11-27T22:30:42.701006+0000","last_became_peered":"2023-11-27T22:30:42.701006+0000","last_unstale":"2023-11-27T22:30:44.146615+0000","last_undegraded":"2023-11-27T22:30:44.146615+0000","last_fullsized":"2023-11-27T22:30:44.146615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:06:33.219884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.684349+0000","last_change":"2023-11-27T22:30:41.698215+0000","last_active":"2023-11-27T22:30:42.684349+0000","last_peered":"2023-11-27T22:30:42.684349+0000","last_clean":"2023-11-27T22:30:42.684349+0000","last_became_active":"2023-11-27T22:30:41.697947+0000","last_became_peered":"2023-11-27T22:30:41.697947+0000","last_unstale":"2023-11-27T22:30:42.684349+0000","last_undegraded":"2023-11-27T22:30:42.684349+0000","last_fullsized":"2023-11-27T22:30:42.684349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:47:36.674538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695189+0000","last_change":"2023-11-27T22:30:42.709502+0000","last_active":"2023-11-27T22:30:43.695189+0000","last_peered":"2023-11-27T22:30:43.695189+0000","last_clean":"2023-11-27T22:30:43.695189+0000","last_became_active":"2023-11-27T22:30:42.709242+0000","last_became_peered":"2023-11-27T22:30:42.709242+0000","last_unstale":"2023-11-27T22:30:43.695189+0000","last_undegraded":"2023-11-27T22:30:43.695189+0000","last_fullsized":"2023-11-27T22:30:43.695189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:54.820758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.694892+0000","last_change":"2023-11-27T22:30:41.698176+0000","last_active":"2023-11-27T22:30:42.694892+0000","last_peered":"2023-11-27T22:30:42.694892+0000","last_clean":"2023-11-27T22:30:42.694892+0000","last_became_active":"2023-11-27T22:30:41.697325+0000","last_became_peered":"2023-11-27T22:30:41.697325+0000","last_unstale":"2023-11-27T22:30:42.694892+0000","last_undegraded":"2023-11-27T22:30:42.694892+0000","last_fullsized":"2023-11-27T22:30:42.694892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:45:11.483962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147052+0000","last_change":"2023-11-27T22:30:42.696782+0000","last_active":"2023-11-27T22:30:44.147052+0000","last_peered":"2023-11-27T22:30:44.147052+0000","last_clean":"2023-11-27T22:30:44.147052+0000","last_became_active":"2023-11-27T22:30:42.696509+0000","last_became_peered":"2023-11-27T22:30:42.696509+0000","last_unstale":"2023-11-27T22:30:44.147052+0000","last_undegraded":"2023-11-27T22:30:44.147052+0000","last_fullsized":"2023-11-27T22:30:44.147052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:18.951476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.685326+0000","last_change":"2023-11-27T22:30:41.700844+0000","last_active":"2023-11-27T22:30:42.685326+0000","last_peered":"2023-11-27T22:30:42.685326+0000","last_clean":"2023-11-27T22:30:42.685326+0000","last_became_active":"2023-11-27T22:30:41.700590+0000","last_became_peered":"2023-11-27T22:30:41.700590+0000","last_unstale":"2023-11-27T22:30:42.685326+0000","last_undegraded":"2023-11-27T22:30:42.685326+0000","last_fullsized":"2023-11-27T22:30:42.685326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:07:12.193663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.696178+0000","last_change":"2023-11-27T22:30:42.706126+0000","last_active":"2023-11-27T22:30:43.696178+0000","last_peered":"2023-11-27T22:30:43.696178+0000","last_clean":"2023-11-27T22:30:43.696178+0000","last_became_active":"2023-11-27T22:30:42.705840+0000","last_became_peered":"2023-11-27T22:30:42.705840+0000","last_unstale":"2023-11-27T22:30:43.696178+0000","last_undegraded":"2023-11-27T22:30:43.696178+0000","last_fullsized":"2023-11-27T22:30:43.696178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:03:32.895817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.693976+0000","last_change":"2023-11-27T22:30:41.701471+0000","last_active":"2023-11-27T22:30:42.693976+0000","last_peered":"2023-11-27T22:30:42.693976+0000","last_clean":"2023-11-27T22:30:42.693976+0000","last_became_active":"2023-11-27T22:30:41.701207+0000","last_became_peered":"2023-11-27T22:30:41.701207+0000","last_unstale":"2023-11-27T22:30:42.693976+0000","last_undegraded":"2023-11-27T22:30:42.693976+0000","last_fullsized":"2023-11-27T22:30:42.693976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:45:11.483962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695975+0000","last_change":"2023-11-27T22:30:42.694408+0000","last_active":"2023-11-27T22:30:43.695975+0000","last_peered":"2023-11-27T22:30:43.695975+0000","last_clean":"2023-11-27T22:30:43.695975+0000","last_became_active":"2023-11-27T22:30:42.694126+0000","last_became_peered":"2023-11-27T22:30:42.694126+0000","last_unstale":"2023-11-27T22:30:43.695975+0000","last_undegraded":"2023-11-27T22:30:43.695975+0000","last_fullsized":"2023-11-27T22:30:43.695975+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:31.945592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.711722+0000","last_change":"2023-11-27T22:30:41.704187+0000","last_active":"2023-11-27T22:30:42.711722+0000","last_peered":"2023-11-27T22:30:42.711722+0000","last_clean":"2023-11-27T22:30:42.711722+0000","last_became_active":"2023-11-27T22:30:41.703368+0000","last_became_peered":"2023-11-27T22:30:41.703368+0000","last_unstale":"2023-11-27T22:30:42.711722+0000","last_undegraded":"2023-11-27T22:30:42.711722+0000","last_fullsized":"2023-11-27T22:30:42.711722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:58:53.031390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147034+0000","last_change":"2023-11-27T22:30:42.704078+0000","last_active":"2023-11-27T22:30:44.147034+0000","last_peered":"2023-11-27T22:30:44.147034+0000","last_clean":"2023-11-27T22:30:44.147034+0000","last_became_active":"2023-11-27T22:30:42.703784+0000","last_became_peered":"2023-11-27T22:30:42.703784+0000","last_unstale":"2023-11-27T22:30:44.147034+0000","last_undegraded":"2023-11-27T22:30:44.147034+0000","last_fullsized":"2023-11-27T22:30:44.147034+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:07:13.195881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.724016+0000","last_change":"2023-11-27T22:30:41.702817+0000","last_active":"2023-11-27T22:30:42.724016+0000","last_peered":"2023-11-27T22:30:42.724016+0000","last_clean":"2023-11-27T22:30:42.724016+0000","last_became_active":"2023-11-27T22:30:41.702023+0000","last_became_peered":"2023-11-27T22:30:41.702023+0000","last_unstale":"2023-11-27T22:30:42.724016+0000","last_undegraded":"2023-11-27T22:30:42.724016+0000","last_fullsized":"2023-11-27T22:30:42.724016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:17:40.039016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695191+0000","last_change":"2023-11-27T22:30:42.710178+0000","last_active":"2023-11-27T22:30:43.695191+0000","last_peered":"2023-11-27T22:30:43.695191+0000","last_clean":"2023-11-27T22:30:43.695191+0000","last_became_active":"2023-11-27T22:30:42.709940+0000","last_became_peered":"2023-11-27T22:30:42.709940+0000","last_unstale":"2023-11-27T22:30:43.695191+0000","last_undegraded":"2023-11-27T22:30:43.695191+0000","last_fullsized":"2023-11-27T22:30:43.695191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:58:54.033608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.711922+0000","last_change":"2023-11-27T22:30:41.697095+0000","last_active":"2023-11-27T22:30:42.711922+0000","last_peered":"2023-11-27T22:30:42.711922+0000","last_clean":"2023-11-27T22:30:42.711922+0000","last_became_active":"2023-11-27T22:30:41.696831+0000","last_became_peered":"2023-11-27T22:30:41.696831+0000","last_unstale":"2023-11-27T22:30:42.711922+0000","last_undegraded":"2023-11-27T22:30:42.711922+0000","last_fullsized":"2023-11-27T22:30:42.711922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:04:55.516196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695774+0000","last_change":"2023-11-27T22:30:42.702845+0000","last_active":"2023-11-27T22:30:43.695774+0000","last_peered":"2023-11-27T22:30:43.695774+0000","last_clean":"2023-11-27T22:30:43.695774+0000","last_became_active":"2023-11-27T22:30:42.702596+0000","last_became_peered":"2023-11-27T22:30:42.702596+0000","last_unstale":"2023-11-27T22:30:43.695774+0000","last_undegraded":"2023-11-27T22:30:43.695774+0000","last_fullsized":"2023-11-27T22:30:43.695774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:42:02.117414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.693245+0000","last_change":"2023-11-27T22:30:41.699378+0000","last_active":"2023-11-27T22:30:42.693245+0000","last_peered":"2023-11-27T22:30:42.693245+0000","last_clean":"2023-11-27T22:30:42.693245+0000","last_became_active":"2023-11-27T22:30:41.699080+0000","last_became_peered":"2023-11-27T22:30:41.699080+0000","last_unstale":"2023-11-27T22:30:42.693245+0000","last_undegraded":"2023-11-27T22:30:42.693245+0000","last_fullsized":"2023-11-27T22:30:42.693245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:45:11.483962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695679+0000","last_change":"2023-11-27T22:30:42.703675+0000","last_active":"2023-11-27T22:30:43.695679+0000","last_peered":"2023-11-27T22:30:43.695679+0000","last_clean":"2023-11-27T22:30:43.695679+0000","last_became_active":"2023-11-27T22:30:42.703403+0000","last_became_peered":"2023-11-27T22:30:42.703403+0000","last_unstale":"2023-11-27T22:30:43.695679+0000","last_undegraded":"2023-11-27T22:30:43.695679+0000","last_fullsized":"2023-11-27T22:30:43.695679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:42:02.117414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.684586+0000","last_change":"2023-11-27T22:30:41.700308+0000","last_active":"2023-11-27T22:30:42.684586+0000","last_peered":"2023-11-27T22:30:42.684586+0000","last_clean":"2023-11-27T22:30:42.684586+0000","last_became_active":"2023-11-27T22:30:41.700053+0000","last_became_peered":"2023-11-27T22:30:41.700053+0000","last_unstale":"2023-11-27T22:30:42.684586+0000","last_undegraded":"2023-11-27T22:30:42.684586+0000","last_fullsized":"2023-11-27T22:30:42.684586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:01.961906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147310+0000","last_change":"2023-11-27T22:30:42.698085+0000","last_active":"2023-11-27T22:30:44.147310+0000","last_peered":"2023-11-27T22:30:44.147310+0000","last_clean":"2023-11-27T22:30:44.147310+0000","last_became_active":"2023-11-27T22:30:42.697716+0000","last_became_peered":"2023-11-27T22:30:42.697716+0000","last_unstale":"2023-11-27T22:30:44.147310+0000","last_undegraded":"2023-11-27T22:30:44.147310+0000","last_fullsized":"2023-11-27T22:30:44.147310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:33:46.806102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.721087+0000","last_change":"2023-11-27T22:30:41.702198+0000","last_active":"2023-11-27T22:30:42.721087+0000","last_peered":"2023-11-27T22:30:42.721087+0000","last_clean":"2023-11-27T22:30:42.721087+0000","last_became_active":"2023-11-27T22:30:41.701935+0000","last_became_peered":"2023-11-27T22:30:41.701935+0000","last_unstale":"2023-11-27T22:30:42.721087+0000","last_undegraded":"2023-11-27T22:30:42.721087+0000","last_fullsized":"2023-11-27T22:30:42.721087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:45:53.818541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147366+0000","last_change":"2023-11-27T22:30:42.709913+0000","last_active":"2023-11-27T22:30:44.147366+0000","last_peered":"2023-11-27T22:30:44.147366+0000","last_clean":"2023-11-27T22:30:44.147366+0000","last_became_active":"2023-11-27T22:30:42.709631+0000","last_became_peered":"2023-11-27T22:30:42.709631+0000","last_unstale":"2023-11-27T22:30:44.147366+0000","last_undegraded":"2023-11-27T22:30:44.147366+0000","last_fullsized":"2023-11-27T22:30:44.147366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:06:54.350048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.721334+0000","last_change":"2023-11-27T22:30:41.702381+0000","last_active":"2023-11-27T22:30:42.721334+0000","last_peered":"2023-11-27T22:30:42.721334+0000","last_clean":"2023-11-27T22:30:42.721334+0000","last_became_active":"2023-11-27T22:30:41.702036+0000","last_became_peered":"2023-11-27T22:30:41.702036+0000","last_unstale":"2023-11-27T22:30:42.721334+0000","last_undegraded":"2023-11-27T22:30:42.721334+0000","last_fullsized":"2023-11-27T22:30:42.721334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:25.076845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147550+0000","last_change":"2023-11-27T22:30:42.702882+0000","last_active":"2023-11-27T22:30:44.147550+0000","last_peered":"2023-11-27T22:30:44.147550+0000","last_clean":"2023-11-27T22:30:44.147550+0000","last_became_active":"2023-11-27T22:30:42.702098+0000","last_became_peered":"2023-11-27T22:30:42.702098+0000","last_unstale":"2023-11-27T22:30:44.147550+0000","last_undegraded":"2023-11-27T22:30:44.147550+0000","last_fullsized":"2023-11-27T22:30:44.147550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:40:17.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.711158+0000","last_change":"2023-11-27T22:30:41.698747+0000","last_active":"2023-11-27T22:30:42.711158+0000","last_peered":"2023-11-27T22:30:42.711158+0000","last_clean":"2023-11-27T22:30:42.711158+0000","last_became_active":"2023-11-27T22:30:41.697755+0000","last_became_peered":"2023-11-27T22:30:41.697755+0000","last_unstale":"2023-11-27T22:30:42.711158+0000","last_undegraded":"2023-11-27T22:30:42.711158+0000","last_fullsized":"2023-11-27T22:30:42.711158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:19:41.625852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695490+0000","last_change":"2023-11-27T22:30:42.702837+0000","last_active":"2023-11-27T22:30:43.695490+0000","last_peered":"2023-11-27T22:30:43.695490+0000","last_clean":"2023-11-27T22:30:43.695490+0000","last_became_active":"2023-11-27T22:30:42.702586+0000","last_became_peered":"2023-11-27T22:30:42.702586+0000","last_unstale":"2023-11-27T22:30:43.695490+0000","last_undegraded":"2023-11-27T22:30:43.695490+0000","last_fullsized":"2023-11-27T22:30:43.695490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:58:16.384816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.711645+0000","last_change":"2023-11-27T22:30:41.701727+0000","last_active":"2023-11-27T22:30:42.711645+0000","last_peered":"2023-11-27T22:30:42.711645+0000","last_clean":"2023-11-27T22:30:42.711645+0000","last_became_active":"2023-11-27T22:30:41.701281+0000","last_became_peered":"2023-11-27T22:30:41.701281+0000","last_unstale":"2023-11-27T22:30:42.711645+0000","last_undegraded":"2023-11-27T22:30:42.711645+0000","last_fullsized":"2023-11-27T22:30:42.711645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:52.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073186+0000","last_change":"2023-11-27T22:30:42.695710+0000","last_active":"2023-11-27T22:30:44.073186+0000","last_peered":"2023-11-27T22:30:44.073186+0000","last_clean":"2023-11-27T22:30:44.073186+0000","last_became_active":"2023-11-27T22:30:42.695444+0000","last_became_peered":"2023-11-27T22:30:42.695444+0000","last_unstale":"2023-11-27T22:30:44.073186+0000","last_undegraded":"2023-11-27T22:30:44.073186+0000","last_fullsized":"2023-11-27T22:30:44.073186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:28:22.378609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.691326+0000","last_change":"2023-11-27T22:30:41.699235+0000","last_active":"2023-11-27T22:30:42.691326+0000","last_peered":"2023-11-27T22:30:42.691326+0000","last_clean":"2023-11-27T22:30:42.691326+0000","last_became_active":"2023-11-27T22:30:41.698993+0000","last_became_peered":"2023-11-27T22:30:41.698993+0000","last_unstale":"2023-11-27T22:30:42.691326+0000","last_undegraded":"2023-11-27T22:30:42.691326+0000","last_fullsized":"2023-11-27T22:30:42.691326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:12:24.053740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073045+0000","last_change":"2023-11-27T22:30:42.700082+0000","last_active":"2023-11-27T22:30:44.073045+0000","last_peered":"2023-11-27T22:30:44.073045+0000","last_clean":"2023-11-27T22:30:44.073045+0000","last_became_active":"2023-11-27T22:30:42.699161+0000","last_became_peered":"2023-11-27T22:30:42.699161+0000","last_unstale":"2023-11-27T22:30:44.073045+0000","last_undegraded":"2023-11-27T22:30:44.073045+0000","last_fullsized":"2023-11-27T22:30:44.073045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:53:17.741614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.714021+0000","last_change":"2023-11-27T22:30:41.704084+0000","last_active":"2023-11-27T22:30:42.714021+0000","last_peered":"2023-11-27T22:30:42.714021+0000","last_clean":"2023-11-27T22:30:42.714021+0000","last_became_active":"2023-11-27T22:30:41.703821+0000","last_became_peered":"2023-11-27T22:30:41.703821+0000","last_unstale":"2023-11-27T22:30:42.714021+0000","last_undegraded":"2023-11-27T22:30:42.714021+0000","last_fullsized":"2023-11-27T22:30:42.714021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:47:36.674538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073174+0000","last_change":"2023-11-27T22:30:42.698710+0000","last_active":"2023-11-27T22:30:44.073174+0000","last_peered":"2023-11-27T22:30:44.073174+0000","last_clean":"2023-11-27T22:30:44.073174+0000","last_became_active":"2023-11-27T22:30:42.698428+0000","last_became_peered":"2023-11-27T22:30:42.698428+0000","last_unstale":"2023-11-27T22:30:44.073174+0000","last_undegraded":"2023-11-27T22:30:44.073174+0000","last_fullsized":"2023-11-27T22:30:44.073174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:51:41.465650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.684037+0000","last_change":"2023-11-27T22:30:41.704334+0000","last_active":"2023-11-27T22:30:42.684037+0000","last_peered":"2023-11-27T22:30:42.684037+0000","last_clean":"2023-11-27T22:30:42.684037+0000","last_became_active":"2023-11-27T22:30:41.704006+0000","last_became_peered":"2023-11-27T22:30:41.704006+0000","last_unstale":"2023-11-27T22:30:42.684037+0000","last_undegraded":"2023-11-27T22:30:42.684037+0000","last_fullsized":"2023-11-27T22:30:42.684037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:52.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073060+0000","last_change":"2023-11-27T22:30:42.702741+0000","last_active":"2023-11-27T22:30:44.073060+0000","last_peered":"2023-11-27T22:30:44.073060+0000","last_clean":"2023-11-27T22:30:44.073060+0000","last_became_active":"2023-11-27T22:30:42.702199+0000","last_became_peered":"2023-11-27T22:30:42.702199+0000","last_unstale":"2023-11-27T22:30:44.073060+0000","last_undegraded":"2023-11-27T22:30:44.073060+0000","last_fullsized":"2023-11-27T22:30:44.073060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:19:24.892660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.693382+0000","last_change":"2023-11-27T22:30:41.702604+0000","last_active":"2023-11-27T22:30:42.693382+0000","last_peered":"2023-11-27T22:30:42.693382+0000","last_clean":"2023-11-27T22:30:42.693382+0000","last_became_active":"2023-11-27T22:30:41.702281+0000","last_became_peered":"2023-11-27T22:30:41.702281+0000","last_unstale":"2023-11-27T22:30:42.693382+0000","last_undegraded":"2023-11-27T22:30:42.693382+0000","last_fullsized":"2023-11-27T22:30:42.693382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:48.589388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695450+0000","last_change":"2023-11-27T22:30:42.699742+0000","last_active":"2023-11-27T22:30:43.695450+0000","last_peered":"2023-11-27T22:30:43.695450+0000","last_clean":"2023-11-27T22:30:43.695450+0000","last_became_active":"2023-11-27T22:30:42.699153+0000","last_became_peered":"2023-11-27T22:30:42.699153+0000","last_unstale":"2023-11-27T22:30:43.695450+0000","last_undegraded":"2023-11-27T22:30:43.695450+0000","last_fullsized":"2023-11-27T22:30:43.695450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:39:18.951476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.692796+0000","last_change":"2023-11-27T22:30:41.703709+0000","last_active":"2023-11-27T22:30:42.692796+0000","last_peered":"2023-11-27T22:30:42.692796+0000","last_clean":"2023-11-27T22:30:42.692796+0000","last_became_active":"2023-11-27T22:30:41.703349+0000","last_became_peered":"2023-11-27T22:30:41.703349+0000","last_unstale":"2023-11-27T22:30:42.692796+0000","last_undegraded":"2023-11-27T22:30:42.692796+0000","last_fullsized":"2023-11-27T22:30:42.692796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T06:05:33.379021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.073181+0000","last_change":"2023-11-27T22:30:42.701408+0000","last_active":"2023-11-27T22:30:44.073181+0000","last_peered":"2023-11-27T22:30:44.073181+0000","last_clean":"2023-11-27T22:30:44.073181+0000","last_became_active":"2023-11-27T22:30:42.701163+0000","last_became_peered":"2023-11-27T22:30:42.701163+0000","last_unstale":"2023-11-27T22:30:44.073181+0000","last_undegraded":"2023-11-27T22:30:44.073181+0000","last_fullsized":"2023-11-27T22:30:44.073181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:02:49.591606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.712864+0000","last_change":"2023-11-27T22:30:41.701683+0000","last_active":"2023-11-27T22:30:42.712864+0000","last_peered":"2023-11-27T22:30:42.712864+0000","last_clean":"2023-11-27T22:30:42.712864+0000","last_became_active":"2023-11-27T22:30:41.701442+0000","last_became_peered":"2023-11-27T22:30:41.701442+0000","last_unstale":"2023-11-27T22:30:42.712864+0000","last_undegraded":"2023-11-27T22:30:42.712864+0000","last_fullsized":"2023-11-27T22:30:42.712864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:42:57.723690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.147559+0000","last_change":"2023-11-27T22:30:42.703513+0000","last_active":"2023-11-27T22:30:44.147559+0000","last_peered":"2023-11-27T22:30:44.147559+0000","last_clean":"2023-11-27T22:30:44.147559+0000","last_became_active":"2023-11-27T22:30:42.703238+0000","last_became_peered":"2023-11-27T22:30:42.703238+0000","last_unstale":"2023-11-27T22:30:44.147559+0000","last_undegraded":"2023-11-27T22:30:44.147559+0000","last_fullsized":"2023-11-27T22:30:44.147559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:18:52.031736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146029+0000","last_change":"2023-11-27T22:30:41.704174+0000","last_active":"2023-11-27T22:30:44.146029+0000","last_peered":"2023-11-27T22:30:44.146029+0000","last_clean":"2023-11-27T22:30:44.146029+0000","last_became_active":"2023-11-27T22:30:41.703940+0000","last_became_peered":"2023-11-27T22:30:41.703940+0000","last_unstale":"2023-11-27T22:30:44.146029+0000","last_undegraded":"2023-11-27T22:30:44.146029+0000","last_fullsized":"2023-11-27T22:30:44.146029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:23.507510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.145904+0000","last_change":"2023-11-27T22:30:42.700939+0000","last_active":"2023-11-27T22:30:44.145904+0000","last_peered":"2023-11-27T22:30:44.145904+0000","last_clean":"2023-11-27T22:30:44.145904+0000","last_became_active":"2023-11-27T22:30:42.700655+0000","last_became_peered":"2023-11-27T22:30:42.700655+0000","last_unstale":"2023-11-27T22:30:44.145904+0000","last_undegraded":"2023-11-27T22:30:44.145904+0000","last_fullsized":"2023-11-27T22:30:44.145904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:51:26.079062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.692676+0000","last_change":"2023-11-27T22:30:41.697634+0000","last_active":"2023-11-27T22:30:42.692676+0000","last_peered":"2023-11-27T22:30:42.692676+0000","last_clean":"2023-11-27T22:30:42.692676+0000","last_became_active":"2023-11-27T22:30:41.697354+0000","last_became_peered":"2023-11-27T22:30:41.697354+0000","last_unstale":"2023-11-27T22:30:42.692676+0000","last_undegraded":"2023-11-27T22:30:42.692676+0000","last_fullsized":"2023-11-27T22:30:42.692676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:25:52.189777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146850+0000","last_change":"2023-11-27T22:30:42.704177+0000","last_active":"2023-11-27T22:30:44.146850+0000","last_peered":"2023-11-27T22:30:44.146850+0000","last_clean":"2023-11-27T22:30:44.146850+0000","last_became_active":"2023-11-27T22:30:42.703932+0000","last_became_peered":"2023-11-27T22:30:42.703932+0000","last_unstale":"2023-11-27T22:30:44.146850+0000","last_undegraded":"2023-11-27T22:30:44.146850+0000","last_fullsized":"2023-11-27T22:30:44.146850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:24.509728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.694956+0000","last_change":"2023-11-27T22:30:41.696773+0000","last_active":"2023-11-27T22:30:42.694956+0000","last_peered":"2023-11-27T22:30:42.694956+0000","last_clean":"2023-11-27T22:30:42.694956+0000","last_became_active":"2023-11-27T22:30:41.696503+0000","last_became_peered":"2023-11-27T22:30:41.696503+0000","last_unstale":"2023-11-27T22:30:42.694956+0000","last_undegraded":"2023-11-27T22:30:42.694956+0000","last_fullsized":"2023-11-27T22:30:42.694956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T09:33:45.803885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.145969+0000","last_change":"2023-11-27T22:30:42.698612+0000","last_active":"2023-11-27T22:30:44.145969+0000","last_peered":"2023-11-27T22:30:44.145969+0000","last_clean":"2023-11-27T22:30:44.145969+0000","last_became_active":"2023-11-27T22:30:42.698268+0000","last_became_peered":"2023-11-27T22:30:42.698268+0000","last_unstale":"2023-11-27T22:30:44.145969+0000","last_undegraded":"2023-11-27T22:30:44.145969+0000","last_fullsized":"2023-11-27T22:30:44.145969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:48:02.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.693372+0000","last_change":"2023-11-27T22:30:41.701244+0000","last_active":"2023-11-27T22:30:42.693372+0000","last_peered":"2023-11-27T22:30:42.693372+0000","last_clean":"2023-11-27T22:30:42.693372+0000","last_became_active":"2023-11-27T22:30:41.700724+0000","last_became_peered":"2023-11-27T22:30:41.700724+0000","last_unstale":"2023-11-27T22:30:42.693372+0000","last_undegraded":"2023-11-27T22:30:42.693372+0000","last_fullsized":"2023-11-27T22:30:42.693372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:12:23.507510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.694955+0000","last_change":"2023-11-27T22:30:42.705752+0000","last_active":"2023-11-27T22:30:43.694955+0000","last_peered":"2023-11-27T22:30:43.694955+0000","last_clean":"2023-11-27T22:30:43.694955+0000","last_became_active":"2023-11-27T22:30:42.705498+0000","last_became_peered":"2023-11-27T22:30:42.705498+0000","last_unstale":"2023-11-27T22:30:43.694955+0000","last_undegraded":"2023-11-27T22:30:43.694955+0000","last_fullsized":"2023-11-27T22:30:43.694955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:21:02.329609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.694175+0000","last_change":"2023-11-27T22:30:41.700515+0000","last_active":"2023-11-27T22:30:42.694175+0000","last_peered":"2023-11-27T22:30:42.694175+0000","last_clean":"2023-11-27T22:30:42.694175+0000","last_became_active":"2023-11-27T22:30:41.700257+0000","last_became_peered":"2023-11-27T22:30:41.700257+0000","last_unstale":"2023-11-27T22:30:42.694175+0000","last_undegraded":"2023-11-27T22:30:42.694175+0000","last_fullsized":"2023-11-27T22:30:42.694175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:45:20.265119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:44.146438+0000","last_change":"2023-11-27T22:30:42.699062+0000","last_active":"2023-11-27T22:30:44.146438+0000","last_peered":"2023-11-27T22:30:44.146438+0000","last_clean":"2023-11-27T22:30:44.146438+0000","last_became_active":"2023-11-27T22:30:42.698732+0000","last_became_peered":"2023-11-27T22:30:42.698732+0000","last_unstale":"2023-11-27T22:30:44.146438+0000","last_undegraded":"2023-11-27T22:30:44.146438+0000","last_fullsized":"2023-11-27T22:30:44.146438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T07:47:37.676755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.684654+0000","last_change":"2023-11-27T22:30:41.699702+0000","last_active":"2023-11-27T22:30:42.684654+0000","last_peered":"2023-11-27T22:30:42.684654+0000","last_clean":"2023-11-27T22:30:42.684654+0000","last_became_active":"2023-11-27T22:30:41.699384+0000","last_became_peered":"2023-11-27T22:30:41.699384+0000","last_unstale":"2023-11-27T22:30:42.684654+0000","last_undegraded":"2023-11-27T22:30:42.684654+0000","last_fullsized":"2023-11-27T22:30:42.684654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:06:53.347831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-27T22:30:43.695646+0000","last_change":"2023-11-27T22:30:42.700578+0000","last_active":"2023-11-27T22:30:43.695646+0000","last_peered":"2023-11-27T22:30:43.695646+0000","last_clean":"2023-11-27T22:30:43.695646+0000","last_became_active":"2023-11-27T22:30:42.700159+0000","last_became_peered":"2023-11-27T22:30:42.700159+0000","last_unstale":"2023-11-27T22:30:43.695646+0000","last_undegraded":"2023-11-27T22:30:43.695646+0000","last_fullsized":"2023-11-27T22:30:43.695646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:41.677825+0000","last_clean_scrub_stamp":"2023-11-27T22:30:41.677825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:40:17.105003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.683782+0000","last_change":"2023-11-27T22:30:41.699650+0000","last_active":"2023-11-27T22:30:42.683782+0000","last_peered":"2023-11-27T22:30:42.683782+0000","last_clean":"2023-11-27T22:30:42.683782+0000","last_became_active":"2023-11-27T22:30:41.699211+0000","last_became_peered":"2023-11-27T22:30:41.699211+0000","last_unstale":"2023-11-27T22:30:42.683782+0000","last_undegraded":"2023-11-27T22:30:42.683782+0000","last_fullsized":"2023-11-27T22:30:42.683782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:30:40.675607+0000","last_clean_scrub_stamp":"2023-11-27T22:30:40.675607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T10:19:41.625852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-27T22:30:42.690861+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-27T22:30:42.690861+0000","last_peered":"2023-11-27T22:30:42.690861+0000","last_clean":"2023-11-27T22:30:42.690861+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-27T22:30:42.690861+0000","last_undegraded":"2023-11-27T22:30:42.690861+0000","last_fullsized":"2023-11-27T22:30:42.690861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":743191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73299999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.755}]},{"osd":4,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.57699999999999996}]},{"osd":5,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Nov 27 22:30:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":153349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.316},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46899999999999997}]},{"osd":1,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48899999999999999}]},{"osd":3,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Nov 27 22:30:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":153405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.625}]},{"osd":1,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.36899999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.40100000000000002}]},{"osd":7,"last update":"Mon Nov 27 22:30:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.501}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":393216,"data_stored":152837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56999999999999995}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64700000000000002}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":154367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.34100000000000003}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.377},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.315}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73999999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":152803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.29299999999999998}]},{"osd":1,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.33800000000000002}]},{"osd":3,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.438,"5min":0.438,"15min":0.438},"last":0.308},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.32100000000000001}]},{"osd":4,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42799999999999999}]},{"osd":6,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.504}]},{"osd":7,"last update":"Mon Nov 27 22:30:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.441},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":154367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.23499999999999999}]},{"osd":2,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.31},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.27900000000000003}]},{"osd":3,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.29199999999999998}]},{"osd":4,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51900000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.56299999999999994}]},{"osd":6,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.627}]},{"osd":7,"last update":"Mon Nov 27 22:30:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":743101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.215},{"interface":"front","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.23100000000000001}]},{"osd":2,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.311}]},{"osd":4,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.505},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52700000000000002}]},{"osd":5,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56999999999999995}]},{"osd":6,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.49299999999999999}]},{"osd":7,"last update":"Mon Nov 27 22:30:27 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T22:30:50.299 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T22:30:50.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-27T22:30:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.440+0000 7f4d4c997640 1 Processor -- start 2023-11-27T22:30:50.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 -- start start 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d480b6c20 0x7f4d480b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d480cd4a0 0x7f4d48099a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4d48099fb0 0x7f4d4815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d480b29f0 con 0x7f4d480b6c20 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d480cd920 con 0x7f4d48099fb0 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4c997640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4809a440 con 0x7f4d480cd4a0 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.441+0000 7f4d4659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d480b6c20 0x7f4d480b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d480b6c20 0x7f4d480b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53506/0 (socket says 172.21.15.154:53506) 2023-11-27T22:30:50.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 -- 172.21.15.154:0/1148591847 learned_addr learned my addr 172.21.15.154:0/1148591847 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d46d9d640 1 --2- 172.21.15.154:0/1148591847 >> v2:172.21.15.194:3300/0 conn(0x7f4d48099fb0 0x7f4d4815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d3ffff640 1 --2- 172.21.15.154:0/1148591847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d480cd4a0 0x7f4d48099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 -- 172.21.15.154:0/1148591847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d480cd4a0 msgr2=0x7f4d48099a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 --2- 172.21.15.154:0/1148591847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d480cd4a0 0x7f4d48099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 -- 172.21.15.154:0/1148591847 >> v2:172.21.15.194:3300/0 conn(0x7f4d48099fb0 msgr2=0x7f4d4815f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 --2- 172.21.15.154:0/1148591847 >> v2:172.21.15.194:3300/0 conn(0x7f4d48099fb0 0x7f4d4815f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.442+0000 7f4d4659c640 1 -- 172.21.15.154:0/1148591847 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d480b7000 con 0x7f4d480b6c20 2023-11-27T22:30:50.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4659c640 1 --2- 172.21.15.154:0/1148591847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b1b90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d480728f0 tx=0x7f4d3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b54a18f7524e8bb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d45d9b640 1 -- 172.21.15.154:0/1148591847 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38031870 con 0x7f4d480b6c20 2023-11-27T22:30:50.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d45d9b640 1 -- 172.21.15.154:0/1148591847 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d380319d0 con 0x7f4d480b6c20 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d45d9b640 1 -- 172.21.15.154:0/1148591847 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38031d60 con 0x7f4d480b6c20 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 -- 172.21.15.154:0/1148591847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 msgr2=0x7f4d480b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 --2- 172.21.15.154:0/1148591847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b1b90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d480728f0 tx=0x7f4d3802b910 comp rx=0 tx=0).stop 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 -- 172.21.15.154:0/1148591847 shutdown_connections 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 --2- 172.21.15.154:0/1148591847 >> v2:172.21.15.194:3300/0 conn(0x7f4d48099fb0 0x7f4d4815f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 --2- 172.21.15.154:0/1148591847 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d480cd4a0 0x7f4d48099a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 --2- 172.21.15.154:0/1148591847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b1b90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 -- 172.21.15.154:0/1148591847 >> 172.21.15.154:0/1148591847 conn(0x7f4d480d1000 msgr2=0x7f4d480d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 -- 172.21.15.154:0/1148591847 shutdown_connections 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.443+0000 7f4d4c997640 1 -- 172.21.15.154:0/1148591847 wait complete. 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 Processor -- start 2023-11-27T22:30:50.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 -- start start 2023-11-27T22:30:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d48099fb0 0x7f4d480c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.449 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d480cd4a0 0x7f4d48151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480b0d80 con 0x7f4d480b6c20 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480c8760 con 0x7f4d480cd4a0 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d4c997640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480cb630 con 0x7f4d48099fb0 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.445+0000 7f4d3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53518/0 (socket says 172.21.15.154:53518) 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 -- 172.21.15.154:0/2522856212 learned_addr learned my addr 172.21.15.154:0/2522856212 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d46d9d640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d480cd4a0 0x7f4d48151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d4659c640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d48099fb0 0x7f4d480c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 -- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d48099fb0 msgr2=0x7f4d480c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d48099fb0 0x7f4d480c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 -- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d480cd4a0 msgr2=0x7f4d48151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d480cd4a0 0x7f4d48151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 -- 172.21.15.154:0/2522856212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380094d0 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3ffff640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b0840 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c820 tx=0x7f4d3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30004020 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30004180 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30007830 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d480ca610 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.446+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d480ca870 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.447+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d48067420 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.448+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4d30007990 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.448+0000 7f4d3effd640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2806b1f0 0x7f4d2806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.448+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d300894e0 con 0x7f4d480b6c20 2023-11-27T22:30:50.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.448+0000 7f4d4659c640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2806b1f0 0x7f4d2806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.448+0000 7f4d4659c640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2806b1f0 0x7f4d2806d6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d38036000 tx=0x7f4d3803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.454 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.452+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4d30054350 con 0x7f4d480b6c20 2023-11-27T22:30:50.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.687+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4d4815eae0 con 0x7f4d480b6c20 2023-11-27T22:30:50.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.689+0000 7f4d3effd640 1 -- 172.21.15.154:0/2522856212 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4d30057970 con 0x7f4d480b6c20 2023-11-27T22:30:50.690 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-11-27T22:30:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAZGGVlAhSrFxAA3iO+CO56glsDGfCwT7XFtw== 2023-11-27T22:30:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow" 2023-11-27T22:30:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow r" 2023-11-27T22:30:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T22:30:50.691 INFO:teuthology.orchestra.run.smithi154.stderr:updated caps for client.0 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2806b1f0 msgr2=0x7f4d2806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2806b1f0 0x7f4d2806d6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d38036000 tx=0x7f4d3803c040 comp rx=0 tx=0).stop 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 msgr2=0x7f4d480b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b0840 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000c820 tx=0x7f4d3000cce0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 shutdown_connections 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d480cd4a0 0x7f4d48151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4d2806b1f0 0x7f4d2806d6b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d480b6c20 0x7f4d480b0840 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 --2- 172.21.15.154:0/2522856212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d48099fb0 0x7f4d480c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 >> 172.21.15.154:0/2522856212 conn(0x7f4d480d1000 msgr2=0x7f4d480b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 shutdown_connections 2023-11-27T22:30:50.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.691+0000 7f4d4c997640 1 -- 172.21.15.154:0/2522856212 wait complete. 2023-11-27T22:30:50.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T22:30:50.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.803+0000 7f725840e640 1 Processor -- start 2023-11-27T22:30:50.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.803+0000 7f725840e640 1 -- start start 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.804+0000 7f725840e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7250143490 0x7f72500b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.804+0000 7f725840e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 0x7f72500b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.804+0000 7f725840e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725015e2a0 con 0x7f725015e730 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.804+0000 7f725840e640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725015b520 con 0x7f7250143490 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.804+0000 7f725840e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7250143870 con 0x7f725015abf0 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72559a9640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f725015e730 0x7f725015a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:35616/0 (socket says 172.21.15.154:35616) 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72559a9640 1 -- 172.21.15.154:0/2545420534 learned_addr learned my addr 172.21.15.154:0/2545420534 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72561aa640 1 --2- 172.21.15.154:0/2545420534 >> v2:172.21.15.194:3300/0 conn(0x7f7250143490 0x7f72500b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72569ab640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 0x7f72500b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180589019 0 0) 0x7f725015e2a0 con 0x7f725015e730 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723c003520 con 0x7f725015e730 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 <== mon.0 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4147304672 0 0) 0x7f723c003520 con 0x7f725015e730 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 msgr2=0x7f72500b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 0x7f72500b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 >> v2:172.21.15.194:3300/0 conn(0x7f7250143490 msgr2=0x7f72500b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 --2- 172.21.15.154:0/2545420534 >> v2:172.21.15.194:3300/0 conn(0x7f7250143490 0x7f72500b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725015b240 con 0x7f725015e730 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 <== mon.0 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f7240001670 con 0x7f725015e730 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72561aa640 1 --2- 172.21.15.154:0/2545420534 >> v2:172.21.15.194:3300/0 conn(0x7f7250143490 0x7f72500b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:50.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 >> v1:172.21.15.154:6789/0 conn(0x7f725015e730 legacy=0x7f725015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723c003970 0x7f723c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f723c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 0x7f723c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725015b520 con 0x7f723c0047c0 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7250143870 con 0x7f723c003970 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c00b980 con 0x7f725015abf0 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72559a9640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f723c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72561aa640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723c003970 0x7f723c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.805+0000 7f72569ab640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 0x7f723c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72559a9640 1 -- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 msgr2=0x7f723c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:50.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72559a9640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f725015abf0 0x7f723c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72559a9640 1 -- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723c003970 msgr2=0x7f723c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72559a9640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723c003970 0x7f723c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72559a9640 1 -- 172.21.15.154:0/2545420534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c003520 con 0x7f723c0047c0 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72559a9640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f723c004c40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f724000c240 tx=0x7f723c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e2b69940fcd24 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724002cb00 con 0x7f723c0047c0 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724002cc60 con 0x7f723c0047c0 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.806+0000 7f72551a8640 1 -- 172.21.15.154:0/2545420534 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240005af0 con 0x7f723c0047c0 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f725840e640 1 -- 172.21.15.154:0/2545420534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 msgr2=0x7f723c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f725840e640 1 --2- 172.21.15.154:0/2545420534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f723c004c40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f724000c240 tx=0x7f723c0057f0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f72569ab640 1 -- 172.21.15.154:0/2545420534 reap_dead start 2023-11-27T22:30:50.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f725840e640 1 -- 172.21.15.154:0/2545420534 shutdown_connections 2023-11-27T22:30:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f725840e640 1 -- 172.21.15.154:0/2545420534 >> 172.21.15.154:0/2545420534 conn(0x7f725006a4d0 msgr2=0x7f725006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f725840e640 1 -- 172.21.15.154:0/2545420534 shutdown_connections 2023-11-27T22:30:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.807+0000 7f725840e640 1 -- 172.21.15.154:0/2545420534 wait complete. 2023-11-27T22:30:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.808+0000 7f725840e640 1 Processor -- start 2023-11-27T22:30:50.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.808+0000 7f725840e640 1 -- start start 2023-11-27T22:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f725840e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f725015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f725840e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72501e7c50 0x7f72501e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f725840e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7250130870 0x7f7250130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.816 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f725840e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501e8610 con 0x7f723c0047c0 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f725840e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501421c0 con 0x7f72501e7c50 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f725840e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725012ef10 con 0x7f7250130870 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f725015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f725015cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53534/0 (socket says 172.21.15.154:53534) 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 -- 172.21.15.154:0/3586471545 learned_addr learned my addr 172.21.15.154:0/3586471545 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 -- 172.21.15.154:0/3586471545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7250130870 msgr2=0x7f7250130cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7250130870 0x7f7250130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 -- 172.21.15.154:0/3586471545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72501e7c50 msgr2=0x7f72501e80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72501e7c50 0x7f72501e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 -- 172.21.15.154:0/3586471545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250131230 con 0x7f723c0047c0 2023-11-27T22:30:50.817 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f72561aa640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f725015cec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f724c011ac0 tx=0x7f724c011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00fb90 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.809+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c00fcf0 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.810+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7250131490 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.810+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c004260 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.810+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725012e8c0 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.810+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250069400 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.811+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f724c003610 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.811+0000 7f7246ffd640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f723406b1f0 0x7f723406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.811+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f724c08a0c0 con 0x7f723c0047c0 2023-11-27T22:30:50.818 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.811+0000 7f72559a9640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f723406b1f0 0x7f723406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.812+0000 7f72559a9640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f723406b1f0 0x7f723406d6b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7240034000 tx=0x7f724002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:50.819 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:50.815+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f724c054df0 con 0x7f723c0047c0 2023-11-27T22:30:51.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.018+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72500b2820 con 0x7f723c0047c0 2023-11-27T22:30:51.021 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.019+0000 7f7246ffd640 1 -- 172.21.15.154:0/3586471545 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f724c058410 con 0x7f723c0047c0 2023-11-27T22:30:51.021 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:51.021 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:30:42.026663+0000","modified":"2023-11-27T22:30:44.025219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1494168994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1494168994},{"type":"v1","addr":"172.21.15.154:6837","nonce":1494168994}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T22:30:51.023 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 12 2023-11-27T22:30:51.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.020+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f723406b1f0 msgr2=0x7f723406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f723406b1f0 0x7f723406d6b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7240034000 tx=0x7f724002e000 comp rx=0 tx=0).stop 2023-11-27T22:30:51.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 msgr2=0x7f725015cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.023 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f725015cec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f724c011ac0 tx=0x7f724c011f80 comp rx=0 tx=0).stop 2023-11-27T22:30:51.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 shutdown_connections 2023-11-27T22:30:51.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72501e7c50 0x7f72501e80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.024 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f723406b1f0 0x7f723406d6b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7250130870 0x7f7250130cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 --2- 172.21.15.154:0/3586471545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f723c0047c0 0x7f725015cec0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 >> 172.21.15.154:0/3586471545 conn(0x7f725006a4d0 msgr2=0x7f72500ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 shutdown_connections 2023-11-27T22:30:51.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.021+0000 7f725840e640 1 -- 172.21.15.154:0/3586471545 wait complete. 2023-11-27T22:30:51.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T22:30:42.026663+0000', 'modified': '2023-11-27T22:30:44.025219+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5229}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5229': {'gid': 5229, 'name': 'c', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6837/1494168994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6835', 'nonce': 1494168994}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 1494168994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T22:30:51.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T22:30:51.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-27T22:30:51.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.538+0000 7f1c2082b640 1 Processor -- start 2023-11-27T22:30:51.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.538+0000 7f1c2082b640 1 -- start start 2023-11-27T22:30:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c2082b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1c1c158f00 0x7f1c1c15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c2082b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 0x7f1c1c15b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c2082b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c1592e0 con 0x7f1c1c15be60 2023-11-27T22:30:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c2082b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c15c8c0 con 0x7f1c1c158f00 2023-11-27T22:30:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c2082b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c15fdf0 con 0x7f1c1c0cd720 2023-11-27T22:30:51.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 0x7f1c1c15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1a59c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1c1c158f00 0x7f1c1c15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1ad9d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1c1c15be60 0x7f1c1c0b52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:33928/0 (socket says 172.21.15.154:33928) 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1a59c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1c1c158f00 0x7f1c1c15f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:48558/0 (socket says 172.21.15.154:48558) 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/908692001 learned_addr learned my addr 172.21.15.154:0/908692001 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c13fff640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 0x7f1c1c15b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:57270/0 (socket says 172.21.15.154:57270) 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1a59c640 1 -- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 msgr2=0x7f1c1c15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 0x7f1c1c15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1a59c640 1 -- 172.21.15.154:0/908692001 >> v1:172.21.15.194:6789/0 conn(0x7f1c1c15be60 legacy=0x7f1c1c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c1a59c640 1 -- 172.21.15.154:0/908692001 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c15c300 con 0x7f1c1c158f00 2023-11-27T22:30:51.542 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.539+0000 7f1c13fff640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 0x7f1c1c15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.540+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c158f00 0x7f1c1c15f8b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0097d0 tx=0x7f1c0c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=277a7ffd98e86392 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.540+0000 7f1c19d9b640 1 -- 172.21.15.154:0/908692001 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c031800 con 0x7f1c1c158f00 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.540+0000 7f1c19d9b640 1 -- 172.21.15.154:0/908692001 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c031960 con 0x7f1c1c158f00 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.540+0000 7f1c19d9b640 1 -- 172.21.15.154:0/908692001 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c031cf0 con 0x7f1c1c158f00 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 -- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c158f00 msgr2=0x7f1c1c15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c158f00 0x7f1c1c15f8b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0097d0 tx=0x7f1c0c02b8a0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 -- 172.21.15.154:0/908692001 shutdown_connections 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c0cd720 0x7f1c1c15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 --2- 172.21.15.154:0/908692001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c158f00 0x7f1c1c15f8b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 -- 172.21.15.154:0/908692001 >> 172.21.15.154:0/908692001 conn(0x7f1c1c0cff30 msgr2=0x7f1c1c0d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 -- 172.21.15.154:0/908692001 shutdown_connections 2023-11-27T22:30:51.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.541+0000 7f1c2082b640 1 -- 172.21.15.154:0/908692001 wait complete. 2023-11-27T22:30:51.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.542+0000 7f1c2082b640 1 Processor -- start 2023-11-27T22:30:51.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.542+0000 7f1c2082b640 1 -- start start 2023-11-27T22:30:51.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c2082b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 0x7f1c1c15ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c2082b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c158f00 0x7f1c1c1f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c2082b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c15be60 0x7f1c1c13aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c2082b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1f1790 con 0x7f1c1c0cd720 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c2082b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c13b020 con 0x7f1c1c15be60 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c2082b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1f2220 con 0x7f1c1c158f00 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 0x7f1c1c15ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 0x7f1c1c15ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53544/0 (socket says 172.21.15.154:53544) 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 -- 172.21.15.154:0/2939443992 learned_addr learned my addr 172.21.15.154:0/2939443992 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c15be60 0x7f1c1c13aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c158f00 0x7f1c1c1f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 -- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c158f00 msgr2=0x7f1c1c1f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c158f00 0x7f1c1c1f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 -- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c15be60 msgr2=0x7f1c1c13aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c15be60 0x7f1c1c13aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.543+0000 7f1c1a59c640 1 -- 172.21.15.154:0/2939443992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c04009400 con 0x7f1c1c0cd720 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.544+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 0x7f1c1c15ea40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0098f0 tx=0x7f1c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.544+0000 7f1c12ffd640 1 -- 172.21.15.154:0/2939443992 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c03bc70 con 0x7f1c1c0cd720 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.544+0000 7f1c12ffd640 1 -- 172.21.15.154:0/2939443992 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c03bdd0 con 0x7f1c1c0cd720 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.544+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c009400 con 0x7f1c1c0cd720 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.544+0000 7f1c12ffd640 1 -- 172.21.15.154:0/2939443992 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c045630 con 0x7f1c1c0cd720 2023-11-27T22:30:51.548 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.544+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c1f1c60 con 0x7f1c1c0cd720 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.545+0000 7f1c12ffd640 1 -- 172.21.15.154:0/2939443992 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1c0c04e450 con 0x7f1c1c0cd720 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.546+0000 7f1c12ffd640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.546+0000 7f1c12ffd640 1 -- 172.21.15.154:0/2939443992 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c0c02e070 con 0x7f1c1c0cd720 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.546+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.546+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0b1dd0 tx=0x7f1c04009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.547+0000 7f1c233c3740 1 Processor -- start 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.547+0000 7f1c233c3740 1 -- start start 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96da0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.557 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96dd09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 0x55da96dd0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c233c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96d61980 con 0x55da96da1130 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96d13b90 con 0x55da96dcdc50 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da96d11280 con 0x55da96dce030 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 0x55da96dd0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 0x55da96dd0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53552/0 (socket says 172.21.15.154:53552) 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2549904654 learned_addr learned my addr 172.21.15.154:0/2549904654 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96da0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 msgr2=0x55da96dd09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96dd09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96dd09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.558 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 msgr2=0x55da96da0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96da0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2549904654 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da96cd2500 con 0x55da96da1130 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 0x55da96dd0f20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1c140020b0 tx=0x7f1c14001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4611761b36732 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1bfbfff640 1 -- 172.21.15.154:0/2549904654 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400feb0 con 0x55da96da1130 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1bfbfff640 1 -- 172.21.15.154:0/2549904654 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140070d0 con 0x55da96da1130 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.548+0000 7f1bfbfff640 1 -- 172.21.15.154:0/2549904654 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14007440 con 0x55da96da1130 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 -- 172.21.15.154:0/2549904654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 msgr2=0x55da96dd0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 0x55da96dd0f20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1c140020b0 tx=0x7f1c14001950 comp rx=0 tx=0).stop 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 -- 172.21.15.154:0/2549904654 shutdown_connections 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96da1130 0x55da96dd0f20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96dd09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2549904654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96da0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.559 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 -- 172.21.15.154:0/2549904654 >> 172.21.15.154:0/2549904654 conn(0x55da96da2e60 msgr2=0x55da96deb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 -- 172.21.15.154:0/2549904654 shutdown_connections 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.549+0000 7f1c233c3740 1 -- 172.21.15.154:0/2549904654 wait complete. 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.550+0000 7f1c233c3740 1 -- start start 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.550+0000 7f1c233c3740 1 Processor -- start 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dd2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96de2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96d0cb70 con 0x55da96dce030 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96cc6e00 con 0x55da96de2500 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da96cc6aa0 con 0x55da96dcdc50 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 10 client.0 _ll_register_callbacks cb 0x55da96a1eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dd2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.560 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dd2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53558/0 (socket says 172.21.15.154:53558) 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 -- 172.21.15.154:0/2975271502 learned_addr learned my addr 172.21.15.154:0/2975271502 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96de2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 -- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 msgr2=0x55da96db7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 -- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 msgr2=0x55da96de2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96de2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 -- 172.21.15.154:0/2975271502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c1592e0 con 0x55da96dce030 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96de2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dd2580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1c040149a0 tx=0x7f1c040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741a05a160690485 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1bf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2975271502 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04004030 con 0x55da96dce030 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2975271502 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c04004190 con 0x55da96dce030 2023-11-27T22:30:51.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da96d05b50 con 0x55da96dce030 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2975271502 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c04004350 con 0x55da96dce030 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 10 client.5451 fetch_fsmap learned FSMap version 12 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.551+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x55da96d0b1f0 con 0x55da96dce030 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2975271502 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da96d05b50 con 0x55da96dce030 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2975271502 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 12) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1c040137b0 con 0x55da96dce030 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c233c3740 10 client.5451 fetch_fsmap finished waiting for FSMap version 12 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c233c3740 10 client.5451 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c233c3740 20 client.5451 populate_metadata read hostname 'smithi154' 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96dd4a00 0x55da96dcee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c233c3740 4 client.5451 mds_command: new command op to 5229 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 --> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da96d05870 con 0x55da96dd4a00 2023-11-27T22:30:51.562 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96dd4a00 0x55da96dcee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1bf97fa640 10 client.5451 ms_handle_connect on v2:172.21.15.154:6835/1494168994 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.552+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96dd4a00 0x55da96dcee00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74ea10bd923b8f8 server_cookie=b3eb2cdd59f31645 in_seq=0 out_seq=0 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2975271502 <== mds.0 v2:172.21.15.154:6835/1494168994 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55da96d05870 con 0x55da96dd4a00 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1bf97fa640 10 client.5451 handle_command_reply: tid=0 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 client.5451 shutdown 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 msgr2=0x55da96dd2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dd2580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1c040149a0 tx=0x7f1c040046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 shutdown_connections 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96dd4a00 0x55da96dcee00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96de2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1bf97fa640 0 client.5451 ms_handle_reset on v2:172.21.15.154:6835/1494168994 2023-11-27T22:30:51.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dd2580 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.564 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2975271502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 >> 172.21.15.154:0/2975271502 conn(0x55da96da1130 msgr2=0x55da96deeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 shutdown_connections 2023-11-27T22:30:51.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 1 -- 172.21.15.154:0/2975271502 wait complete. 2023-11-27T22:30:51.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.553+0000 7f1c233c3740 20 client.5451 trim_cache size 0 max 16384 2023-11-27T22:30:51.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.569+0000 7f1c233c3740 1 Processor -- start 2023-11-27T22:30:51.570 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.569+0000 7f1c233c3740 1 -- start start 2023-11-27T22:30:51.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.569+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96e053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.569+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96db64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.569+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 0x55da96d9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.569+0000 7f1c233c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96c8c270 con 0x55da96de2500 2023-11-27T22:30:51.573 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96dee9a0 con 0x55da96dcdc50 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da96dccd30 con 0x55da96dce030 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 0x55da96d9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 0x55da96d9fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53568/0 (socket says 172.21.15.154:53568) 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2023626778 learned_addr learned my addr 172.21.15.154:0/2023626778 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96db64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96e053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.574 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 msgr2=0x55da96db64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96db64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 msgr2=0x55da96e053b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96e053b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 -- 172.21.15.154:0/2023626778 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da96ca8d00 con 0x55da96de2500 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 0x55da96d9fc60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1c140012e0 tx=0x7f1c1400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e87ab317ff6397 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c10ff9640 1 -- 172.21.15.154:0/2023626778 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14007540 con 0x55da96de2500 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c10ff9640 1 -- 172.21.15.154:0/2023626778 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140076e0 con 0x55da96de2500 2023-11-27T22:30:51.575 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.570+0000 7f1c10ff9640 1 -- 172.21.15.154:0/2023626778 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14007a90 con 0x55da96de2500 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 -- 172.21.15.154:0/2023626778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 msgr2=0x55da96d9fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 0x55da96d9fc60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1c140012e0 tx=0x7f1c1400a000 comp rx=0 tx=0).stop 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 -- 172.21.15.154:0/2023626778 shutdown_connections 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96de2500 0x55da96d9fc60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dce030 0x55da96db64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2023626778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96dcdc50 0x55da96e053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.576 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 -- 172.21.15.154:0/2023626778 >> 172.21.15.154:0/2023626778 conn(0x55da96da1130 msgr2=0x55da96d9c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 -- 172.21.15.154:0/2023626778 shutdown_connections 2023-11-27T22:30:51.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 -- 172.21.15.154:0/2023626778 wait complete. 2023-11-27T22:30:51.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 -- start start 2023-11-27T22:30:51.577 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.571+0000 7f1c233c3740 1 Processor -- start 2023-11-27T22:30:51.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dc8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96dbb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.581 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96decff0 con 0x55da96dce030 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da96db7020 con 0x55da96de2500 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da96dba290 con 0x55da96dcdc50 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c233c3740 10 client.0 _ll_register_callbacks cb 0x7f1c14001c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dc8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dc8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53584/0 (socket says 172.21.15.154:53584) 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.572+0000 7f1c13fff640 1 -- 172.21.15.154:0/2275377133 learned_addr learned my addr 172.21.15.154:0/2275377133 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c1ad9d640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96dbb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c13fff640 1 -- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 msgr2=0x55da96db9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c13fff640 1 -- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 msgr2=0x55da96dbb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.582 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96dbb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c13fff640 1 -- 172.21.15.154:0/2275377133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da96cd2500 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c13fff640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dc8490 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1c040149a0 tx=0x7f1c04019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e89981c9c9eeb7d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1bf97fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2275377133 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04013240 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2275377133 <== mon.0 v2:172.21.15.154:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c04004040 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c140070d0 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2275377133 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c04004200 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 10 client.5457 fetch_fsmap learned FSMap version 12 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x55da96cce4f0 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2275377133 <== mon.0 v2:172.21.15.154:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140070d0 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2275377133 <== mon.0 v2:172.21.15.154:3300/0 5 ==== fsmap(e 12) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1c04004360 con 0x55da96dce030 2023-11-27T22:30:51.583 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 10 client.5457 fetch_fsmap finished waiting for FSMap version 12 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 10 client.5457 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 20 client.5457 populate_metadata read hostname 'smithi154' 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96da66c0 0x55da96de1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 4 client.5457 mds_command: new command op to 5229 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.573+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 --> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55da96a0d6c0 con 0x55da96da66c0 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96da66c0 0x55da96de1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1bf97fa640 10 client.5457 ms_handle_connect on v2:172.21.15.154:6835/1494168994 2023-11-27T22:30:51.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c1a59c640 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96da66c0 0x55da96de1370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c273a0c160b292bc server_cookie=b1a59bf998b28608 in_seq=0 out_seq=0 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1bf97fa640 1 -- 172.21.15.154:0/2275377133 <== mds.0 v2:172.21.15.154:6835/1494168994 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55da96a0d6c0 con 0x55da96da66c0 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1bf97fa640 10 client.5457 handle_command_reply: tid=0 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 client.5457 shutdown 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 msgr2=0x55da96dc8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dc8490 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1c040149a0 tx=0x7f1c04019000 comp rx=0 tx=0).stop 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 shutdown_connections 2023-11-27T22:30:51.585 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:6835/1494168994,v1:172.21.15.154:6837/1494168994] conn(0x55da96da66c0 0x55da96de1370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da96de2500 0x55da96dbb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da96dce030 0x55da96dc8490 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1bf97fa640 0 client.5457 ms_handle_reset on v2:172.21.15.154:6835/1494168994 2023-11-27T22:30:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 --2- 172.21.15.154:0/2275377133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55da96dcdc50 0x55da96db9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 >> 172.21.15.154:0/2275377133 conn(0x55da96da1130 msgr2=0x55da96d9c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 shutdown_connections 2023-11-27T22:30:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.574+0000 7f1c233c3740 1 -- 172.21.15.154:0/2275377133 wait complete. 2023-11-27T22:30:51.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c233c3740 20 client.5457 trim_cache size 0 max 16384 2023-11-27T22:30:51.587 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-27T22:30:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "cluster_fsid": "480179ad-e540-429b-b1ff-bfa2150dc1f7", 2023-11-27T22:30:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "whoami": 0, 2023-11-27T22:30:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5229, 2023-11-27T22:30:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "want_state": "up:active", 2023-11-27T22:30:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "state": "up:active", 2023-11-27T22:30:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs", 2023-11-27T22:30:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "rank_uptime": 8.8851997160000007, 2023-11-27T22:30:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "mdsmap_epoch": 12, 2023-11-27T22:30:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch": 34, 2023-11-27T22:30:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_epoch_barrier": 34, 2023-11-27T22:30:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "uptime": 16.934041666999999 2023-11-27T22:30:51.589 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-27T22:30:51.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 msgr2=0x7f1bfc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0b1dd0 tx=0x7f1c04009190 comp rx=0 tx=0).stop 2023-11-27T22:30:51.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 msgr2=0x7f1c1c15ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.591 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 0x7f1c1c15ea40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0098f0 tx=0x7f1c0c0046c0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 shutdown_connections 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c1c15be60 0x7f1c1c13aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1bfc06b1c0 0x7f1bfc06d680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1c1c158f00 0x7f1c1c1f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 --2- 172.21.15.154:0/2939443992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c1c0cd720 0x7f1c1c15ea40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 >> 172.21.15.154:0/2939443992 conn(0x7f1c1c0cff30 msgr2=0x7f1c1c159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 shutdown_connections 2023-11-27T22:30:51.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.575+0000 7f1c2082b640 1 -- 172.21.15.154:0/2939443992 wait complete. 2023-11-27T22:30:51.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T22:30:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.692+0000 7ff13dfd7640 1 Processor -- start 2023-11-27T22:30:51.694 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.692+0000 7ff13dfd7640 1 -- start start 2023-11-27T22:30:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff13dfd7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff138158ba0 0x7ff13815c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff13dfd7640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1380ac370 0x7ff1380ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff13dfd7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1380adbb0 con 0x7ff138071c80 2023-11-27T22:30:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff13dfd7640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1380b4520 con 0x7ff1380ac370 2023-11-27T22:30:51.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff13dfd7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13815c6a0 con 0x7ff138158ba0 2023-11-27T22:30:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff1377fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff138158ba0 0x7ff13815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff136ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1380ac370 0x7ff1380ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff137fff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff138071c80 0x7ff1380b2200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:33938/0 (socket says 172.21.15.154:33938) 2023-11-27T22:30:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff136ffd640 1 --2- 172.21.15.154:0/2169788322 >> v2:172.21.15.194:3300/0 conn(0x7ff1380ac370 0x7ff1380ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:48622/0 (socket says 172.21.15.154:48622) 2023-11-27T22:30:51.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.693+0000 7ff137fff640 1 -- 172.21.15.154:0/2169788322 learned_addr learned my addr 172.21.15.154:0/2169788322 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-27T22:30:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.694+0000 7ff136ffd640 1 -- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff138158ba0 msgr2=0x7ff13815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:30:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.694+0000 7ff136ffd640 1 --2- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff138158ba0 0x7ff13815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.694+0000 7ff136ffd640 1 -- 172.21.15.154:0/2169788322 >> v1:172.21.15.194:6789/0 conn(0x7ff138071c80 legacy=0x7ff1380b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.694+0000 7ff136ffd640 1 -- 172.21.15.154:0/2169788322 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380b3f60 con 0x7ff1380ac370 2023-11-27T22:30:51.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.694+0000 7ff1377fe640 1 --2- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff138158ba0 0x7ff13815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.694+0000 7ff1367fc640 1 -- 172.21.15.154:0/2169788322 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907979118 0 0) 0x7ff1380adbb0 con 0x7ff138071c80 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff136ffd640 1 --2- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1380ac370 0x7ff1380ae5e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0097a0 tx=0x7ff12c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c749f05e732df9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff1367fc640 1 -- 172.21.15.154:0/2169788322 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c02e070 con 0x7ff1380ac370 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff1367fc640 1 -- 172.21.15.154:0/2169788322 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c0315a0 con 0x7ff1380ac370 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff1367fc640 1 -- 172.21.15.154:0/2169788322 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c031930 con 0x7ff1380ac370 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 -- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1380ac370 msgr2=0x7ff1380ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1380ac370 0x7ff1380ae5e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0097a0 tx=0x7ff12c02b840 comp rx=0 tx=0).stop 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 -- 172.21.15.154:0/2169788322 shutdown_connections 2023-11-27T22:30:51.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1380ac370 0x7ff1380ae5e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/2169788322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff138158ba0 0x7ff13815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 -- 172.21.15.154:0/2169788322 >> 172.21.15.154:0/2169788322 conn(0x7ff1380b4720 msgr2=0x7ff1380b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 -- 172.21.15.154:0/2169788322 shutdown_connections 2023-11-27T22:30:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.695+0000 7ff13dfd7640 1 -- 172.21.15.154:0/2169788322 wait complete. 2023-11-27T22:30:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.696+0000 7ff13dfd7640 1 Processor -- start 2023-11-27T22:30:51.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 -- start start 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 0x7ff13814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1380ac370 0x7ff13813d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff138158ba0 0x7ff138153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13814e270 con 0x7ff138071c80 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13814edf0 con 0x7ff138158ba0 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff13dfd7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13814e4c0 con 0x7ff1380ac370 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff1377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 0x7ff13814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff1377fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 0x7ff13814d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:53590/0 (socket says 172.21.15.154:53590) 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.697+0000 7ff1377fe640 1 -- 172.21.15.154:0/3765513595 learned_addr learned my addr 172.21.15.154:0/3765513595 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff136ffd640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1380ac370 0x7ff13813d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff137fff640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff138158ba0 0x7ff138153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff1377fe640 1 -- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1380ac370 msgr2=0x7ff13813d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff1377fe640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1380ac370 0x7ff13813d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff1377fe640 1 -- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff138158ba0 msgr2=0x7ff138153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff1377fe640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff138158ba0 0x7ff138153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff1377fe640 1 -- 172.21.15.154:0/3765513595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009400 con 0x7ff138071c80 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff1377fe640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 0x7ff13814d600 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff12800e960 tx=0x7ff12800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12800ca00 con 0x7ff138071c80 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800cb60 con 0x7ff138071c80 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c009400 con 0x7ff138071c80 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128013470 con 0x7ff138071c80 2023-11-27T22:30:51.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.698+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13814ea80 con 0x7ff138071c80 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.699+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff138069400 con 0x7ff138071c80 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.699+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff1280135d0 con 0x7ff138071c80 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.700+0000 7ff11ffff640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff12406b1c0 0x7ff12406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.700+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff128089c50 con 0x7ff138071c80 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.700+0000 7ff136ffd640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff12406b1c0 0x7ff12406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.700+0000 7ff136ffd640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff12406b1c0 0x7ff12406d680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff12c036000 tx=0x7ff12c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:30:51.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.704+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff12808f020 con 0x7ff138071c80 2023-11-27T22:30:51.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.905+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff13815c3a0 con 0x7ff138071c80 2023-11-27T22:30:51.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.905+0000 7ff11ffff640 1 -- 172.21.15.154:0/3765513595 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff128054990 con 0x7ff138071c80 2023-11-27T22:30:51.907 INFO:teuthology.orchestra.run.smithi154.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff12406b1c0 msgr2=0x7ff12406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff12406b1c0 0x7ff12406d680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff12c036000 tx=0x7ff12c008030 comp rx=0 tx=0).stop 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 msgr2=0x7ff13814d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 0x7ff13814d600 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff12800e960 tx=0x7ff12800ee20 comp rx=0 tx=0).stop 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 shutdown_connections 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff138158ba0 0x7ff138153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff12406b1c0 0x7ff12406d680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1380ac370 0x7ff13813d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 --2- 172.21.15.154:0/3765513595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff138071c80 0x7ff13814d600 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:30:51.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 >> 172.21.15.154:0/3765513595 conn(0x7ff1380b4720 msgr2=0x7ff138072110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:30:51.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 shutdown_connections 2023-11-27T22:30:51.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:51.907+0000 7ff13dfd7640 1 -- 172.21.15.154:0/3765513595 wait complete. 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T22:30:51.920 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T22:30:51.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:51.920 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:51.936 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:51.937 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-11-27T22:30:51.937 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:51.937 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:51.937 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-11-27T22:30:51.937 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-27T22:30:51.938 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:51.938 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42623sec preferred_lft 42623sec 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ec4:7aff:fe88:7761/64 scope link 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 8a:54:d0:de:af:a5 brd ff:ff:ff:ff:ff:ff 2023-11-27T22:30:51.939 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::248f:8fff:fe27:29a8/64 scope link 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether ae:4a:cf:38:5a:08 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::ac4a:cfff:fe38:5a08/64 scope link 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 8a:54:d0:de:af:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::8854:d0ff:fede:afa5/64 scope link 2023-11-27T22:30:51.940 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-11-27T22:30:51.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:51.941 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T22:30:52.003 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-11-27T22:30:52.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.004 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-11-27T22:30:52.061 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-11-27T22:30:52.061 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T22:30:52.061 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T22:30:52.061 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T22:30:52.061 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T22:30:52.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.062 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-11-27T22:30:52.062 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-11-27T22:30:52.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T22:30:52.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T22:30:52.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T22:30:52.063 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-11-27T22:30:52.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.158 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-27T22:30:52.172 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-27T22:30:52.173 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T22:30:52.173 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T22:30:52.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-11-27T22:30:52.241 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-27T22:30:52.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:52.242 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:52.297 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T22:30:52.297 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T22:30:52.298 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:52.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-27T22:30:52.420 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:52.476 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2023-11-27T22:30:52.477 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:52.478 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:52.479 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:52.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.480 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-27T22:30:52.532 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-27T22:30:52.532 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-27T22:30:52.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-11-27T22:30:52.603 DEBUG:teuthology.orchestra.run.smithi154:> cat /proc/self/mounts | awk '{print $2}' 2023-11-27T22:30:52.658 INFO:teuthology.orchestra.run.smithi154.stdout:/proc 2023-11-27T22:30:52.658 INFO:teuthology.orchestra.run.smithi154.stdout:/sys 2023-11-27T22:30:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:/dev 2023-11-27T22:30:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/security 2023-11-27T22:30:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/shm 2023-11-27T22:30:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/pts 2023-11-27T22:30:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:/run 2023-11-27T22:30:52.660 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/cgroup 2023-11-27T22:30:52.660 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/pstore 2023-11-27T22:30:52.660 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/bpf 2023-11-27T22:30:52.660 INFO:teuthology.orchestra.run.smithi154.stdout:/ 2023-11-27T22:30:52.660 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/selinux 2023-11-27T22:30:52.660 INFO:teuthology.orchestra.run.smithi154.stdout:/proc/sys/fs/binfmt_misc 2023-11-27T22:30:52.661 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/hugepages 2023-11-27T22:30:52.661 INFO:teuthology.orchestra.run.smithi154.stdout:/dev/mqueue 2023-11-27T22:30:52.661 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/debug 2023-11-27T22:30:52.661 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/tracing 2023-11-27T22:30:52.662 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-27T22:30:52.662 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/fs/fuse/connections 2023-11-27T22:30:52.662 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-sysctl.service 2023-11-27T22:30:52.662 INFO:teuthology.orchestra.run.smithi154.stdout:/sys/kernel/config 2023-11-27T22:30:52.663 INFO:teuthology.orchestra.run.smithi154.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-27T22:30:52.663 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/nfs/rpc_pipefs 2023-11-27T22:30:52.663 INFO:teuthology.orchestra.run.smithi154.stdout:/run/user/1000 2023-11-27T22:30:52.663 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph 2023-11-27T22:30:52.663 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-0 2023-11-27T22:30:52.663 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-1 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-2 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/var/lib/ceph/osd/ceph-3 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run.smithi154.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-27T22:30:52.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.665 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-11-27T22:30:52.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:2023-11-27T22:30:52.659+0000 7fc989c3a480 -1 init, newargv = 0x561a4ebb24c0 newargc=15 2023-11-27T22:30:52.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[104039]: starting ceph client 2023-11-27T22:30:52.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[104039]: starting fuse 2023-11-27T22:30:52.680 INFO:teuthology.orchestra.run.smithi154.stdout:41 2023-11-27T22:30:52.681 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo stdin-killer -- python3 -c ' 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-11-27T22:30:52.681 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:52.682 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-11-27T22:30:52.683 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-27T22:30:52.683 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-27T22:30:52.683 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-27T22:30:52.683 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-11-27T22:30:52.683 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-11-27T22:30:52.683 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-11-27T22:30:52.684 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-27T22:30:52.684 DEBUG:teuthology.orchestra.run.smithi154:> 2023-11-27T22:30:52.684 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.0")) 2023-11-27T22:30:52.684 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-11-27T22:30:52.801 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.0.104039.asok 2023-11-27T22:30:52.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:30:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-27T22:30:52.813 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104039.asok 2023-11-27T22:30:52.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.104039.asok status 2023-11-27T22:30:52.948 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-27T22:30:52.948 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-11-27T22:30:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "369173db14b6995b2bd07c60ec5f63d01cf21631", 2023-11-27T22:30:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-7498-g369173db (369173db14b6995b2bd07c60ec5f63d01cf21631) squid (dev)", 2023-11-27T22:30:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "0", 2023-11-27T22:30:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-11-27T22:30:52.949 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-27T22:30:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "104039", 2023-11-27T22:30:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-11-27T22:30:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:52.950 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-11-27T22:30:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-11-27T22:30:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 5466, 2023-11-27T22:30:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-11-27T22:30:52.951 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-11-27T22:30:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-11-27T22:30:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 5466 2023-11-27T22:30:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:52.952 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-27T22:30:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-27T22:30:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-11-27T22:30:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3710266490 2023-11-27T22:30:52.953 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-11-27T22:30:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-11-27T22:30:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-11-27T22:30:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-11-27T22:30:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3710266490 2023-11-27T22:30:52.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.5466 192.168.0.1:0/3710266490", 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/3710266490", 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 12, 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 34, 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-11-27T22:30:52.955 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-27T22:30:52.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.958 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-11-27T22:30:52.959 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:52.974 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-11-27T22:30:52.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:52.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:52.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T22:30:53.042 DEBUG:teuthology.orchestra.run.smithi154:> mktemp -d --suffix=xfstests-dev 2023-11-27T22:30:53.097 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.1EbDOAX7rXxfstests-dev 2023-11-27T22:30:53.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:53.098 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.1EbDOAX7rXxfstests-dev) 2023-11-27T22:30:53.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:53.166 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.1EbDOAX7rXxfstests-dev) 2023-11-27T22:30:53.225 INFO:teuthology.orchestra.run.smithi154.stderr:Cloning into '/tmp/tmp.1EbDOAX7rXxfstests-dev'... 2023-11-27T22:30:53.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:53.922 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-27T22:30:53.982 DEBUG:teuthology.orchestra.run.smithi154:> mktemp -d --suffix=test 2023-11-27T22:30:54.037 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.0kYt7WHchItest 2023-11-27T22:30:54.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:30:54.038 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-27T22:30:54.095 DEBUG:teuthology.orchestra.run.smithi154:> mktemp -d --suffix=scratch 2023-11-27T22:30:54.149 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.TVl9XwHeYtscratch 2023-11-27T22:30:54.149 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-11-27T22:30:54.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-11-27T22:30:54.781 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:03:35 ago on Mon 27 Nov 2023 10:27:19 PM UTC. 2023-11-27T22:30:54.877 INFO:teuthology.orchestra.run.smithi154.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-11-27T22:30:54.878 INFO:teuthology.orchestra.run.smithi154.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-11-27T22:30:54.879 INFO:teuthology.orchestra.run.smithi154.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-11-27T22:30:54.880 INFO:teuthology.orchestra.run.smithi154.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-11-27T22:30:54.881 INFO:teuthology.orchestra.run.smithi154.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-11-27T22:30:54.883 INFO:teuthology.orchestra.run.smithi154.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-11-27T22:30:54.885 INFO:teuthology.orchestra.run.smithi154.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-11-27T22:30:54.886 INFO:teuthology.orchestra.run.smithi154.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-11-27T22:30:54.888 INFO:teuthology.orchestra.run.smithi154.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-11-27T22:30:54.891 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-11-27T22:30:54.892 INFO:teuthology.orchestra.run.smithi154.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-11-27T22:30:54.894 INFO:teuthology.orchestra.run.smithi154.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-11-27T22:30:54.895 INFO:teuthology.orchestra.run.smithi154.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-11-27T22:30:54.896 INFO:teuthology.orchestra.run.smithi154.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-11-27T22:30:54.897 INFO:teuthology.orchestra.run.smithi154.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-11-27T22:30:54.898 INFO:teuthology.orchestra.run.smithi154.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-11-27T22:30:54.899 INFO:teuthology.orchestra.run.smithi154.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-11-27T22:30:54.900 INFO:teuthology.orchestra.run.smithi154.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-11-27T22:30:54.901 INFO:teuthology.orchestra.run.smithi154.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-11-27T22:30:54.904 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-27T22:30:54.962 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-11-27T22:30:54.964 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: kernel-devel x86_64 5.14.0-386.el9 appstream 21 M 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-11-27T22:30:54.965 INFO:teuthology.orchestra.run.smithi154.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-11-27T22:30:54.966 INFO:teuthology.orchestra.run.smithi154.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: libnbd x86_64 1.18.1-2.el9 CentOS-AppStream 164 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2023-11-27T22:30:54.967 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout:================================================================================ 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout:Install 17 Packages 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 16 Packages 2023-11-27T22:30:54.968 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:30:54.969 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 96 M 2023-11-27T22:30:54.969 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-11-27T22:30:55.578 INFO:teuthology.orchestra.run.smithi154.stdout:(1/33): fio-engine-http-3.35-1.el9.x86_64.rpm 74 kB/s | 17 kB 00:00 2023-11-27T22:30:55.603 INFO:teuthology.orchestra.run.smithi154.stdout:(2/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 57 kB/s | 14 kB 00:00 2023-11-27T22:30:55.812 INFO:teuthology.orchestra.run.smithi154.stdout:(3/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 58 kB/s | 13 kB 00:00 2023-11-27T22:30:55.837 INFO:teuthology.orchestra.run.smithi154.stdout:(4/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 63 kB/s | 15 kB 00:00 2023-11-27T22:30:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:(5/33): fio-3.35-1.el9.x86_64.rpm 9.1 MB/s | 6.2 MB 00:00 2023-11-27T22:30:56.063 INFO:teuthology.orchestra.run.smithi154.stdout:(6/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 87 kB/s | 20 kB 00:00 2023-11-27T22:30:56.088 INFO:teuthology.orchestra.run.smithi154.stdout:(7/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 60 kB/s | 15 kB 00:00 2023-11-27T22:30:56.113 INFO:teuthology.orchestra.run.smithi154.stdout:(8/33): libcap-devel-2.48-9.el9.x86_64.rpm 439 kB/s | 33 kB 00:00 2023-11-27T22:30:56.138 INFO:teuthology.orchestra.run.smithi154.stdout:(9/33): libnbd-1.18.1-2.el9.x86_64.rpm 2.1 MB/s | 164 kB 00:00 2023-11-27T22:30:56.155 INFO:teuthology.orchestra.run.smithi154.stdout:(10/33): udftools-2.2-5.el9.x86_64.rpm 3.4 MB/s | 144 kB 00:00 2023-11-27T22:30:56.189 INFO:teuthology.orchestra.run.smithi154.stdout:(11/33): sqlite-3.34.1-6.el9.x86_64.rpm 9.7 MB/s | 747 kB 00:00 2023-11-27T22:30:56.214 INFO:teuthology.orchestra.run.smithi154.stdout:(12/33): rmt-1.6-6.el9.x86_64.rpm 607 kB/s | 45 kB 00:00 2023-11-27T22:30:56.589 INFO:teuthology.orchestra.run.smithi154.stdout:(13/33): gdbm-devel-1.19-4.el9.x86_64.rpm 156 kB/s | 59 kB 00:00 2023-11-27T22:30:56.690 INFO:teuthology.orchestra.run.smithi154.stdout:(14/33): gdbm-1.19-4.el9.x86_64.rpm 278 kB/s | 132 kB 00:00 2023-11-27T22:30:56.715 INFO:teuthology.orchestra.run.smithi154.stdout:(15/33): dump-0.4-0.51.b47.el9.x86_64.rpm 702 kB/s | 88 kB 00:00 2023-11-27T22:30:56.832 INFO:teuthology.orchestra.run.smithi154.stdout:(16/33): indent-2.2.13-4.el9.x86_64.rpm 1.2 MB/s | 179 kB 00:00 2023-11-27T22:30:57.032 INFO:teuthology.orchestra.run.smithi154.stdout:(17/33): cpp-11.4.1-2.3.el9.x86_64.rpm 34 MB/s | 11 MB 00:00 2023-11-27T22:30:57.957 INFO:teuthology.orchestra.run.smithi154.stdout:(18/33): gcc-11.4.1-2.3.el9.x86_64.rpm 29 MB/s | 32 MB 00:01 2023-11-27T22:30:58.108 INFO:teuthology.orchestra.run.smithi154.stdout:(19/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 13 MB 00:01 2023-11-27T22:30:58.133 INFO:teuthology.orchestra.run.smithi154.stdout:(20/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 270 kB/s | 47 kB 00:00 2023-11-27T22:30:58.208 INFO:teuthology.orchestra.run.smithi154.stdout:(21/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 22 MB/s | 2.2 MB 00:00 2023-11-27T22:30:58.233 INFO:teuthology.orchestra.run.smithi154.stdout:(22/33): python-unversioned-command-3.9.18-1.el 89 kB/s | 8.8 kB 00:00 2023-11-27T22:30:58.300 INFO:teuthology.orchestra.run.smithi154.stdout:(23/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2023-11-27T22:30:58.326 INFO:teuthology.orchestra.run.smithi154.stdout:(24/33): python3-devel-3.9.18-1.el9.x86_64.rpm 2.2 MB/s | 204 kB 00:00 2023-11-27T22:30:58.351 INFO:teuthology.orchestra.run.smithi154.stdout:(25/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2023-11-27T22:30:58.376 INFO:teuthology.orchestra.run.smithi154.stdout:(26/33): libcom_err-1.46.5-4.el9.x86_64.rpm 500 kB/s | 25 kB 00:00 2023-11-27T22:30:58.402 INFO:teuthology.orchestra.run.smithi154.stdout:(27/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.8 MB/s | 92 kB 00:00 2023-11-27T22:30:58.426 INFO:teuthology.orchestra.run.smithi154.stdout:(28/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 5.2 MB/s | 268 kB 00:00 2023-11-27T22:30:58.452 INFO:teuthology.orchestra.run.smithi154.stdout:(29/33): libss-1.46.5-4.el9.x86_64.rpm 615 kB/s | 31 kB 00:00 2023-11-27T22:30:58.485 INFO:teuthology.orchestra.run.smithi154.stdout:(30/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 735 kB 00:00 2023-11-27T22:30:58.511 INFO:teuthology.orchestra.run.smithi154.stdout:(31/33): python3-3.9.18-1.el9.x86_64.rpm 446 kB/s | 26 kB 00:00 2023-11-27T22:30:58.728 INFO:teuthology.orchestra.run.smithi154.stdout:(32/33): python3-libs-3.9.18-1.el9.x86_64.rpm 30 MB/s | 7.3 MB 00:00 2023-11-27T22:30:59.628 INFO:teuthology.orchestra.run.smithi154.stdout:(33/33): kernel-devel-5.14.0-386.el9.x86_64.rpm 6.0 MB/s | 21 MB 00:03 2023-11-27T22:30:59.631 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-11-27T22:30:59.631 INFO:teuthology.orchestra.run.smithi154.stdout:Total 21 MB/s | 96 MB 00:04 2023-11-27T22:30:59.844 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-11-27T22:31:00.101 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-11-27T22:31:00.101 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-11-27T22:31:01.188 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-11-27T22:31:01.188 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-11-27T22:31:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-11-27T22:31:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-11-27T22:31:03.412 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-11-27T22:31:03.515 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-11-27T22:31:03.578 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-11-27T22:31:04.151 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-11-27T22:31:04.229 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-11-27T22:31:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-11-27T22:31:05.698 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-11-27T22:31:05.737 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-11-27T22:31:05.775 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-11-27T22:31:06.158 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-11-27T22:31:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-11-27T22:31:07.334 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-11-27T22:31:07.377 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-11-27T22:31:07.414 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-11-27T22:31:07.450 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rmt-2:1.6-6.el9.x86_64 14/49 2023-11-27T22:31:07.479 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libnbd-1.18.1-2.el9.x86_64 15/49 2023-11-27T22:31:07.504 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 16/49 2023-11-27T22:31:07.529 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 17/49 2023-11-27T22:31:07.555 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 18/49 2023-11-27T22:31:07.580 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 19/49 2023-11-27T22:31:07.606 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 20/49 2023-11-27T22:31:07.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 21/49 2023-11-27T22:31:07.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fio-3.35-1.el9.x86_64 22/49 2023-11-27T22:31:07.818 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-11-27T22:31:09.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:09.099 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:16.980 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-11-27T22:31:17.192 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : kernel-devel-5.14.0-386.el9.x86_64 25/49 2023-11-27T22:31:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: kernel-devel-5.14.0-386.el9.x86_64 25/49 2023-11-27T22:31:27.616 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-11-27T22:31:27.648 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-11-27T22:31:27.745 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-11-27T22:31:27.867 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-11-27T22:31:28.009 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-11-27T22:31:28.084 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-11-27T22:31:28.236 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-11-27T22:31:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-11-27T22:31:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-11-27T22:31:28.384 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-11-27T22:31:28.412 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-11-27T22:31:28.443 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-11-27T22:31:28.468 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-11-27T22:31:28.493 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-11-27T22:31:28.493 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-11-27T22:31:28.540 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-11-27T22:31:28.578 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-11-27T22:31:28.603 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-11-27T22:31:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-11-27T22:31:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-11-27T22:31:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-11-27T22:31:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-11-27T22:31:28.798 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-11-27T22:31:28.823 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-11-27T22:31:28.848 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-11-27T22:31:28.908 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-11-27T22:31:29.001 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-27T22:31:31.193 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-27T22:31:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-11-27T22:31:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-11-27T22:31:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-11-27T22:31:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-11-27T22:31:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-11-27T22:31:31.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-11-27T22:31:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-11-27T22:31:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/49 2023-11-27T22:31:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libnbd-1.18.1-2.el9.x86_64 9/49 2023-11-27T22:31:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 10/49 2023-11-27T22:31:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : udftools-2.2-5.el9.x86_64 11/49 2023-11-27T22:31:31.195 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 12/49 2023-11-27T22:31:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : kernel-devel-5.14.0-386.el9.x86_64 13/49 2023-11-27T22:31:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-11-27T22:31:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-11-27T22:31:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-11-27T22:31:31.196 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-11-27T22:31:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-11-27T22:31:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-11-27T22:31:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-11-27T22:31:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-11-27T22:31:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-11-27T22:31:31.197 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-11-27T22:31:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-11-27T22:31:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-11-27T22:31:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-11-27T22:31:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-11-27T22:31:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-11-27T22:31:31.198 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-11-27T22:31:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-11-27T22:31:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-11-27T22:31:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-11-27T22:31:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-11-27T22:31:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-11-27T22:31:31.199 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-11-27T22:31:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-11-27T22:31:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-11-27T22:31:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-11-27T22:31:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-11-27T22:31:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-11-27T22:31:31.200 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-11-27T22:31:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-11-27T22:31:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-11-27T22:31:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-11-27T22:31:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-11-27T22:31:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-11-27T22:31:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-11-27T22:31:31.202 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.103 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: libss-1.46.5-4.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: python3-3.9.18-1.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-11-27T22:31:32.104 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-386.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-2.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: udftools-2.2-5.el9.x86_64 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:31:32.105 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-11-27T22:31:32.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo useradd -m fsgqa 2023-11-27T22:31:32.821 INFO:teuthology.orchestra.run.smithi154.stderr:useradd: user 'fsgqa' already exists 2023-11-27T22:31:32.822 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-27T22:31:32.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo groupadd fsgqa 2023-11-27T22:31:32.890 INFO:teuthology.orchestra.run.smithi154.stderr:groupadd: group 'fsgqa' already exists 2023-11-27T22:31:32.891 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-27T22:31:32.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo useradd fsgqa2 2023-11-27T22:31:33.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo useradd 123456-fsgqa 2023-11-27T22:31:34.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-27T22:31:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.439+0000 7f93da8e7640 1 Processor -- start 2023-11-27T22:31:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.439+0000 7f93da8e7640 1 -- start start 2023-11-27T22:31:34.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93da8e7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93da8e7640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93d40b4370 0x7f93d40b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93da8e7640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d4071770 con 0x7f93d40ceb70 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93da8e7640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40b4d20 con 0x7f93d40b4370 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93da8e7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40ccb60 con 0x7f93d4144980 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93d40b4370 0x7f93d40b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f93d40b4370 0x7f93d40b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36972/0 (socket says 172.21.15.154:36972) 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 -- 172.21.15.154:0/521599969 learned_addr learned my addr 172.21.15.154:0/521599969 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 -- 172.21.15.154:0/521599969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 msgr2=0x7f93d415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:31:34.445 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 --2- 172.21.15.154:0/521599969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 -- 172.21.15.154:0/521599969 >> v1:172.21.15.194:6789/0 conn(0x7f93d40ceb70 legacy=0x7f93d40cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.440+0000 7f93d8e84640 1 -- 172.21.15.154:0/521599969 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40ccdc0 con 0x7f93d40b4370 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.441+0000 7f93d8e84640 1 --2- 172.21.15.154:0/521599969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40b4370 0x7f93d40b47e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009e50 tx=0x7f93cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8f80459c215052 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.441+0000 7f93d2ffd640 1 -- 172.21.15.154:0/521599969 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc02ca70 con 0x7f93d40b4370 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.441+0000 7f93d2ffd640 1 -- 172.21.15.154:0/521599969 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc02cbd0 con 0x7f93d40b4370 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.441+0000 7f93d2ffd640 1 -- 172.21.15.154:0/521599969 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0343f0 con 0x7f93d40b4370 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 -- 172.21.15.154:0/521599969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40b4370 msgr2=0x7f93d40b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.446 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 --2- 172.21.15.154:0/521599969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40b4370 0x7f93d40b47e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009e50 tx=0x7f93cc02bed0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 -- 172.21.15.154:0/521599969 shutdown_connections 2023-11-27T22:31:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 --2- 172.21.15.154:0/521599969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40b4370 0x7f93d40b47e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 --2- 172.21.15.154:0/521599969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 -- 172.21.15.154:0/521599969 >> 172.21.15.154:0/521599969 conn(0x7f93d406a4d0 msgr2=0x7f93d406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:31:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 -- 172.21.15.154:0/521599969 shutdown_connections 2023-11-27T22:31:34.447 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.442+0000 7f93da8e7640 1 -- 172.21.15.154:0/521599969 wait complete. 2023-11-27T22:31:34.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.443+0000 7f93da8e7640 1 Processor -- start 2023-11-27T22:31:34.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.443+0000 7f93da8e7640 1 -- start start 2023-11-27T22:31:34.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93da8e7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40b4370 0x7f93d4140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93da8e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 0x7f93d40b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.450 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93da8e7640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d40ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93da8e7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40b01b0 con 0x7f93d40ceb70 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93da8e7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40b0490 con 0x7f93d40b4370 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93da8e7640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40b0770 con 0x7f93d4144980 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 0x7f93d40b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 0x7f93d40b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36982/0 (socket says 172.21.15.154:36982) 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 -- 172.21.15.154:0/2789762757 learned_addr learned my addr 172.21.15.154:0/2789762757 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d8e84640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d40ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d3fff640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40b4370 0x7f93d4140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.451 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 -- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 msgr2=0x7f93d40ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d40ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 -- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40b4370 msgr2=0x7f93d4140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40b4370 0x7f93d4140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.444+0000 7f93d37fe640 1 -- 172.21.15.154:0/2789762757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009b30 con 0x7f93d40ceb70 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.445+0000 7f93d37fe640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 0x7f93d40b2160 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c400 tx=0x7f93c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.445+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8011790 con 0x7f93d40ceb70 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.445+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8011930 con 0x7f93d40ceb70 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.445+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8011ce0 con 0x7f93d40ceb70 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.445+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d40b0a50 con 0x7f93d40ceb70 2023-11-27T22:31:34.452 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.445+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d4140980 con 0x7f93d40ceb70 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.446+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4069400 con 0x7f93d40ceb70 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.446+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f93c801c460 con 0x7f93d40ceb70 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.447+0000 7f93d0ff9640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f93c006b1c0 0x7f93c006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.447+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93c8089870 con 0x7f93d40ceb70 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.447+0000 7f93d3fff640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f93c006b1c0 0x7f93c006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.447+0000 7f93d3fff640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f93c006b1c0 0x7f93c006d680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93d4157580 tx=0x7f93c4009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:31:34.453 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.451+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f93c8054650 con 0x7f93d40ceb70 2023-11-27T22:31:34.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.684+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f93d41557c0 con 0x7f93d40ceb70 2023-11-27T22:31:34.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.685+0000 7f93d0ff9640 1 -- 172.21.15.154:0/2789762757 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1289 (secure 0 0 0) 0x7f93c8057c70 con 0x7f93d40ceb70 2023-11-27T22:31:34.688 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:31:34.688 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","modified":"2023-11-27T22:28:40.318833Z","created":"2023-11-27T22:28:40.318833Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3301","nonce":0},{"type":"v1","addr":"172.21.15.194:6790","nonce":0}]},"addr":"172.21.15.194:6790/0","public_addr":"172.21.15.194:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-27T22:31:34.689 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2023-11-27T22:31:34.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f93c006b1c0 msgr2=0x7f93c006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f93c006b1c0 0x7f93c006d680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93d4157580 tx=0x7f93c4009060 comp rx=0 tx=0).stop 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 msgr2=0x7f93d40b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 0x7f93d40b2160 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c400 tx=0x7f93c800c8c0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 shutdown_connections 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f93c006b1c0 0x7f93c006d680 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d4144980 0x7f93d40ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d40ceb70 0x7f93d40b2160 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 --2- 172.21.15.154:0/2789762757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40b4370 0x7f93d4140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 >> 172.21.15.154:0/2789762757 conn(0x7f93d406a4d0 msgr2=0x7f93d415e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 shutdown_connections 2023-11-27T22:31:34.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.687+0000 7f93da8e7640 1 -- 172.21.15.154:0/2789762757 wait complete. 2023-11-27T22:31:34.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-11-27T22:31:34.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.800+0000 7f5a257b6640 1 Processor -- start 2023-11-27T22:31:34.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.800+0000 7f5a257b6640 1 -- start start 2023-11-27T22:31:34.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a257b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a2006f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a257b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5a2015b5e0 0x7f5a2015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.804 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a257b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a2006a4d0 0x7f5a2006a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a257b6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2006ee30 con 0x7f5a2006a4d0 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a257b6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a20155b70 con 0x7f5a2015b5e0 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a257b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2006ae60 con 0x7f5a20155790 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a2006a4d0 0x7f5a2006a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5a2006a4d0 0x7f5a2006a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:36992/0 (socket says 172.21.15.154:36992) 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 -- 172.21.15.154:0/841873052 learned_addr learned my addr 172.21.15.154:0/841873052 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1e7fc640 1 --2- 172.21.15.154:0/841873052 >> v2:172.21.15.194:3300/0 conn(0x7f5a2015b5e0 0x7f5a2015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1effd640 1 --2- 172.21.15.154:0/841873052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a2006f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 -- 172.21.15.154:0/841873052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 msgr2=0x7f5a2006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 --2- 172.21.15.154:0/841873052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a2006f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.805 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 -- 172.21.15.154:0/841873052 >> v2:172.21.15.194:3300/0 conn(0x7f5a2015b5e0 msgr2=0x7f5a2015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T22:31:34.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 --2- 172.21.15.154:0/841873052 >> v2:172.21.15.194:3300/0 conn(0x7f5a2015b5e0 0x7f5a2015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1f7fe640 1 -- 172.21.15.154:0/841873052 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2006f3b0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.801+0000 7f5a1e7fc640 1 --2- 172.21.15.154:0/841873052 >> v2:172.21.15.194:3300/0 conn(0x7f5a2015b5e0 0x7f5a2015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:31:34.806 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.802+0000 7f5a1f7fe640 1 --2- 172.21.15.154:0/841873052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a2006a920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a2006e630 tx=0x7f5a1802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d06f5e613d97e90 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:31:34.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.802+0000 7f5a1dffb640 1 -- 172.21.15.154:0/841873052 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18031870 con 0x7f5a2006a4d0 2023-11-27T22:31:34.809 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.802+0000 7f5a1dffb640 1 -- 172.21.15.154:0/841873052 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a180319d0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.802+0000 7f5a1dffb640 1 -- 172.21.15.154:0/841873052 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18031d60 con 0x7f5a2006a4d0 2023-11-27T22:31:34.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 -- 172.21.15.154:0/841873052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 msgr2=0x7f5a2006a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.810 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 --2- 172.21.15.154:0/841873052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a2006a920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5a2006e630 tx=0x7f5a1802b910 comp rx=0 tx=0).stop 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 -- 172.21.15.154:0/841873052 shutdown_connections 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 --2- 172.21.15.154:0/841873052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a2006a920 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 --2- 172.21.15.154:0/841873052 >> v2:172.21.15.194:3300/0 conn(0x7f5a2015b5e0 0x7f5a2015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 --2- 172.21.15.154:0/841873052 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a2006f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 -- 172.21.15.154:0/841873052 >> 172.21.15.154:0/841873052 conn(0x7f5a200b1e50 msgr2=0x7f5a200b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 -- 172.21.15.154:0/841873052 shutdown_connections 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.803+0000 7f5a257b6640 1 -- 172.21.15.154:0/841873052 wait complete. 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.804+0000 7f5a257b6640 1 Processor -- start 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.804+0000 7f5a257b6640 1 -- start start 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a257b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a20153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a257b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a20157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a257b6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a2015b5e0 0x7f5a201577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.811 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a257b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20158ab0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a257b6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20156000 con 0x7f5a2015b5e0 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a257b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20157e30 con 0x7f5a20155790 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a20153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a20153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37000/0 (socket says 172.21.15.154:37000) 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 -- 172.21.15.154:0/4183664599 learned_addr learned my addr 172.21.15.154:0/4183664599 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1f7fe640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a2015b5e0 0x7f5a201577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1e7fc640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a20157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 -- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 msgr2=0x7f5a20157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a20157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 -- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a2015b5e0 msgr2=0x7f5a201577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a2015b5e0 0x7f5a201577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:34.812 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 -- 172.21.15.154:0/4183664599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a180094d0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1e7fc640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a20157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.805+0000 7f5a1effd640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a20153730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5a10007e60 tx=0x7f5a1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.806+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10014620 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.806+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1000ee90 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.806+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20158110 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.806+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100149c0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.806+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a201586d0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.807+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a20158860 con 0x7f5a2006a4d0 2023-11-27T22:31:34.813 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.807+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f5a10014b20 con 0x7f5a2006a4d0 2023-11-27T22:31:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.807+0000 7f5a077fe640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5a0c06b1c0 0x7f5a0c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T22:31:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.807+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a1008a2a0 con 0x7f5a2006a4d0 2023-11-27T22:31:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.807+0000 7f5a1e7fc640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5a0c06b1c0 0x7f5a0c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T22:31:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.808+0000 7f5a1e7fc640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5a0c06b1c0 0x7f5a0c06d680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a200ce8a0 tx=0x7f5a14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T22:31:34.814 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:34.812+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f5a10054fd0 con 0x7f5a2006a4d0 2023-11-27T22:31:35.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.041+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f5a20069400 con 0x7f5a2006a4d0 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.041+0000 7f5a077fe640 1 -- 172.21.15.154:0/4183664599 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v15) v1 ==== 82+0+151 (secure 0 0 0) 0x7f5a10009a20 con 0x7f5a2006a4d0 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stdout:[client.admin] 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAYGGVla6hCHhAAlFKYvm/VRCu+mbtcGVfkrQ== 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stdout: caps mds = "allow *" 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stdout: caps mgr = "allow *" 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stdout: caps mon = "allow *" 2023-11-27T22:31:35.044 INFO:teuthology.orchestra.run.smithi154.stdout: caps osd = "allow *" 2023-11-27T22:31:35.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5a0c06b1c0 msgr2=0x7f5a0c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5a0c06b1c0 0x7f5a0c06d680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5a200ce8a0 tx=0x7f5a14008040 comp rx=0 tx=0).stop 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 msgr2=0x7f5a20153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a20153730 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5a10007e60 tx=0x7f5a1000e4b0 comp rx=0 tx=0).stop 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 shutdown_connections 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a2015b5e0 0x7f5a201577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f5a0c06b1c0 0x7f5a0c06d680 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a20155790 0x7f5a20157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 --2- 172.21.15.154:0/4183664599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a2006a4d0 0x7f5a20153730 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 >> 172.21.15.154:0/4183664599 conn(0x7f5a200b1e50 msgr2=0x7f5a2006f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 shutdown_connections 2023-11-27T22:31:35.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-27T22:31:35.043+0000 7f5a257b6640 1 -- 172.21.15.154:0/4183664599 wait complete. 2023-11-27T22:31:35.057 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-11-27T22:31:35.071 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.f8UrqOpRt1 2023-11-27T22:31:35.072 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:31:35.072 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/tmp/tmp.f8UrqOpRt1 2023-11-27T22:31:35.126 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:31:35.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/tmp/tmp.1EbDOAX7rXxfstests-dev/local.config 2023-11-27T22:31:35.194 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.0kYt7WHchItest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.TVl9XwHeYtscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.154:6789 -k /tmp/tmp.f8UrqOpRt1 --client_mountpoint /test" 2023-11-27T22:31:35.194 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-27T22:31:35.195 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/tmp/tmp.1EbDOAX7rXxfstests-dev/ceph.exclude 2023-11-27T22:31:35.260 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo make) 2023-11-27T22:31:35.352 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize -cfi 2023-11-27T22:31:35.756 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-27T22:31:35.756 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './config.guess' 2023-11-27T22:31:35.760 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './config.sub' 2023-11-27T22:31:35.763 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './install-sh' 2023-11-27T22:31:35.767 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file './ltmain.sh' 2023-11-27T22:31:35.789 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-27T22:31:35.789 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-27T22:31:35.793 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-27T22:31:35.798 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-27T22:31:35.802 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-27T22:31:35.807 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-27T22:31:35.813 INFO:teuthology.orchestra.run.smithi154.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-27T22:31:35.814 INFO:teuthology.orchestra.run.smithi154.stdout:cp include/install-sh . 2023-11-27T22:31:35.815 INFO:teuthology.orchestra.run.smithi154.stdout:aclocal -I m4 2023-11-27T22:31:36.839 INFO:teuthology.orchestra.run.smithi154.stdout:autoheader 2023-11-27T22:31:37.123 INFO:teuthology.orchestra.run.smithi154.stdout:autoconf 2023-11-27T22:31:37.290 INFO:teuthology.orchestra.run.smithi154.stdout:./configure \ 2023-11-27T22:31:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: --libexecdir=/usr/lib \ 2023-11-27T22:31:37.291 INFO:teuthology.orchestra.run.smithi154.stdout: --exec_prefix=/var/lib 2023-11-27T22:31:37.481 INFO:teuthology.orchestra.run.smithi154.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-27T22:31:37.482 INFO:teuthology.orchestra.run.smithi154.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-27T22:31:37.482 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to print strings... printf 2023-11-27T22:31:37.482 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc... gcc 2023-11-27T22:31:37.542 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether the C compiler works... yes 2023-11-27T22:31:37.542 INFO:teuthology.orchestra.run.smithi154.stdout:checking for C compiler default output file name... a.out 2023-11-27T22:31:37.570 INFO:teuthology.orchestra.run.smithi154.stdout:checking for suffix of executables... 2023-11-27T22:31:37.621 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether we are cross compiling... no 2023-11-27T22:31:37.638 INFO:teuthology.orchestra.run.smithi154.stdout:checking for suffix of object files... o 2023-11-27T22:31:37.653 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether we are using the GNU C compiler... yes 2023-11-27T22:31:37.669 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether gcc accepts -g... yes 2023-11-27T22:31:37.695 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc option to accept ISO C89... none needed 2023-11-27T22:31:37.697 INFO:teuthology.orchestra.run.smithi154.stdout:checking for a sed that does not truncate output... /bin/sed 2023-11-27T22:31:37.699 INFO:teuthology.orchestra.run.smithi154.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-11-27T22:31:37.701 INFO:teuthology.orchestra.run.smithi154.stdout:checking for egrep... /bin/grep -E 2023-11-27T22:31:37.702 INFO:teuthology.orchestra.run.smithi154.stdout:checking for fgrep... /bin/grep -F 2023-11-27T22:31:37.705 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ld used by gcc... /bin/ld 2023-11-27T22:31:37.706 INFO:teuthology.orchestra.run.smithi154.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-11-27T22:31:37.717 INFO:teuthology.orchestra.run.smithi154.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-11-27T22:31:38.638 INFO:teuthology.orchestra.run.smithi154.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-11-27T22:31:38.638 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether ln -s works... yes 2023-11-27T22:31:38.658 INFO:teuthology.orchestra.run.smithi154.stdout:checking the maximum length of command line arguments... 1572864 2023-11-27T22:31:38.661 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking for /bin/ld option to reload object files... -r 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking for objdump... objdump 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to recognize dependent libraries... pass_all 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dlltool... no 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-27T22:31:38.662 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ar... ar 2023-11-27T22:31:38.706 INFO:teuthology.orchestra.run.smithi154.stdout:checking for archiver @FILE support... @ 2023-11-27T22:31:38.706 INFO:teuthology.orchestra.run.smithi154.stdout:checking for strip... strip 2023-11-27T22:31:38.706 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ranlib... ranlib 2023-11-27T22:31:38.706 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gawk... gawk 2023-11-27T22:31:38.771 INFO:teuthology.orchestra.run.smithi154.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-11-27T22:31:38.772 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sysroot... no 2023-11-27T22:31:38.775 INFO:teuthology.orchestra.run.smithi154.stdout:checking for a working dd... /bin/dd 2023-11-27T22:31:38.777 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-11-27T22:31:38.791 INFO:teuthology.orchestra.run.smithi154.stdout:checking for mt... no 2023-11-27T22:31:38.792 INFO:teuthology.orchestra.run.smithi154.stdout:checking if : is a manifest tool... no 2023-11-27T22:31:38.834 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to run the C preprocessor... gcc -E 2023-11-27T22:31:39.005 INFO:teuthology.orchestra.run.smithi154.stdout:checking for ANSI C header files... yes 2023-11-27T22:31:39.025 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/types.h... yes 2023-11-27T22:31:39.058 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/stat.h... yes 2023-11-27T22:31:39.081 INFO:teuthology.orchestra.run.smithi154.stdout:checking for stdlib.h... yes 2023-11-27T22:31:39.105 INFO:teuthology.orchestra.run.smithi154.stdout:checking for string.h... yes 2023-11-27T22:31:39.134 INFO:teuthology.orchestra.run.smithi154.stdout:checking for memory.h... yes 2023-11-27T22:31:39.158 INFO:teuthology.orchestra.run.smithi154.stdout:checking for strings.h... yes 2023-11-27T22:31:39.187 INFO:teuthology.orchestra.run.smithi154.stdout:checking for inttypes.h... yes 2023-11-27T22:31:39.212 INFO:teuthology.orchestra.run.smithi154.stdout:checking for stdint.h... yes 2023-11-27T22:31:39.246 INFO:teuthology.orchestra.run.smithi154.stdout:checking for unistd.h... yes 2023-11-27T22:31:39.276 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dlfcn.h... yes 2023-11-27T22:31:39.279 INFO:teuthology.orchestra.run.smithi154.stdout:checking for objdir... .libs 2023-11-27T22:31:39.340 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-27T22:31:39.341 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-27T22:31:39.355 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-27T22:31:39.372 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc static flag -static works... no 2023-11-27T22:31:39.392 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc supports -c -o file.o... yes 2023-11-27T22:31:39.393 INFO:teuthology.orchestra.run.smithi154.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-27T22:31:39.399 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-27T22:31:39.424 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether -lc should be explicitly linked in... no 2023-11-27T22:31:39.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:39.447 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:39.479 INFO:teuthology.orchestra.run.smithi154.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-27T22:31:39.479 INFO:teuthology.orchestra.run.smithi154.stdout:checking how to hardcode library paths into programs... immediate 2023-11-27T22:31:39.480 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether stripping libraries is possible... yes 2023-11-27T22:31:39.480 INFO:teuthology.orchestra.run.smithi154.stdout:checking if libtool supports shared libraries... yes 2023-11-27T22:31:39.480 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether to build shared libraries... yes 2023-11-27T22:31:39.480 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether to build static libraries... yes 2023-11-27T22:31:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc... (cached) gcc 2023-11-27T22:31:39.501 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-11-27T22:31:39.501 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-27T22:31:39.501 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-11-27T22:31:39.501 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gmake... /usr/bin/gmake 2023-11-27T22:31:39.501 INFO:teuthology.orchestra.run.smithi154.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-11-27T22:31:39.502 INFO:teuthology.orchestra.run.smithi154.stdout:checking for tar... /bin/tar 2023-11-27T22:31:39.502 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gzip... /bin/gzip 2023-11-27T22:31:39.509 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether gcc -MM is supported... yes 2023-11-27T22:31:39.511 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sort... /bin/sort 2023-11-27T22:31:39.511 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether ln -s works... yes 2023-11-27T22:31:39.511 INFO:teuthology.orchestra.run.smithi154.stdout:checking for rpm... /bin/rpm 2023-11-27T22:31:39.513 INFO:teuthology.orchestra.run.smithi154.stdout:checking for rpmbuild... no 2023-11-27T22:31:39.538 INFO:teuthology.orchestra.run.smithi154.stdout:checking assert.h usability... yes 2023-11-27T22:31:39.546 INFO:teuthology.orchestra.run.smithi154.stdout:checking assert.h presence... yes 2023-11-27T22:31:39.546 INFO:teuthology.orchestra.run.smithi154.stdout:checking for assert.h... yes 2023-11-27T22:31:39.572 INFO:teuthology.orchestra.run.smithi154.stdout:checking bstring.h usability... no 2023-11-27T22:31:39.583 INFO:teuthology.orchestra.run.smithi154.stdout:checking bstring.h presence... no 2023-11-27T22:31:39.583 INFO:teuthology.orchestra.run.smithi154.stdout:checking for bstring.h... no 2023-11-27T22:31:39.608 INFO:teuthology.orchestra.run.smithi154.stdout:checking libgen.h usability... yes 2023-11-27T22:31:39.616 INFO:teuthology.orchestra.run.smithi154.stdout:checking libgen.h presence... yes 2023-11-27T22:31:39.616 INFO:teuthology.orchestra.run.smithi154.stdout:checking for libgen.h... yes 2023-11-27T22:31:39.649 INFO:teuthology.orchestra.run.smithi154.stdout:checking dirent.h usability... yes 2023-11-27T22:31:39.658 INFO:teuthology.orchestra.run.smithi154.stdout:checking dirent.h presence... yes 2023-11-27T22:31:39.658 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dirent.h... yes 2023-11-27T22:31:39.707 INFO:teuthology.orchestra.run.smithi154.stdout:checking errno.h usability... yes 2023-11-27T22:31:39.715 INFO:teuthology.orchestra.run.smithi154.stdout:checking errno.h presence... yes 2023-11-27T22:31:39.716 INFO:teuthology.orchestra.run.smithi154.stdout:checking for errno.h... yes 2023-11-27T22:31:39.749 INFO:teuthology.orchestra.run.smithi154.stdout:checking malloc.h usability... yes 2023-11-27T22:31:39.759 INFO:teuthology.orchestra.run.smithi154.stdout:checking malloc.h presence... yes 2023-11-27T22:31:39.759 INFO:teuthology.orchestra.run.smithi154.stdout:checking for malloc.h... yes 2023-11-27T22:31:39.786 INFO:teuthology.orchestra.run.smithi154.stdout:checking uuid.h usability... no 2023-11-27T22:31:39.797 INFO:teuthology.orchestra.run.smithi154.stdout:checking uuid.h presence... no 2023-11-27T22:31:39.798 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid.h... no 2023-11-27T22:31:39.836 INFO:teuthology.orchestra.run.smithi154.stdout:checking uuid/uuid.h usability... yes 2023-11-27T22:31:39.846 INFO:teuthology.orchestra.run.smithi154.stdout:checking uuid/uuid.h presence... yes 2023-11-27T22:31:39.846 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid/uuid.h... yes 2023-11-27T22:31:39.874 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/uuid.h usability... no 2023-11-27T22:31:39.884 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/uuid.h presence... no 2023-11-27T22:31:39.885 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/uuid.h... no 2023-11-27T22:31:39.911 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/file.h usability... yes 2023-11-27T22:31:39.920 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/file.h presence... yes 2023-11-27T22:31:39.920 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/file.h... yes 2023-11-27T22:31:39.951 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/fcntl.h usability... yes 2023-11-27T22:31:39.960 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/fcntl.h presence... yes 2023-11-27T22:31:39.960 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/fcntl.h... yes 2023-11-27T22:31:39.987 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/syssgi.h usability... no 2023-11-27T22:31:39.998 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/syssgi.h presence... no 2023-11-27T22:31:39.998 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/syssgi.h... no 2023-11-27T22:31:40.046 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/param.h usability... yes 2023-11-27T22:31:40.057 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/param.h presence... yes 2023-11-27T22:31:40.057 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/param.h... yes 2023-11-27T22:31:40.061 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/stat.h... (cached) yes 2023-11-27T22:31:40.089 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/statvfs.h usability... yes 2023-11-27T22:31:40.097 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/statvfs.h presence... yes 2023-11-27T22:31:40.098 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/statvfs.h... yes 2023-11-27T22:31:40.125 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/time.h usability... yes 2023-11-27T22:31:40.134 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/time.h presence... yes 2023-11-27T22:31:40.134 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/time.h... yes 2023-11-27T22:31:40.171 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/ioctl.h usability... yes 2023-11-27T22:31:40.180 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/ioctl.h presence... yes 2023-11-27T22:31:40.181 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/ioctl.h... yes 2023-11-27T22:31:40.216 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/wait.h usability... yes 2023-11-27T22:31:40.227 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/wait.h presence... yes 2023-11-27T22:31:40.227 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/wait.h... yes 2023-11-27T22:31:40.231 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/types.h... (cached) yes 2023-11-27T22:31:40.235 INFO:teuthology.orchestra.run.smithi154.stdout:checking for strings.h... (cached) yes 2023-11-27T22:31:40.262 INFO:teuthology.orchestra.run.smithi154.stdout:checking err.h usability... yes 2023-11-27T22:31:40.270 INFO:teuthology.orchestra.run.smithi154.stdout:checking err.h presence... yes 2023-11-27T22:31:40.270 INFO:teuthology.orchestra.run.smithi154.stdout:checking for err.h... yes 2023-11-27T22:31:40.298 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/falloc.h usability... yes 2023-11-27T22:31:40.305 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/falloc.h presence... yes 2023-11-27T22:31:40.305 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/falloc.h... yes 2023-11-27T22:31:40.332 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-11-27T22:31:40.342 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-11-27T22:31:40.342 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-27T22:31:40.366 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/fs/xfs_itable.h usability... no 2023-11-27T22:31:40.377 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/fs/xfs_itable.h presence... no 2023-11-27T22:31:40.377 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-27T22:31:40.400 INFO:teuthology.orchestra.run.smithi154.stdout:checking xfs/platform_defs.h usability... no 2023-11-27T22:31:40.411 INFO:teuthology.orchestra.run.smithi154.stdout:checking xfs/platform_defs.h presence... no 2023-11-27T22:31:40.411 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/platform_defs.h... no 2023-11-27T22:31:40.435 INFO:teuthology.orchestra.run.smithi154.stdout:checking btrfs/ioctl.h usability... no 2023-11-27T22:31:40.445 INFO:teuthology.orchestra.run.smithi154.stdout:checking btrfs/ioctl.h presence... no 2023-11-27T22:31:40.446 INFO:teuthology.orchestra.run.smithi154.stdout:checking for btrfs/ioctl.h... no 2023-11-27T22:31:40.469 INFO:teuthology.orchestra.run.smithi154.stdout:checking cifs/ioctl.h usability... no 2023-11-27T22:31:40.480 INFO:teuthology.orchestra.run.smithi154.stdout:checking cifs/ioctl.h presence... no 2023-11-27T22:31:40.480 INFO:teuthology.orchestra.run.smithi154.stdout:checking for cifs/ioctl.h... no 2023-11-27T22:31:40.506 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/mman.h usability... yes 2023-11-27T22:31:40.515 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/mman.h presence... yes 2023-11-27T22:31:40.515 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/mman.h... yes 2023-11-27T22:31:40.530 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/xfs_log_format.h... no 2023-11-27T22:31:40.564 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid_compare... no 2023-11-27T22:31:40.594 INFO:teuthology.orchestra.run.smithi154.stdout:checking for uuid_compare in -luuid... yes 2023-11-27T22:31:40.672 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/xfs.h... yes 2023-11-27T22:31:40.684 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/libxfs.h... no 2023-11-27T22:31:40.698 INFO:teuthology.orchestra.run.smithi154.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-27T22:31:40.727 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/xqm.h... yes 2023-11-27T22:31:40.775 INFO:teuthology.orchestra.run.smithi154.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-27T22:31:40.799 INFO:teuthology.orchestra.run.smithi154.stdout:checking xfs/handle.h usability... yes 2023-11-27T22:31:40.806 INFO:teuthology.orchestra.run.smithi154.stdout:checking xfs/handle.h presence... yes 2023-11-27T22:31:40.807 INFO:teuthology.orchestra.run.smithi154.stdout:checking for xfs/handle.h... yes 2023-11-27T22:31:40.841 INFO:teuthology.orchestra.run.smithi154.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-27T22:31:40.864 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/acl.h usability... yes 2023-11-27T22:31:40.873 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/acl.h presence... yes 2023-11-27T22:31:40.873 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/acl.h... yes 2023-11-27T22:31:40.897 INFO:teuthology.orchestra.run.smithi154.stdout:checking acl/libacl.h usability... yes 2023-11-27T22:31:40.906 INFO:teuthology.orchestra.run.smithi154.stdout:checking acl/libacl.h presence... yes 2023-11-27T22:31:40.906 INFO:teuthology.orchestra.run.smithi154.stdout:checking for acl/libacl.h... yes 2023-11-27T22:31:40.938 INFO:teuthology.orchestra.run.smithi154.stdout:checking for acl_init in -lacl... yes 2023-11-27T22:31:40.960 INFO:teuthology.orchestra.run.smithi154.stdout:checking gdbm-ndbm.h usability... no 2023-11-27T22:31:40.971 INFO:teuthology.orchestra.run.smithi154.stdout:checking gdbm-ndbm.h presence... no 2023-11-27T22:31:40.971 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gdbm-ndbm.h... no 2023-11-27T22:31:40.994 INFO:teuthology.orchestra.run.smithi154.stdout:checking gdbm/ndbm.h usability... yes 2023-11-27T22:31:41.003 INFO:teuthology.orchestra.run.smithi154.stdout:checking gdbm/ndbm.h presence... yes 2023-11-27T22:31:41.004 INFO:teuthology.orchestra.run.smithi154.stdout:checking for gdbm/ndbm.h... yes 2023-11-27T22:31:41.037 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_open in -lgdbm... no 2023-11-27T22:31:41.071 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_fetch in -lgdbm... no 2023-11-27T22:31:41.105 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_store in -lgdbm... no 2023-11-27T22:31:41.139 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_close in -lgdbm... no 2023-11-27T22:31:41.176 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-11-27T22:31:41.206 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-11-27T22:31:41.238 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-11-27T22:31:41.270 INFO:teuthology.orchestra.run.smithi154.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-11-27T22:31:41.293 INFO:teuthology.orchestra.run.smithi154.stdout:checking libaio.h usability... yes 2023-11-27T22:31:41.304 INFO:teuthology.orchestra.run.smithi154.stdout:checking libaio.h presence... yes 2023-11-27T22:31:41.304 INFO:teuthology.orchestra.run.smithi154.stdout:checking for libaio.h... yes 2023-11-27T22:31:41.326 INFO:teuthology.orchestra.run.smithi154.stdout:checking liburing.h usability... no 2023-11-27T22:31:41.338 INFO:teuthology.orchestra.run.smithi154.stdout:checking liburing.h presence... no 2023-11-27T22:31:41.338 INFO:teuthology.orchestra.run.smithi154.stdout:checking for liburing.h... no 2023-11-27T22:31:41.368 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/capability.h usability... yes 2023-11-27T22:31:41.378 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/capability.h presence... yes 2023-11-27T22:31:41.378 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/capability.h... yes 2023-11-27T22:31:41.402 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/fiemap.h usability... yes 2023-11-27T22:31:41.410 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/fiemap.h presence... yes 2023-11-27T22:31:41.410 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/fiemap.h... yes 2023-11-27T22:31:41.443 INFO:teuthology.orchestra.run.smithi154.stdout:checking for fallocate... yes 2023-11-27T22:31:41.477 INFO:teuthology.orchestra.run.smithi154.stdout:checking for open_by_handle_at... yes 2023-11-27T22:31:41.502 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/prctl.h usability... yes 2023-11-27T22:31:41.511 INFO:teuthology.orchestra.run.smithi154.stdout:checking sys/prctl.h presence... yes 2023-11-27T22:31:41.511 INFO:teuthology.orchestra.run.smithi154.stdout:checking for sys/prctl.h... yes 2023-11-27T22:31:41.535 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/fs.h usability... yes 2023-11-27T22:31:41.543 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/fs.h presence... yes 2023-11-27T22:31:41.543 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/fs.h... yes 2023-11-27T22:31:41.566 INFO:teuthology.orchestra.run.smithi154.stdout:checking btrfsutil.h usability... no 2023-11-27T22:31:41.577 INFO:teuthology.orchestra.run.smithi154.stdout:checking btrfsutil.h presence... no 2023-11-27T22:31:41.577 INFO:teuthology.orchestra.run.smithi154.stdout:checking for btrfsutil.h... no 2023-11-27T22:31:41.614 INFO:teuthology.orchestra.run.smithi154.stdout:checking for copy_file_range... yes 2023-11-27T22:31:41.648 INFO:teuthology.orchestra.run.smithi154.stdout:checking for SEEK_DATA... yes 2023-11-27T22:31:41.697 INFO:teuthology.orchestra.run.smithi154.stdout:checking for BMV_OF_SHARED... yes 2023-11-27T22:31:41.733 INFO:teuthology.orchestra.run.smithi154.stdout:checking for nftw... yes 2023-11-27T22:31:41.777 INFO:teuthology.orchestra.run.smithi154.stdout:checking for RLIMIT_NOFILE... yes 2023-11-27T22:31:41.795 INFO:teuthology.orchestra.run.smithi154.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-27T22:31:41.828 INFO:teuthology.orchestra.run.smithi154.stdout:checking for renameat2... yes 2023-11-27T22:31:41.862 INFO:teuthology.orchestra.run.smithi154.stdout:checking for reallocarray... yes 2023-11-27T22:31:41.892 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct mount_attr... yes 2023-11-27T22:31:41.924 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-27T22:31:41.956 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-27T22:31:41.987 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-27T22:31:42.020 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-27T22:31:42.051 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-27T22:31:42.084 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-27T22:31:42.115 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-27T22:31:42.141 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/btrfs.h usability... yes 2023-11-27T22:31:42.149 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/btrfs.h presence... yes 2023-11-27T22:31:42.150 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/btrfs.h... yes 2023-11-27T22:31:42.179 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/btrfs_tree.h usability... yes 2023-11-27T22:31:42.188 INFO:teuthology.orchestra.run.smithi154.stdout:checking linux/btrfs_tree.h presence... yes 2023-11-27T22:31:42.188 INFO:teuthology.orchestra.run.smithi154.stdout:checking for linux/btrfs_tree.h... yes 2023-11-27T22:31:42.209 INFO:teuthology.orchestra.run.smithi154.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-27T22:31:42.225 INFO:teuthology.orchestra.run.smithi154.stdout:configure: creating ./config.status 2023-11-27T22:31:42.518 INFO:teuthology.orchestra.run.smithi154.stdout:config.status: creating include/builddefs 2023-11-27T22:31:42.529 INFO:teuthology.orchestra.run.smithi154.stdout:config.status: creating include/config.h 2023-11-27T22:31:42.537 INFO:teuthology.orchestra.run.smithi154.stdout:config.status: executing libtool commands 2023-11-27T22:31:42.574 INFO:teuthology.orchestra.run.smithi154.stdout:Building include 2023-11-27T22:31:42.577 INFO:teuthology.orchestra.run.smithi154.stdout:Building lib 2023-11-27T22:31:42.580 INFO:teuthology.orchestra.run.smithi154.stdout: [LTDEP] 2023-11-27T22:31:42.714 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dataascii.lo 2023-11-27T22:31:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] databin.lo 2023-11-27T22:31:42.952 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] datapid.lo 2023-11-27T22:31:43.045 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] file_lock.lo 2023-11-27T22:31:43.179 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] forker.lo 2023-11-27T22:31:43.299 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] pattern.lo 2023-11-27T22:31:43.408 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] open_flags.lo 2023-11-27T22:31:43.534 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] random_range.lo 2023-11-27T22:31:43.741 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] string_to_tokens.lo 2023-11-27T22:31:43.834 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] str_to_bytes.lo 2023-11-27T22:31:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] tlibio.lo 2023-11-27T22:31:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] write_log.lo 2023-11-27T22:31:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] random.lo 2023-11-27T22:31:44.484 INFO:teuthology.orchestra.run.smithi154.stdout: [LD] 2023-11-27T22:31:44.564 INFO:teuthology.orchestra.run.smithi154.stdout:Building ltp 2023-11-27T22:31:44.567 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2023-11-27T22:31:44.714 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] doio 2023-11-27T22:31:45.312 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsstress 2023-11-27T22:31:46.635 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsx 2023-11-27T22:31:47.303 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] growfiles 2023-11-27T22:31:47.750 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] iogen 2023-11-27T22:31:48.084 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-stress 2023-11-27T22:31:48.467 INFO:teuthology.orchestra.run.smithi154.stdout:Building src 2023-11-27T22:31:48.473 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2023-11-27T22:31:50.126 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2023-11-27T22:31:50.155 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2023-11-27T22:31:50.162 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2023-11-27T22:31:50.369 INFO:teuthology.orchestra.run.smithi154.stdout: [DEP] 2023-11-27T22:31:50.390 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dirstress 2023-11-27T22:31:50.609 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fill 2023-11-27T22:31:50.741 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fill2 2023-11-27T22:31:50.939 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] getpagesize 2023-11-27T22:31:51.056 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] holes 2023-11-27T22:31:51.222 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] lstat64 2023-11-27T22:31:51.379 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] nametest 2023-11-27T22:31:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] permname 2023-11-27T22:31:51.760 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] randholes 2023-11-27T22:31:51.975 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] runas 2023-11-27T22:31:52.124 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] truncfile 2023-11-27T22:31:52.277 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] usemem 2023-11-27T22:31:52.406 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mmapcat 2023-11-27T22:31:52.530 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] append_reader 2023-11-27T22:31:52.658 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] append_writer 2023-11-27T22:31:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dirperf 2023-11-27T22:31:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] metaperf 2023-11-27T22:31:53.221 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] devzero 2023-11-27T22:31:53.374 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] feature 2023-11-27T22:31:53.558 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] alloc 2023-11-27T22:31:53.740 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fault 2023-11-27T22:31:53.877 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fstest 2023-11-27T22:31:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_access_root 2023-11-27T22:31:54.213 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] godown 2023-11-27T22:31:54.358 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] resvtest 2023-11-27T22:31:54.517 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] writemod 2023-11-27T22:31:54.639 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] writev_on_pagefault 2023-11-27T22:31:54.776 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] makeextents 2023-11-27T22:31:54.928 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] itrash 2023-11-27T22:31:55.057 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] rename 2023-11-27T22:31:55.174 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] multi_open_unlink 2023-11-27T22:31:55.315 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] unwritten_sync 2023-11-27T22:31:55.469 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] genhashnames 2023-11-27T22:31:55.635 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_holes 2023-11-27T22:31:55.759 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_writev 2023-11-27T22:31:55.885 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_truncate_cmtime 2023-11-27T22:31:56.020 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dirhash_collide 2023-11-27T22:31:56.176 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_rename_overwrite 2023-11-27T22:31:56.294 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] holetest 2023-11-27T22:31:56.492 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_truncate_self 2023-11-27T22:31:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] af_unix 2023-11-27T22:31:56.740 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_stale_pmd 2023-11-27T22:31:56.869 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_cow_race 2023-11-27T22:31:57.010 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_fallocate 2023-11-27T22:31:57.138 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsync-err 2023-11-27T22:31:57.296 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_write_ro 2023-11-27T22:31:57.425 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-27T22:31:57.559 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-27T22:31:57.692 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_ofd_locks 2023-11-27T22:31:57.860 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_collision 2023-11-27T22:31:58.032 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mmap-write-concurrent 2023-11-27T22:31:58.176 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_get_file_time 2023-11-27T22:31:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_create_short_dirs 2023-11-27T22:31:58.444 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_create_long_dirs 2023-11-27T22:31:58.587 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_enospc 2023-11-27T22:31:58.747 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_writev_overlap 2023-11-27T22:31:58.893 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] checkpoint_journal 2023-11-27T22:31:59.027 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mmap-rw-fault 2023-11-27T22:31:59.185 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] allocstale 2023-11-27T22:31:59.329 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_cow_memory_failure 2023-11-27T22:31:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fake-dump-rootino 2023-11-27T22:31:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dio-buf-fault 2023-11-27T22:31:59.730 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] rewinddir-test 2023-11-27T22:31:59.877 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] xfsctl 2023-11-27T22:32:00.039 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bstat 2023-11-27T22:32:00.217 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mtab 2023-11-27T22:32:00.377 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] getdevicesize 2023-11-27T22:32:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] preallo_rw_pattern_reader 2023-11-27T22:32:00.631 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] preallo_rw_pattern_writer 2023-11-27T22:32:00.766 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] ftrunc 2023-11-27T22:32:00.893 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] trunc 2023-11-27T22:32:01.031 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fs_perms 2023-11-27T22:32:01.170 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] testx 2023-11-27T22:32:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] looptest 2023-11-27T22:32:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] locktest 2023-11-27T22:32:01.720 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] unwritten_mmap 2023-11-27T22:32:01.861 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bulkstat_unlink_test 2023-11-27T22:32:02.032 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] deduperace 2023-11-27T22:32:02.198 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bulkstat_unlink_test_modified 2023-11-27T22:32:02.368 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_dir_offset 2023-11-27T22:32:02.493 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_futimens 2023-11-27T22:32:02.611 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_immutable 2023-11-27T22:32:03.170 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] stale_handle 2023-11-27T22:32:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] pwrite_mmap_blocked 2023-11-27T22:32:03.444 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_dir_offset2 2023-11-27T22:32:03.610 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] seek_sanity_test 2023-11-27T22:32:04.009 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] seek_copy_test 2023-11-27T22:32:04.159 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_readdir_1 2023-11-27T22:32:04.285 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_readdir_2 2023-11-27T22:32:04.415 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fsync-tester 2023-11-27T22:32:04.636 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] nsexec 2023-11-27T22:32:04.790 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] cloner 2023-11-27T22:32:04.942 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] renameat2 2023-11-27T22:32:05.084 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_getcwd 2023-11-27T22:32:05.220 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] e4compact 2023-11-27T22:32:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] test-nextquota 2023-11-27T22:32:05.543 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] punch-alternating 2023-11-27T22:32:05.689 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-27T22:32:05.832 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] listxattr 2023-11-27T22:32:05.958 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dio-interleaved 2023-11-27T22:32:06.096 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_dir_type 2023-11-27T22:32:06.229 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dio-invalidate-cache 2023-11-27T22:32:06.404 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] stat_test 2023-11-27T22:32:06.663 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_encrypted_d_revalidate 2023-11-27T22:32:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] attr_replace_test 2023-11-27T22:32:06.944 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] swapon 2023-11-27T22:32:07.084 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mkswap 2023-11-27T22:32:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_attr_corruption 2023-11-27T22:32:07.341 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_open_tmpfiles 2023-11-27T22:32:07.494 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fscrypt-crypt-util 2023-11-27T22:32:08.095 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] bulkstat_null_ocount 2023-11-27T22:32:08.228 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] splice-test 2023-11-27T22:32:08.383 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] chprojid_fail 2023-11-27T22:32:08.520 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] detached_mounts_propagation 2023-11-27T22:32:08.681 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] ext4_resize 2023-11-27T22:32:08.809 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_readdir_3 2023-11-27T22:32:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] splice2pipe 2023-11-27T22:32:09.117 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] uuid_ioctl 2023-11-27T22:32:09.249 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fiemap-tester 2023-11-27T22:32:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_stripealign 2023-11-27T22:32:09.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:09.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:09.612 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] open_by_handle 2023-11-27T22:32:09.834 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] dbtest 2023-11-27T22:32:10.054 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] t_mmap_dio 2023-11-27T22:32:10.191 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] xfsfind 2023-11-27T22:32:10.358 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] fssum 2023-11-27T22:32:10.759 INFO:teuthology.orchestra.run.smithi154.stdout:Building log-writes 2023-11-27T22:32:10.764 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] replay-log 2023-11-27T22:32:11.044 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2023-11-27T22:32:11.047 INFO:teuthology.orchestra.run.smithi154.stdout:Building aio-dio-regress 2023-11-27T22:32:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aiocp 2023-11-27T22:32:11.250 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-27T22:32:11.394 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-append-write-read-race 2023-11-27T22:32:11.545 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-cow-race 2023-11-27T22:32:11.674 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-cycle-write 2023-11-27T22:32:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-eof-race 2023-11-27T22:32:11.993 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-extend-stat 2023-11-27T22:32:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-fcntl-race 2023-11-27T22:32:12.270 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-hole-filling-race 2023-11-27T22:32:12.398 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-invalidate-failure 2023-11-27T22:32:12.535 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-invalidate-readahead 2023-11-27T22:32:12.676 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aiodio_sparse2 2023-11-27T22:32:12.866 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-subblock-eof-read 2023-11-27T22:32:12.988 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-dio-write-verify 2023-11-27T22:32:13.155 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-27T22:32:13.269 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-27T22:32:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] aio-last-ref-held-by-io 2023-11-27T22:32:13.528 INFO:teuthology.orchestra.run.smithi154.stdout:Building vfs 2023-11-27T22:32:13.533 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] vfstest 2023-11-27T22:32:16.822 INFO:teuthology.orchestra.run.smithi154.stdout: [CC] mount-idmapped 2023-11-27T22:32:17.165 INFO:teuthology.orchestra.run.smithi154.stdout:Building m4 2023-11-27T22:32:17.168 INFO:teuthology.orchestra.run.smithi154.stdout:Building common 2023-11-27T22:32:17.171 INFO:teuthology.orchestra.run.smithi154.stdout:Building tests 2023-11-27T22:32:17.176 INFO:teuthology.orchestra.run.smithi154.stdout:Building btrfs 2023-11-27T22:32:17.182 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/btrfs/group.list 2023-11-27T22:32:17.240 INFO:teuthology.orchestra.run.smithi154.stdout:Building ceph 2023-11-27T22:32:17.245 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ceph/group.list 2023-11-27T22:32:17.258 INFO:teuthology.orchestra.run.smithi154.stdout:Building cifs 2023-11-27T22:32:17.263 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/cifs/group.list 2023-11-27T22:32:17.276 INFO:teuthology.orchestra.run.smithi154.stdout:Building ext4 2023-11-27T22:32:17.281 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ext4/group.list 2023-11-27T22:32:17.318 INFO:teuthology.orchestra.run.smithi154.stdout:Building f2fs 2023-11-27T22:32:17.322 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/f2fs/group.list 2023-11-27T22:32:17.339 INFO:teuthology.orchestra.run.smithi154.stdout:Building generic 2023-11-27T22:32:17.345 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/generic/group.list 2023-11-27T22:32:17.440 INFO:teuthology.orchestra.run.smithi154.stdout:Building nfs 2023-11-27T22:32:17.445 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/nfs/group.list 2023-11-27T22:32:17.459 INFO:teuthology.orchestra.run.smithi154.stdout:Building ocfs2 2023-11-27T22:32:17.463 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ocfs2/group.list 2023-11-27T22:32:17.477 INFO:teuthology.orchestra.run.smithi154.stdout:Building overlay 2023-11-27T22:32:17.482 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/overlay/group.list 2023-11-27T22:32:17.521 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2023-11-27T22:32:17.526 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/perf/group.list 2023-11-27T22:32:17.537 INFO:teuthology.orchestra.run.smithi154.stdout:Building selftest 2023-11-27T22:32:17.542 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/selftest/group.list 2023-11-27T22:32:17.554 INFO:teuthology.orchestra.run.smithi154.stdout:Building shared 2023-11-27T22:32:17.558 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/shared/group.list 2023-11-27T22:32:17.575 INFO:teuthology.orchestra.run.smithi154.stdout:Building tmpfs 2023-11-27T22:32:17.580 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/tmpfs/group.list 2023-11-27T22:32:17.593 INFO:teuthology.orchestra.run.smithi154.stdout:Building udf 2023-11-27T22:32:17.598 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/udf/group.list 2023-11-27T22:32:17.609 INFO:teuthology.orchestra.run.smithi154.stdout:Building xfs 2023-11-27T22:32:17.616 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/xfs/group.list 2023-11-27T22:32:17.713 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo make install) 2023-11-27T22:32:17.751 INFO:teuthology.orchestra.run.smithi154.stdout:Building include 2023-11-27T22:32:17.754 INFO:teuthology.orchestra.run.smithi154.stdout:Building lib 2023-11-27T22:32:17.757 INFO:teuthology.orchestra.run.smithi154.stdout:Building ltp 2023-11-27T22:32:17.761 INFO:teuthology.orchestra.run.smithi154.stdout:Building src 2023-11-27T22:32:17.796 INFO:teuthology.orchestra.run.smithi154.stdout:Building log-writes 2023-11-27T22:32:17.798 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2023-11-27T22:32:17.801 INFO:teuthology.orchestra.run.smithi154.stdout:Building aio-dio-regress 2023-11-27T22:32:17.805 INFO:teuthology.orchestra.run.smithi154.stdout:Building vfs 2023-11-27T22:32:17.808 INFO:teuthology.orchestra.run.smithi154.stdout:Building m4 2023-11-27T22:32:17.812 INFO:teuthology.orchestra.run.smithi154.stdout:Building common 2023-11-27T22:32:17.815 INFO:teuthology.orchestra.run.smithi154.stdout:Building tests 2023-11-27T22:32:17.820 INFO:teuthology.orchestra.run.smithi154.stdout:Building btrfs 2023-11-27T22:32:17.825 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/btrfs/group.list 2023-11-27T22:32:17.883 INFO:teuthology.orchestra.run.smithi154.stdout:Building ceph 2023-11-27T22:32:17.888 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ceph/group.list 2023-11-27T22:32:17.902 INFO:teuthology.orchestra.run.smithi154.stdout:Building cifs 2023-11-27T22:32:17.906 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/cifs/group.list 2023-11-27T22:32:17.919 INFO:teuthology.orchestra.run.smithi154.stdout:Building ext4 2023-11-27T22:32:17.924 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ext4/group.list 2023-11-27T22:32:17.960 INFO:teuthology.orchestra.run.smithi154.stdout:Building f2fs 2023-11-27T22:32:17.965 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/f2fs/group.list 2023-11-27T22:32:17.982 INFO:teuthology.orchestra.run.smithi154.stdout:Building generic 2023-11-27T22:32:17.988 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/generic/group.list 2023-11-27T22:32:18.081 INFO:teuthology.orchestra.run.smithi154.stdout:Building nfs 2023-11-27T22:32:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/nfs/group.list 2023-11-27T22:32:18.100 INFO:teuthology.orchestra.run.smithi154.stdout:Building ocfs2 2023-11-27T22:32:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ocfs2/group.list 2023-11-27T22:32:18.117 INFO:teuthology.orchestra.run.smithi154.stdout:Building overlay 2023-11-27T22:32:18.122 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/overlay/group.list 2023-11-27T22:32:18.162 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2023-11-27T22:32:18.166 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/perf/group.list 2023-11-27T22:32:18.177 INFO:teuthology.orchestra.run.smithi154.stdout:Building selftest 2023-11-27T22:32:18.182 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/selftest/group.list 2023-11-27T22:32:18.194 INFO:teuthology.orchestra.run.smithi154.stdout:Building shared 2023-11-27T22:32:18.199 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/shared/group.list 2023-11-27T22:32:18.216 INFO:teuthology.orchestra.run.smithi154.stdout:Building tmpfs 2023-11-27T22:32:18.221 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/tmpfs/group.list 2023-11-27T22:32:18.234 INFO:teuthology.orchestra.run.smithi154.stdout:Building udf 2023-11-27T22:32:18.241 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/udf/group.list 2023-11-27T22:32:18.250 INFO:teuthology.orchestra.run.smithi154.stdout:Building xfs 2023-11-27T22:32:18.256 INFO:teuthology.orchestra.run.smithi154.stdout: [GROUP] /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/xfs/group.list 2023-11-27T22:32:18.350 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-27T22:32:18.351 INFO:teuthology.orchestra.run.smithi154.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T22:32:18.352 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-27T22:32:18.354 INFO:teuthology.orchestra.run.smithi154.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T22:32:18.354 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-27T22:32:18.356 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-27T22:32:18.364 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-27T22:32:18.431 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-27T22:32:18.439 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-27T22:32:18.456 INFO:teuthology.orchestra.run.smithi154.stdout:Building log-writes 2023-11-27T22:32:18.459 INFO:teuthology.orchestra.run.smithi154.stdout:Building perf 2023-11-27T22:32:18.462 INFO:teuthology.orchestra.run.smithi154.stdout:Building aio-dio-regress 2023-11-27T22:32:18.466 INFO:teuthology.orchestra.run.smithi154.stdout:Building vfs 2023-11-27T22:32:18.469 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C log-writes install 2023-11-27T22:32:18.471 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-27T22:32:18.479 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-27T22:32:18.487 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C perf install 2023-11-27T22:32:18.488 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-27T22:32:18.497 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-27T22:32:18.517 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-27T22:32:18.519 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-27T22:32:18.527 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-27T22:32:18.575 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake -C vfs install 2023-11-27T22:32:18.576 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-27T22:32:18.585 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-27T22:32:18.596 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-27T22:32:18.604 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-11-27T22:32:19.694 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-27T22:32:19.785 INFO:teuthology.orchestra.run.smithi154.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-27T22:32:19.810 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-27T22:32:19.812 INFO:teuthology.orchestra.run.smithi154.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T22:32:19.812 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-27T22:32:19.813 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-27T22:32:19.821 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-27T22:32:19.941 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-27T22:32:19.942 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/btrfs/ install 2023-11-27T22:32:19.946 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-27T22:32:19.954 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-27T22:32:20.698 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-27T22:32:20.704 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-11-27T22:32:21.451 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ceph/ install 2023-11-27T22:32:21.453 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-27T22:32:21.461 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-27T22:32:21.479 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-27T22:32:21.487 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-27T22:32:21.505 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/cifs/ install 2023-11-27T22:32:21.507 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-27T22:32:21.515 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-27T22:32:21.523 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-27T22:32:21.531 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-27T22:32:21.539 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ext4/ install 2023-11-27T22:32:21.541 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-27T22:32:21.549 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-27T22:32:21.718 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-27T22:32:21.726 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-27T22:32:21.904 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/f2fs/ install 2023-11-27T22:32:21.906 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-27T22:32:21.914 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-27T22:32:21.925 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-27T22:32:21.933 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-27T22:32:21.944 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/generic/ install 2023-11-27T22:32:21.949 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-27T22:32:21.957 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-27T22:32:23.753 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-27T22:32:23.761 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-27T22:32:25.604 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/nfs/ install 2023-11-27T22:32:25.605 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-27T22:32:25.613 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-27T22:32:25.621 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-27T22:32:25.630 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-27T22:32:25.638 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/ocfs2/ install 2023-11-27T22:32:25.639 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-27T22:32:25.647 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-27T22:32:25.656 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-27T22:32:25.664 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-27T22:32:25.672 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/overlay/ install 2023-11-27T22:32:25.674 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-27T22:32:25.682 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-27T22:32:25.934 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-27T22:32:25.942 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-27T22:32:26.194 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/perf/ install 2023-11-27T22:32:26.195 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-27T22:32:26.203 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-27T22:32:26.211 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-27T22:32:26.220 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-27T22:32:26.228 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/selftest/ install 2023-11-27T22:32:26.230 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-27T22:32:26.238 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-27T22:32:26.258 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-27T22:32:26.266 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-27T22:32:26.287 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/shared/ install 2023-11-27T22:32:26.288 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-27T22:32:26.297 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-27T22:32:26.310 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-27T22:32:26.318 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-27T22:32:26.331 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/tmpfs/ install 2023-11-27T22:32:26.333 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-27T22:32:26.342 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-27T22:32:26.349 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-27T22:32:26.357 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-27T22:32:26.366 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/udf/ install 2023-11-27T22:32:26.367 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-27T22:32:26.375 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-27T22:32:26.383 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-27T22:32:26.392 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-27T22:32:26.400 INFO:teuthology.orchestra.run.smithi154.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.1EbDOAX7rXxfstests-dev/tests/xfs/ install 2023-11-27T22:32:26.406 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-27T22:32:26.414 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-27T22:32:28.110 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-27T22:32:28.118 INFO:teuthology.orchestra.run.smithi154.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-27T22:32:29.848 INFO:teuthology.orchestra.run.smithi154.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-27T22:32:29.856 INFO:teuthology.orchestra.run.smithi154.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-27T22:32:29.864 INFO:teuthology.orchestra.run.smithi154.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-27T22:32:29.872 INFO:teuthology.orchestra.run.smithi154.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-27T22:32:29.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T22:32:29.884 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec ls tests/generic) 2023-11-27T22:32:29.939 INFO:teuthology.orchestra.run.smithi154.stdout:001 2023-11-27T22:32:29.939 INFO:teuthology.orchestra.run.smithi154.stdout:001.out 2023-11-27T22:32:29.939 INFO:teuthology.orchestra.run.smithi154.stdout:002 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:002.out 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:003 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:003.out 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:004 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:004.out 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:005 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:005.out 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:006 2023-11-27T22:32:29.940 INFO:teuthology.orchestra.run.smithi154.stdout:006.out 2023-11-27T22:32:29.941 INFO:teuthology.orchestra.run.smithi154.stdout:007 2023-11-27T22:32:29.941 INFO:teuthology.orchestra.run.smithi154.stdout:007.out 2023-11-27T22:32:29.941 INFO:teuthology.orchestra.run.smithi154.stdout:008 2023-11-27T22:32:29.941 INFO:teuthology.orchestra.run.smithi154.stdout:008.out 2023-11-27T22:32:29.941 INFO:teuthology.orchestra.run.smithi154.stdout:009 2023-11-27T22:32:29.941 INFO:teuthology.orchestra.run.smithi154.stdout:009.out 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:010 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:010.out 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:011 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:011.out 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:012 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:012.out 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:013 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:013.out 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:014 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:014.out 2023-11-27T22:32:29.942 INFO:teuthology.orchestra.run.smithi154.stdout:015 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:015.out 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:016 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:016.out 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:017 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:017.out 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:018 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:018.out 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:019 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:019.out 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:020 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:020.out 2023-11-27T22:32:29.943 INFO:teuthology.orchestra.run.smithi154.stdout:021 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:021.out 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:022 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:022.out 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:023 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:023.out 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:024 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:024.out 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:025 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:025.out 2023-11-27T22:32:29.944 INFO:teuthology.orchestra.run.smithi154.stdout:026 2023-11-27T22:32:29.945 INFO:teuthology.orchestra.run.smithi154.stdout:026.out 2023-11-27T22:32:29.946 INFO:teuthology.orchestra.run.smithi154.stdout:027 2023-11-27T22:32:29.946 INFO:teuthology.orchestra.run.smithi154.stdout:027.out 2023-11-27T22:32:29.946 INFO:teuthology.orchestra.run.smithi154.stdout:028 2023-11-27T22:32:29.946 INFO:teuthology.orchestra.run.smithi154.stdout:028.out 2023-11-27T22:32:29.946 INFO:teuthology.orchestra.run.smithi154.stdout:029 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:029.out 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:030 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:030.out 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:031 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:031.out 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:032 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:032.out 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:033 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:033.out 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:034 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:034.out 2023-11-27T22:32:29.947 INFO:teuthology.orchestra.run.smithi154.stdout:035 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:035.cfg 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:035.out.default 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:035.out.nfs 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:036 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:036.out 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:037 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:037.out 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:038 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:038.out 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:039 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:039.out 2023-11-27T22:32:29.948 INFO:teuthology.orchestra.run.smithi154.stdout:040 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:040.out 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:041 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:041.out 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:042 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:042.out 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:043 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:043.out 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:044 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:044.out 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:045 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:045.out 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:046 2023-11-27T22:32:29.949 INFO:teuthology.orchestra.run.smithi154.stdout:046.out 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:047 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:047.out 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:048 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:048.out 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:049 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:049.out 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:050 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:050.cfg 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:050.out.default 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:050.out.nojournal 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:050.out.xfsquota 2023-11-27T22:32:29.950 INFO:teuthology.orchestra.run.smithi154.stdout:051 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:051.out 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:052 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:052.out 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:053 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:053.out 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:054 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:054.out 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:055 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:055.out 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:056 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:056.out 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:057 2023-11-27T22:32:29.951 INFO:teuthology.orchestra.run.smithi154.stdout:057.out 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:058 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:058.out 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:059 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:059.out 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:060 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:060.out 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:061 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:061.out 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:062 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:062.out 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:063 2023-11-27T22:32:29.952 INFO:teuthology.orchestra.run.smithi154.stdout:063.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:064 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:064.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:065 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:065.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:066 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:066.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:067 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:067.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:068 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:068.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:069 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:069.out 2023-11-27T22:32:29.953 INFO:teuthology.orchestra.run.smithi154.stdout:070 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:070.out 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:071 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:071.out 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:072 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:072.out 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:073 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:073.out 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:074 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:074.out 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:075 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:075.out 2023-11-27T22:32:29.954 INFO:teuthology.orchestra.run.smithi154.stdout:076 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:076.out 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:077 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:077.out 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:078 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:078.out 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:079 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:079.out 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:080 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:080.out 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:081 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:081.out 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:082 2023-11-27T22:32:29.955 INFO:teuthology.orchestra.run.smithi154.stdout:082.out 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:083 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:083.out 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:084 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:084.out 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:085 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:085.out 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:086 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:086.out 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:087 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:087.out 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:088 2023-11-27T22:32:29.956 INFO:teuthology.orchestra.run.smithi154.stdout:088.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:089 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:089.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:090 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:090.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:091 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:091.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:092 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:092.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:093 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:093.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:094 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:094.out 2023-11-27T22:32:29.957 INFO:teuthology.orchestra.run.smithi154.stdout:095 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:095.out 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:096 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:096.out 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:097 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:097.out 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:098 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:098.out 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:099 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:099.out 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:100 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:100.out 2023-11-27T22:32:29.958 INFO:teuthology.orchestra.run.smithi154.stdout:101 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:101.out 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:102 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:102.out 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:103 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:103.out 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:104 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:104.out 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:105 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:105.out 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:106 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:106.out 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:107 2023-11-27T22:32:29.959 INFO:teuthology.orchestra.run.smithi154.stdout:107.out 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:108 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:108.out 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:109 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:109.out 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:110 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:110.out 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:111 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:111.out 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:112 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:112.out 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:113 2023-11-27T22:32:29.960 INFO:teuthology.orchestra.run.smithi154.stdout:113.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:114 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:114.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:115 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:115.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:116 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:116.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:117 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:117.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:118 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:118.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:119 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:119.out 2023-11-27T22:32:29.961 INFO:teuthology.orchestra.run.smithi154.stdout:120 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:120.out 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:121 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:121.out 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:122 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:122.out 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:123 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:123.out 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:124 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:124.out 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:125 2023-11-27T22:32:29.962 INFO:teuthology.orchestra.run.smithi154.stdout:125.out 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:126 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:126.out 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:127 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:127.out 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:128 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:128.out 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:129 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:129.out 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:130 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:130.out 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:131 2023-11-27T22:32:29.963 INFO:teuthology.orchestra.run.smithi154.stdout:131.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:132 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:132.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:133 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:133.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:134 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:134.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:135 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:135.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:136 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:136.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:137 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:137.out 2023-11-27T22:32:29.964 INFO:teuthology.orchestra.run.smithi154.stdout:138 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:138.out 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:139 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:139.out 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:140 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:140.out 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:141 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:141.out 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:142 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:142.out 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:143 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:143.out 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:144 2023-11-27T22:32:29.965 INFO:teuthology.orchestra.run.smithi154.stdout:144.out 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:145 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:145.out 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:146 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:146.out 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:147 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:147.out 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:148 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:148.out 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:149 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:149.out 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:150 2023-11-27T22:32:29.966 INFO:teuthology.orchestra.run.smithi154.stdout:150.out 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:151 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:151.out 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:152 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:152.out 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:153 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:153.out 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:154 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:154.out 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:155 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:155.out 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:156 2023-11-27T22:32:29.967 INFO:teuthology.orchestra.run.smithi154.stdout:156.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:157 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:157.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:158 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:158.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:159 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:159.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:160 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:160.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:161 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:161.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:162 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:162.out 2023-11-27T22:32:29.968 INFO:teuthology.orchestra.run.smithi154.stdout:163 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:163.out 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:164 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:164.out 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:165 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:165.out 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:166 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:166.out 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:167 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:167.out 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:168 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:168.out 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:169 2023-11-27T22:32:29.969 INFO:teuthology.orchestra.run.smithi154.stdout:169.out 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:170 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:170.out 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:171 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:171.out 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:172 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:172.out 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:173 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:173.out 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:174 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:174.out 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:175 2023-11-27T22:32:29.970 INFO:teuthology.orchestra.run.smithi154.stdout:175.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:176 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:176.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:177 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:177.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:178 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:178.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:179 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:179.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:180 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:180.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:181 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:181.out 2023-11-27T22:32:29.971 INFO:teuthology.orchestra.run.smithi154.stdout:182 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:182.out 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:183 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:183.out 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:184 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:184.out 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:185 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:185.out 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:186 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:186.out 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:187 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:187.out 2023-11-27T22:32:29.972 INFO:teuthology.orchestra.run.smithi154.stdout:188 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:188.out 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:189 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:189.out 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:190 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:190.out 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:191 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:191.out 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:192 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:192.out 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:193 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:193.out 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:194 2023-11-27T22:32:29.973 INFO:teuthology.orchestra.run.smithi154.stdout:194.out 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:195 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:195.out 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:196 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:196.out 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:197 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:197.out 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:198 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:198.out 2023-11-27T22:32:29.974 INFO:teuthology.orchestra.run.smithi154.stdout:199 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:199.out 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:200 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:200.out 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:201 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:201.out 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:202 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:202.out 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:203 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:203.out 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:204 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:204.out 2023-11-27T22:32:29.975 INFO:teuthology.orchestra.run.smithi154.stdout:205 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:205.out 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:206 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:206.out 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:207 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:207.out 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:208 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:208.out 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:209 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:209.out 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:210 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:210.out 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:211 2023-11-27T22:32:29.976 INFO:teuthology.orchestra.run.smithi154.stdout:211.out 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:212 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:212.out 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:213 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:213.out 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:214 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:214.out 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:215 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:215.out 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:216 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:216.out 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:217 2023-11-27T22:32:29.977 INFO:teuthology.orchestra.run.smithi154.stdout:217.out 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:218 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:218.out 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:219 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:219.out 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:220 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:220.out 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:221 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:221.out 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:222 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:222.out 2023-11-27T22:32:29.978 INFO:teuthology.orchestra.run.smithi154.stdout:223 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:223.out 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:224 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:224.out 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:225 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:225.out 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:226 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:226.out 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:227 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:227.out 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:228 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:228.out 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:229 2023-11-27T22:32:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:229.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:230 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:230.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:231 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:231.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:232 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:232.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:233 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:233.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:234 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:234.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:235 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:235.out 2023-11-27T22:32:29.980 INFO:teuthology.orchestra.run.smithi154.stdout:236 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:236.out 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:237 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:237.out 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:238 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:238.out 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:239 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:239.out 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:240 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:240.out 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:241 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:241.out 2023-11-27T22:32:29.981 INFO:teuthology.orchestra.run.smithi154.stdout:242 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:242.out 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:243 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:243.out 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:244 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:244.out 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:245 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:245.out 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:246 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:246.out 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:247 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:247.out 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:248 2023-11-27T22:32:29.982 INFO:teuthology.orchestra.run.smithi154.stdout:248.out 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:249 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:249.out 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:250 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:250.out 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:251 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:251.out 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:252 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:252.out 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:253 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:253.out 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:254 2023-11-27T22:32:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:254.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:255 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:255.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:256 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:256.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:257 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:257.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:258 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:258.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:259 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:259.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:260 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:260.out 2023-11-27T22:32:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:261 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:261.out 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:262 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:262.out 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:263 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:263.out 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:264 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:264.out 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:265 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:265.out 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:266 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:266.out 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:267 2023-11-27T22:32:29.985 INFO:teuthology.orchestra.run.smithi154.stdout:267.out 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:268 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:268.out 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:269 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:269.out 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:270 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:270.out 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:271 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:271.out 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:272 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:272.out 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:273 2023-11-27T22:32:29.986 INFO:teuthology.orchestra.run.smithi154.stdout:273.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:274 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:274.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:275 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:275.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:276 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:276.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:277 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:277.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:278 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:278.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:279 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:279.out 2023-11-27T22:32:29.987 INFO:teuthology.orchestra.run.smithi154.stdout:280 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:280.out 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:281 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:281.out 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:282 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:282.out 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:283 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:283.out 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:284 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:284.out 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:285 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:285.out 2023-11-27T22:32:29.988 INFO:teuthology.orchestra.run.smithi154.stdout:286 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:286.out 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:287 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:287.out 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:288 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:288.out 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:289 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:289.out 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:290 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:290.out 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:291 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:291.out 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:292 2023-11-27T22:32:29.989 INFO:teuthology.orchestra.run.smithi154.stdout:292.out 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:293 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:293.out 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:294 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:294.out 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:295 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:295.out 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:296 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:296.out 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:297 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:297.out 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:298 2023-11-27T22:32:29.990 INFO:teuthology.orchestra.run.smithi154.stdout:298.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:299 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:299.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:300 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:300.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:301 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:301.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:302 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:302.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:303 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:303.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:304 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:304.out 2023-11-27T22:32:29.991 INFO:teuthology.orchestra.run.smithi154.stdout:305 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:305.out 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:306 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:306.out 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:307 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:307.out 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:308 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:308.out 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:309 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:309.out 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:310 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:310.out 2023-11-27T22:32:29.992 INFO:teuthology.orchestra.run.smithi154.stdout:311 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:311.out 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:312 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:312.out 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:313 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:313.out 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:314 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:314.out 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:315 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:315.out 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:316 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:316.out 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:317 2023-11-27T22:32:29.993 INFO:teuthology.orchestra.run.smithi154.stdout:317.out 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:318 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:318.out 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:319 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:319.out 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:320 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:320.out 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:321 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:321.out 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:322 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:322.out 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:323 2023-11-27T22:32:29.994 INFO:teuthology.orchestra.run.smithi154.stdout:323.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:324 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:324.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:325 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:325.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:326 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:326.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:327 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:327.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:328 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:328.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:329 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:329.out 2023-11-27T22:32:29.995 INFO:teuthology.orchestra.run.smithi154.stdout:330 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:330.out 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:331 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:331.out 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:332 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:332.out 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:333 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:333.out 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:334 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:334.out 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:335 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:335.out 2023-11-27T22:32:29.996 INFO:teuthology.orchestra.run.smithi154.stdout:336 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:336.out 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:337 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:337.out 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:338 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:338.out 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:339 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:339.out 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:340 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:340.out 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:341 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:341.out 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:342 2023-11-27T22:32:29.997 INFO:teuthology.orchestra.run.smithi154.stdout:342.out 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:343 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:343.out 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:344 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:344.out 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:345 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:345.out 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:346 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:346.out 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:347 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:347.out 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:348 2023-11-27T22:32:29.998 INFO:teuthology.orchestra.run.smithi154.stdout:348.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:349 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:349.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:350 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:350.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:351 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:351.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:352 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:352.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:353 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:353.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:354 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:354.out 2023-11-27T22:32:29.999 INFO:teuthology.orchestra.run.smithi154.stdout:355 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:355.out 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:356 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:356.out 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:357 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:357.out 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:358 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:358.out 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:359 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:359.out 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:360 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:360.out 2023-11-27T22:32:30.000 INFO:teuthology.orchestra.run.smithi154.stdout:361 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:361.out 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:362 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:362.out 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:363 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:363.out 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:364 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:364.out 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:365 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:365.out 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:366 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:366.out 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:367 2023-11-27T22:32:30.001 INFO:teuthology.orchestra.run.smithi154.stdout:367.out 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:368 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:368.out 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:369 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:369.out 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:370 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:370.out 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:371 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:371.out 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:372 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:372.out 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:373 2023-11-27T22:32:30.002 INFO:teuthology.orchestra.run.smithi154.stdout:373.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:374 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:374.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:375 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:375.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:376 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:376.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:377 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:377.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:378 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:378.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:379 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:379.out 2023-11-27T22:32:30.003 INFO:teuthology.orchestra.run.smithi154.stdout:380 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:380.out 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:381 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:381.out 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:382 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:382.out 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:383 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:383.out 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:384 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:384.out 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:385 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:385.out 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:386 2023-11-27T22:32:30.004 INFO:teuthology.orchestra.run.smithi154.stdout:386.out 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:387 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:387.out 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:388 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:388.out 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:389 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:389.out 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:390 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:390.out 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:391 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:391.out 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:392 2023-11-27T22:32:30.005 INFO:teuthology.orchestra.run.smithi154.stdout:392.out 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:393 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:393.out 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:394 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:394.out 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:395 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:395.out 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:396 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:396.out 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:397 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:397.out 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:398 2023-11-27T22:32:30.006 INFO:teuthology.orchestra.run.smithi154.stdout:398.out 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:399 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:399.out 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:400 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:400.out 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:401 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:401.out 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:402 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:402.out 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:403 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:403.out 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:404 2023-11-27T22:32:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:404.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:405 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:405.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:406 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:406.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:407 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:407.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:408 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:408.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:409 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:409.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:410 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:410.out 2023-11-27T22:32:30.008 INFO:teuthology.orchestra.run.smithi154.stdout:411 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:411.out 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:412 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:412.out 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:413 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:413.out 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:414 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:414.out 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:415 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:415.out 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:416 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:416.out 2023-11-27T22:32:30.009 INFO:teuthology.orchestra.run.smithi154.stdout:417 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:417.out 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:418 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:418.out 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:419 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:419.out 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:420 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:420.out 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:421 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:421.out 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:422 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:422.out 2023-11-27T22:32:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:423 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:423.out 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:424 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:424.out 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:425 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:425.out 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:426 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:426.out 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:427 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:427.out 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:428 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:428.out 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:429 2023-11-27T22:32:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:429.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:430 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:430.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:431 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:431.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:432 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:432.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:433 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:433.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:434 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:434.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:435 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:435.out 2023-11-27T22:32:30.012 INFO:teuthology.orchestra.run.smithi154.stdout:436 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:436.out 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:437 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:437.out 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:438 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:438.out 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:439 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:439.out 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:440 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:440.out 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:441 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:441.out 2023-11-27T22:32:30.013 INFO:teuthology.orchestra.run.smithi154.stdout:442 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:442.out 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:443 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:443.out 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:444 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:444.out 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:445 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:445.out 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:446 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:446.out 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:447 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:447.out 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:448 2023-11-27T22:32:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:448.out 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:449 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:449.out 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:450 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:450.out 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:451 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:451.out 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:452 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:452.out 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:453 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:453.out 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:454 2023-11-27T22:32:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:454.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:455 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:455.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:456 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:456.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:457 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:457.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:458 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:458.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:459 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:459.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:460 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:460.out 2023-11-27T22:32:30.016 INFO:teuthology.orchestra.run.smithi154.stdout:461 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:461.out 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:462 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:462.out 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:463 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:463.out 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:464 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:464.out 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:465 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:465.out 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:466 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:466.out 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:467 2023-11-27T22:32:30.017 INFO:teuthology.orchestra.run.smithi154.stdout:467.out 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:468 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:468.out 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:469 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:469.out 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:470 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:470.out 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:471 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:471.out 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:472 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:472.out 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:473 2023-11-27T22:32:30.018 INFO:teuthology.orchestra.run.smithi154.stdout:473.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:474 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:474.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:475 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:475.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:476 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:476.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:477 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:477.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:478 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:478.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:479 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:479.out 2023-11-27T22:32:30.019 INFO:teuthology.orchestra.run.smithi154.stdout:480 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:480.out 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:481 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:481.out 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:482 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:482.out 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:483 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:483.out 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:484 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:484.out 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:485 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:485.out 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:486 2023-11-27T22:32:30.020 INFO:teuthology.orchestra.run.smithi154.stdout:486.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:487 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:487.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:488 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:488.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:489 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:489.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:490 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:490.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:491 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:491.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:492 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:492.out 2023-11-27T22:32:30.021 INFO:teuthology.orchestra.run.smithi154.stdout:493 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:493.out 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:494 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:494.out 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:495 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:495.out 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:496 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:496.out 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:497 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:497.out 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:498 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:498.out 2023-11-27T22:32:30.022 INFO:teuthology.orchestra.run.smithi154.stdout:499 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:499.out 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:500 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:500.out 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:501 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:501.out 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:502 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:502.out 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:503 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:503.out 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:504 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:504.out 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:505 2023-11-27T22:32:30.023 INFO:teuthology.orchestra.run.smithi154.stdout:505.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:506 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:506.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:507 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:507.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:508 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:508.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:509 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:509.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:510 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:510.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:511 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:511.out 2023-11-27T22:32:30.024 INFO:teuthology.orchestra.run.smithi154.stdout:512 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:512.out 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:513 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:513.out 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:514 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:514.out 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:515 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:515.out 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:516 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:516.out 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:517 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:517.out 2023-11-27T22:32:30.025 INFO:teuthology.orchestra.run.smithi154.stdout:518 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:518.out 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:519 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:519.out 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:520 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:520.out 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:521 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:521.out 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:522 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:522.out 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:523 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:523.out 2023-11-27T22:32:30.026 INFO:teuthology.orchestra.run.smithi154.stdout:524 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:524.out 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:525 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:525.out 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:526 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:526.out 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:527 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:527.out 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:528 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:528.out 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:529 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:529.out 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:530 2023-11-27T22:32:30.027 INFO:teuthology.orchestra.run.smithi154.stdout:530.out 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:531 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:531.out 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:532 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:532.out 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:533 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:533.out 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:534 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:534.out 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:535 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:535.out 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:536 2023-11-27T22:32:30.028 INFO:teuthology.orchestra.run.smithi154.stdout:536.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:537 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:537.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:538 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:538.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:539 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:539.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:540 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:540.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:541 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:541.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:542 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:542.out 2023-11-27T22:32:30.029 INFO:teuthology.orchestra.run.smithi154.stdout:543 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:543.out 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:544 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:544.out 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:545 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:545.out 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:546 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:546.out 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:547 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:547.out 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:548 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:548.out 2023-11-27T22:32:30.030 INFO:teuthology.orchestra.run.smithi154.stdout:549 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:549.out 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:550 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:550.out 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:551 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:551.out 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:552 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:552.out 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:553 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:553.out 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:554 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:554.out 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:555 2023-11-27T22:32:30.031 INFO:teuthology.orchestra.run.smithi154.stdout:555.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:556 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:556.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:557 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:557.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:558 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:558.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:559 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:559.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:560 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:560.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:561 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:561.out 2023-11-27T22:32:30.032 INFO:teuthology.orchestra.run.smithi154.stdout:562 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:562.out 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:563 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:563.out 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:564 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:564.out 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:565 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:565.out 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:566 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:566.out 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:567 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:567.out 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:568 2023-11-27T22:32:30.033 INFO:teuthology.orchestra.run.smithi154.stdout:568.out 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:569 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:569.out 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:570 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:570.out 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:571 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:571.out 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:572 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:572.out 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:573 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:573.out 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:574 2023-11-27T22:32:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:574.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:575 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:575.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:576 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:576.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:577 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:577.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:578 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:578.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:579 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:579.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:580 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:580.out 2023-11-27T22:32:30.035 INFO:teuthology.orchestra.run.smithi154.stdout:581 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:581.out 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:582 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:582.out 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:583 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:583.out 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:584 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:584.out 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:585 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:585.out 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:586 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:586.out 2023-11-27T22:32:30.036 INFO:teuthology.orchestra.run.smithi154.stdout:587 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:587.out 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:588 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:588.out 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:589 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:589.out 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:590 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:590.out 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:591 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:591.out 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:592 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:592.out 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:593 2023-11-27T22:32:30.037 INFO:teuthology.orchestra.run.smithi154.stdout:593.out 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:594 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:594.out 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:595 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:595.out 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:596 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:596.out 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:597 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:597.out 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:598 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:598.out 2023-11-27T22:32:30.038 INFO:teuthology.orchestra.run.smithi154.stdout:599 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:599.out 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:600 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:600.out 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:601 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:601.out 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:602 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:602.out 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:603 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:603.out 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:604 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:604.out 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:605 2023-11-27T22:32:30.039 INFO:teuthology.orchestra.run.smithi154.stdout:605.out 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:606 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:606.out 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:607 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:607.out 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:608 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:608.out 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:609 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:609.out 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:610 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:610.out 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:611 2023-11-27T22:32:30.040 INFO:teuthology.orchestra.run.smithi154.stdout:611.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:612 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:612.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:613 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:613.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:614 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:614.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:615 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:615.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:616 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:616.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:617 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:617.out 2023-11-27T22:32:30.041 INFO:teuthology.orchestra.run.smithi154.stdout:618 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:618.out 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:619 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:619.out 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:620 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:620.out 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:621 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:621.out 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:622 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:622.out 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:623 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:623.out 2023-11-27T22:32:30.042 INFO:teuthology.orchestra.run.smithi154.stdout:624 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:624.out 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:625 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:625.out 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:626 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:626.out 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:627 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:627.out 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:628 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:628.out 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:629 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:629.out 2023-11-27T22:32:30.043 INFO:teuthology.orchestra.run.smithi154.stdout:630 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:630.out 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:631 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:631.out 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:632 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:632.out 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:633 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:633.out 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:634 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:634.out 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:635 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:635.out 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:636 2023-11-27T22:32:30.044 INFO:teuthology.orchestra.run.smithi154.stdout:636.out 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:637 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:637.out 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:638 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:638.out 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:639 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:639.out 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:640 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:640.out 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:641 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:641.out 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:642 2023-11-27T22:32:30.045 INFO:teuthology.orchestra.run.smithi154.stdout:642.out 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:643 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:643.out 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:644 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:644.out 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:645 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:645.out 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:646 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:646.out 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:647 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:647.out 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:648 2023-11-27T22:32:30.046 INFO:teuthology.orchestra.run.smithi154.stdout:648.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:649 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:649.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:650 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:650.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:651 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:651.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:652 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:652.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:653 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:653.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:654 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:654.out 2023-11-27T22:32:30.047 INFO:teuthology.orchestra.run.smithi154.stdout:655 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:655.out 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:656 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:656.out 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:657 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:657.out 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:658 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:658.out 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:659 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:659.out 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:660 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:660.out 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:661 2023-11-27T22:32:30.048 INFO:teuthology.orchestra.run.smithi154.stdout:661.out 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:662 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:662.out 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:663 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:663.out 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:664 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:664.out 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:665 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:665.out 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:666 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:666.out 2023-11-27T22:32:30.049 INFO:teuthology.orchestra.run.smithi154.stdout:667 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:667.out 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:668 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:668.out 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:669 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:669.out 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:670 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:670.out 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:671 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:671.out 2023-11-27T22:32:30.050 INFO:teuthology.orchestra.run.smithi154.stdout:672 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:672.out 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:673 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:673.out 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:674 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:674.out 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:675 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:675.out 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:676 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:676.out 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:677 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:677.out 2023-11-27T22:32:30.051 INFO:teuthology.orchestra.run.smithi154.stdout:678 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:678.out 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:679 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:679.out 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:680 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:680.out 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:681 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:681.out 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:682 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:682.out 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:683 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:683.out 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:684 2023-11-27T22:32:30.052 INFO:teuthology.orchestra.run.smithi154.stdout:684.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:685 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:685.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:686 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:686.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:687 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:687.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:688 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:688.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:689 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:689.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:690 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:690.out 2023-11-27T22:32:30.053 INFO:teuthology.orchestra.run.smithi154.stdout:691 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:691.out 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:692 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:692.out 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:693 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:693.out 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:694 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:694.out 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:695 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:695.out 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:696 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:696.out 2023-11-27T22:32:30.054 INFO:teuthology.orchestra.run.smithi154.stdout:697 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:697.out 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:698 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:698.out 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:699 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:699.out 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:700 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:700.out 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:701 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:701.out 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:702 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:702.out 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:703 2023-11-27T22:32:30.055 INFO:teuthology.orchestra.run.smithi154.stdout:703.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:704 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:704.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:705 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:705.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:706 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:706.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:707 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:707.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:708 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:708.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:709 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:709.out 2023-11-27T22:32:30.056 INFO:teuthology.orchestra.run.smithi154.stdout:710 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:710.out 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:711 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:711.out 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:712 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:712.out 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:713 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:713.out 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:714 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:714.out 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:715 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:715.out 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:716 2023-11-27T22:32:30.057 INFO:teuthology.orchestra.run.smithi154.stdout:716.out 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:717 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:717.out 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:718 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:718.out 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:719 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:719.out 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:720 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:720.out 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:721 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:721.out 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:722 2023-11-27T22:32:30.058 INFO:teuthology.orchestra.run.smithi154.stdout:722.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:723 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:723.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:724 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:724.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:725 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:725.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:726 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:726.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:727 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:727.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:728 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:728.out 2023-11-27T22:32:30.059 INFO:teuthology.orchestra.run.smithi154.stdout:729 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:729.out 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:730 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:730.out 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:731 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:731.out 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:732 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:732.out 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:group.list 2023-11-27T22:32:30.060 INFO:teuthology.orchestra.run.smithi154.stdout:Makefile 2023-11-27T22:32:30.061 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-27T22:32:30.200 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:32:30.203 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:32:30.204 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:32.133 INFO:teuthology.orchestra.run.smithi154.stdout:generic/001 2s 2023-11-27T22:32:32.138 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/001 2023-11-27T22:32:32.138 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:32:32.140 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:32.141 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi154.stderr:ceph-fuse[104039]: fuse finished with error 0 and tester_r 0 2023-11-27T22:32:32.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:32:32.149 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-27T22:32:32.312 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:32:32.316 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:32:32.316 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:32.681 INFO:teuthology.orchestra.run.smithi154.stdout:generic/002 0s 2023-11-27T22:32:32.686 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/002 2023-11-27T22:32:32.686 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:32:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:32.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:32:32.697 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-27T22:32:32.885 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:32:32.890 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:32:32.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:32.993 INFO:teuthology.orchestra.run.smithi154.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:32:32.997 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/003 2023-11-27T22:32:32.997 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/003 2023-11-27T22:32:32.997 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:32:32.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:33.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:32:33.007 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-27T22:32:33.170 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:32:33.174 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:32:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:33.285 INFO:teuthology.orchestra.run.smithi154.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-27T22:32:33.289 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/004 2023-11-27T22:32:33.289 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/004 2023-11-27T22:32:33.289 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:32:33.291 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:33.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:32:33.299 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-27T22:32:33.462 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:32:33.467 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:32:33.467 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:33.914 INFO:teuthology.orchestra.run.smithi154.stdout:generic/005 0s 2023-11-27T22:32:33.920 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/005 2023-11-27T22:32:33.920 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:32:33.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:33.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:32:33.931 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-27T22:32:34.118 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:32:34.122 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:32:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:32:39.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:39.651 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:03.908 INFO:teuthology.orchestra.run.smithi154.stdout:generic/006 29s 2023-11-27T22:33:03.984 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/006 2023-11-27T22:33:03.985 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:33:03.989 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:33:04.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:33:04.038 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-27T22:33:04.240 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:33:04.244 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:33:04.244 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:33:09.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:09.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:40.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:40.078 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:06.450 INFO:teuthology.orchestra.run.smithi154.stdout:generic/007 62s 2023-11-27T22:34:06.523 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/007 2023-11-27T22:34:06.523 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:34:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:06.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:34:06.534 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-27T22:34:06.723 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:34:06.727 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:34:06.728 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:07.503 INFO:teuthology.orchestra.run.smithi154.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T22:34:07.507 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/008 2023-11-27T22:34:07.507 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/008 2023-11-27T22:34:07.507 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:34:07.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:07.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:34:07.517 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-27T22:34:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:34:07.765 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:34:07.766 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:08.527 INFO:teuthology.orchestra.run.smithi154.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T22:34:08.531 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/009 2023-11-27T22:34:08.531 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/009 2023-11-27T22:34:08.531 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:34:08.533 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:08.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:34:08.542 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-27T22:34:08.702 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:34:08.706 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:34:08.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:09.286 INFO:teuthology.orchestra.run.smithi154.stdout:generic/010 1s 2023-11-27T22:34:09.361 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/010 2023-11-27T22:34:09.361 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:34:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:09.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:34:09.385 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-27T22:34:09.566 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:34:09.570 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:34:09.570 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:10.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:10.140 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:40.381 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:40.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:43.338 INFO:teuthology.orchestra.run.smithi154.stdout:generic/011 34s 2023-11-27T22:34:43.343 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/011 2023-11-27T22:34:43.343 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:34:43.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:43.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:34:43.354 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-27T22:34:43.543 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:34:43.547 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:34:43.547 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:44.447 INFO:teuthology.orchestra.run.smithi154.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:34:44.448 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/012 2023-11-27T22:34:44.448 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/012 2023-11-27T22:34:44.448 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:34:44.450 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:34:44.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:34:44.462 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-27T22:34:44.643 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:34:44.647 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:34:44.648 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:35:10.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:10.446 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:40.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:40.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:11.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:11.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:20.279 INFO:teuthology.orchestra.run.smithi154.stdout:generic/013 96s 2023-11-27T22:36:20.286 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/013 2023-11-27T22:36:20.286 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:36:20.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:36:20.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:36:20.300 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-27T22:36:20.557 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:36:20.563 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:36:20.563 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:36:41.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:41.429 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:41.491 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-27T22:36:41.487+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 167535) UID: 0 2023-11-27T22:36:41.491 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-27T22:36:41.489+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 167535) UID: 0 2023-11-27T22:39:49.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:49.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:19.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:19.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:49.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:49.498 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:10.740 INFO:teuthology.orchestra.run.smithi154.stdout:generic/014 290s 2023-11-27T22:41:10.876 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/014 2023-11-27T22:41:10.876 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:10.879 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:10.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:10.891 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-27T22:41:11.120 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:11.124 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:11.280 INFO:teuthology.orchestra.run.smithi154.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:11.285 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/015 2023-11-27T22:41:11.285 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/015 2023-11-27T22:41:11.286 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:11.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:11.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:11.299 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-27T22:41:11.539 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:11.546 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:11.546 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:12.844 INFO:teuthology.orchestra.run.smithi154.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:41:12.849 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/016 2023-11-27T22:41:12.849 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/016 2023-11-27T22:41:12.849 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:12.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:12.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:12.863 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-27T22:41:13.286 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:13.291 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:13.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:13.434 INFO:teuthology.orchestra.run.smithi154.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:13.438 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/017 2023-11-27T22:41:13.438 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/017 2023-11-27T22:41:13.438 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:13.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:13.452 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-27T22:41:13.677 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:13.681 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:13.681 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:13.835 INFO:teuthology.orchestra.run.smithi154.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:13.839 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/018 2023-11-27T22:41:13.839 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/018 2023-11-27T22:41:13.840 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:13.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:13.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:13.855 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-27T22:41:14.106 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:14.110 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:14.111 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:14.259 INFO:teuthology.orchestra.run.smithi154.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:14.264 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/019 2023-11-27T22:41:14.264 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/019 2023-11-27T22:41:14.264 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:14.267 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:14.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:14.278 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-27T22:41:14.511 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:14.516 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:19.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:19.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:23.507 INFO:teuthology.orchestra.run.smithi154.stdout:generic/020 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/020.out.bad) 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/020.out 2023-11-27 22:30:53.817023497 +0000 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/020.out.bad 2023-11-27 22:41:23.504783436 +0000 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -47,9 +47,13 @@ 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: user.snrub="fish2\012" 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: *** really long value 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: -0000000 00 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: -* 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: -ATTRSIZE 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: +attr_set: No space left on device 2023-11-27T22:41:23.510 INFO:teuthology.orchestra.run.smithi154.stdout: +Could not set "long_attr" for 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: +attr_get: No data available 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: +Could not get "long_attr" for 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: +0000000 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: +attr_remove: No data available 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: +Could not remove "long_attr" for 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: *** set/get/remove really long names (expect failure) 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: attr_set: Invalid argument 2023-11-27T22:41:23.511 INFO:teuthology.orchestra.run.smithi154.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-11-27T22:41:23.512 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/020 2023-11-27T22:41:23.513 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/020 2023-11-27T22:41:23.513 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T22:41:23.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:23.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T22:41:23.527 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T22:41:23.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T22:41:23.528 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-27T22:41:23.974 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:23.980 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:23.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:25.292 INFO:teuthology.orchestra.run.smithi154.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:41:25.296 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/021 2023-11-27T22:41:25.296 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/021 2023-11-27T22:41:25.297 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:25.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:25.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:25.309 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-27T22:41:25.753 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:25.759 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:25.759 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:27.077 INFO:teuthology.orchestra.run.smithi154.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:41:27.082 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/022 2023-11-27T22:41:27.082 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/022 2023-11-27T22:41:27.082 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:27.085 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:27.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:27.099 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-27T22:41:27.578 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:27.584 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:27.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:29.234 INFO:teuthology.orchestra.run.smithi154.stdout:generic/023 2s 2023-11-27T22:41:29.240 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/023 2023-11-27T22:41:29.240 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:29.243 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:29.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:29.260 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-27T22:41:29.684 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:29.689 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:29.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:29.893 INFO:teuthology.orchestra.run.smithi154.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-27T22:41:29.899 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/024 2023-11-27T22:41:29.899 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/024 2023-11-27T22:41:29.899 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:29.903 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:29.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:29.921 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-27T22:41:30.344 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:30.349 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:30.349 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:30.557 INFO:teuthology.orchestra.run.smithi154.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-27T22:41:30.562 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/025 2023-11-27T22:41:30.562 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/025 2023-11-27T22:41:30.562 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:30.565 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:30.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:30.577 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-27T22:41:31.021 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:31.027 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:31.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:31.215 INFO:teuthology.orchestra.run.smithi154.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-27T22:41:31.219 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/026 2023-11-27T22:41:31.219 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/026 2023-11-27T22:41:31.219 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:31.222 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:31.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:31.232 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-27T22:41:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:31.467 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/027 2023-11-27T22:41:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/027 2023-11-27T22:41:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:31.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:31.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:31.639 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-27T22:41:31.879 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:31.884 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:31.884 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:37.074 INFO:teuthology.orchestra.run.smithi154.stdout:generic/028 6s 2023-11-27T22:41:37.084 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/028 2023-11-27T22:41:37.084 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:37.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:37.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:37.097 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-27T22:41:37.332 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:37.336 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:37.336 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:37.499 INFO:teuthology.orchestra.run.smithi154.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:37.503 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/029 2023-11-27T22:41:37.503 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/029 2023-11-27T22:41:37.503 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:37.506 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:37.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:37.518 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-27T22:41:37.755 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:37.759 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:37.759 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:37.912 INFO:teuthology.orchestra.run.smithi154.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:37.916 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/030 2023-11-27T22:41:37.916 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/030 2023-11-27T22:41:37.916 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:37.918 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:37.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:37.930 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-27T22:41:38.164 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:38.169 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:38.169 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:38.321 INFO:teuthology.orchestra.run.smithi154.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:38.325 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/031 2023-11-27T22:41:38.325 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/031 2023-11-27T22:41:38.325 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:38.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:38.340 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-27T22:41:38.581 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:38.587 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:38.741 INFO:teuthology.orchestra.run.smithi154.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:38.745 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/032 2023-11-27T22:41:38.746 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/032 2023-11-27T22:41:38.746 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:38.748 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:38.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:38.759 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-27T22:41:39.007 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:39.014 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:39.014 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:39.162 INFO:teuthology.orchestra.run.smithi154.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:39.166 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/033 2023-11-27T22:41:39.166 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/033 2023-11-27T22:41:39.166 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:39.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:39.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:39.184 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-27T22:41:39.418 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:39.423 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:39.423 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:39.588 INFO:teuthology.orchestra.run.smithi154.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:39.592 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/034 2023-11-27T22:41:39.592 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/034 2023-11-27T22:41:39.593 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:39.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:39.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:39.607 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-27T22:41:39.836 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:39.842 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:39.842 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:40.084 INFO:teuthology.orchestra.run.smithi154.stdout:generic/035 1s 2023-11-27T22:41:40.091 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/035 2023-11-27T22:41:40.092 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:40.096 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:40.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:40.107 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-27T22:41:40.500 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:40.505 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:49.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:49.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:50.787 INFO:teuthology.orchestra.run.smithi154.stdout:generic/036 10s 2023-11-27T22:41:50.792 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/036 2023-11-27T22:41:50.792 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:50.797 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:50.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:50.812 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-27T22:41:51.199 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:51.204 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:51.204 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:51.359 INFO:teuthology.orchestra.run.smithi154.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:51.363 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/037 2023-11-27T22:41:51.363 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/037 2023-11-27T22:41:51.363 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:51.366 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:51.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:51.377 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-27T22:41:51.611 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:51.616 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:51.777 INFO:teuthology.orchestra.run.smithi154.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:51.781 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/038 2023-11-27T22:41:51.781 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/038 2023-11-27T22:41:51.781 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:51.784 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:51.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:51.794 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-27T22:41:52.037 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:52.043 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:52.043 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:52.203 INFO:teuthology.orchestra.run.smithi154.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:52.207 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/039 2023-11-27T22:41:52.208 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/039 2023-11-27T22:41:52.208 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:52.211 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:52.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:52.221 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-27T22:41:52.491 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:52.498 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:52.498 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:52.651 INFO:teuthology.orchestra.run.smithi154.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:52.654 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/040 2023-11-27T22:41:52.654 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/040 2023-11-27T22:41:52.655 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:52.657 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:52.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:52.665 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-27T22:41:52.826 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:52.830 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:52.830 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:52.952 INFO:teuthology.orchestra.run.smithi154.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:52.955 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/041 2023-11-27T22:41:52.955 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/041 2023-11-27T22:41:52.955 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:52.957 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:52.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:52.966 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-27T22:41:53.125 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:53.129 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:53.129 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:53.233 INFO:teuthology.orchestra.run.smithi154.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:53.237 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/042 2023-11-27T22:41:53.237 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/042 2023-11-27T22:41:53.237 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:53.239 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:53.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:53.247 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-27T22:41:53.406 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:53.410 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:53.410 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:53.515 INFO:teuthology.orchestra.run.smithi154.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:53.519 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/043 2023-11-27T22:41:53.519 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/043 2023-11-27T22:41:53.519 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:53.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:53.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:53.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-27T22:41:53.689 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:53.693 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:53.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:53.798 INFO:teuthology.orchestra.run.smithi154.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:53.801 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/044 2023-11-27T22:41:53.801 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/044 2023-11-27T22:41:53.801 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:53.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:53.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:53.812 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-27T22:41:53.973 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:53.977 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:53.977 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.082 INFO:teuthology.orchestra.run.smithi154.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:54.087 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/045 2023-11-27T22:41:54.088 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/045 2023-11-27T22:41:54.088 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:54.089 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:54.095 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-27T22:41:54.255 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:54.259 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.368 INFO:teuthology.orchestra.run.smithi154.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:54.371 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/046 2023-11-27T22:41:54.372 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/046 2023-11-27T22:41:54.372 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:54.374 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:54.382 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-27T22:41:54.542 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:54.546 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:54.546 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.650 INFO:teuthology.orchestra.run.smithi154.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:54.654 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/047 2023-11-27T22:41:54.654 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/047 2023-11-27T22:41:54.654 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:54.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:54.664 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-27T22:41:54.828 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:54.832 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:54.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.941 INFO:teuthology.orchestra.run.smithi154.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:54.944 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/048 2023-11-27T22:41:54.945 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/048 2023-11-27T22:41:54.945 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:54.947 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:54.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:54.955 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-27T22:41:55.118 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:55.121 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:55.121 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:55.226 INFO:teuthology.orchestra.run.smithi154.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:55.229 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/049 2023-11-27T22:41:55.229 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/049 2023-11-27T22:41:55.229 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:55.231 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:55.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:55.240 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-27T22:41:55.401 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:55.405 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:55.405 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:55.514 INFO:teuthology.orchestra.run.smithi154.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:55.517 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/050 2023-11-27T22:41:55.518 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/050 2023-11-27T22:41:55.518 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:55.520 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:55.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:55.528 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-27T22:41:55.688 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:55.692 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:55.692 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:55.797 INFO:teuthology.orchestra.run.smithi154.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:55.800 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/051 2023-11-27T22:41:55.801 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/051 2023-11-27T22:41:55.801 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:55.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:55.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:55.811 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-27T22:41:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:55.977 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:55.978 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.089 INFO:teuthology.orchestra.run.smithi154.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/052 2023-11-27T22:41:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/052 2023-11-27T22:41:56.092 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:56.094 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:56.103 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-27T22:41:56.263 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:56.267 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.370 INFO:teuthology.orchestra.run.smithi154.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:56.374 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/053 2023-11-27T22:41:56.374 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/053 2023-11-27T22:41:56.374 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:56.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:56.384 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-27T22:41:56.544 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:56.548 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:56.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.655 INFO:teuthology.orchestra.run.smithi154.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:56.658 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/054 2023-11-27T22:41:56.659 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/054 2023-11-27T22:41:56.659 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:56.669 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-27T22:41:56.830 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:56.834 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:56.834 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.942 INFO:teuthology.orchestra.run.smithi154.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:56.945 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/055 2023-11-27T22:41:56.945 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/055 2023-11-27T22:41:56.945 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:56.949 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:56.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:56.956 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-27T22:41:57.118 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:57.122 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:57.122 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:57.236 INFO:teuthology.orchestra.run.smithi154.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:57.239 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/056 2023-11-27T22:41:57.239 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/056 2023-11-27T22:41:57.239 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:57.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:57.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:57.250 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-27T22:41:57.409 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:57.413 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:57.413 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:57.531 INFO:teuthology.orchestra.run.smithi154.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:57.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/057 2023-11-27T22:41:57.534 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/057 2023-11-27T22:41:57.534 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:57.536 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:57.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:57.544 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-27T22:41:57.705 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:57.708 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:57.709 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:58.508 INFO:teuthology.orchestra.run.smithi154.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:41:58.512 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/058 2023-11-27T22:41:58.512 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/058 2023-11-27T22:41:58.512 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:58.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:58.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:58.567 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-27T22:41:58.917 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:58.921 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:58.921 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:59.033 INFO:teuthology.orchestra.run.smithi154.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:41:59.037 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/059 2023-11-27T22:41:59.037 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/059 2023-11-27T22:41:59.037 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:41:59.039 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:41:59.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:41:59.047 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-27T22:41:59.207 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:41:59.211 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:41:59.212 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:00.048 INFO:teuthology.orchestra.run.smithi154.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:42:00.051 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/060 2023-11-27T22:42:00.051 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/060 2023-11-27T22:42:00.052 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:00.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:00.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:00.113 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-27T22:42:00.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:00.458 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:00.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:01.280 INFO:teuthology.orchestra.run.smithi154.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:42:01.283 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/061 2023-11-27T22:42:01.283 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/061 2023-11-27T22:42:01.284 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:01.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:01.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:01.312 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-27T22:42:01.682 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:01.686 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:01.801 INFO:teuthology.orchestra.run.smithi154.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:01.804 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/062 2023-11-27T22:42:01.805 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/062 2023-11-27T22:42:01.805 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:01.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:01.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:01.815 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-27T22:42:01.976 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:01.980 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:01.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:02.791 INFO:teuthology.orchestra.run.smithi154.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T22:42:02.794 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/063 2023-11-27T22:42:02.794 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/063 2023-11-27T22:42:02.794 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:02.796 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:02.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:02.846 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-27T22:42:03.191 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:03.195 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:03.196 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:03.305 INFO:teuthology.orchestra.run.smithi154.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:03.307 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/064 2023-11-27T22:42:03.307 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/064 2023-11-27T22:42:03.308 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:03.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:03.318 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-27T22:42:03.481 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:03.485 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:03.486 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:03.607 INFO:teuthology.orchestra.run.smithi154.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:03.610 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/065 2023-11-27T22:42:03.610 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/065 2023-11-27T22:42:03.610 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:03.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:03.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:03.620 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-27T22:42:03.782 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:03.786 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:03.904 INFO:teuthology.orchestra.run.smithi154.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:03.909 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/066 2023-11-27T22:42:03.909 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/066 2023-11-27T22:42:03.909 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:03.910 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:03.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:03.918 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-27T22:42:04.079 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:04.082 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:04.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:04.208 INFO:teuthology.orchestra.run.smithi154.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:04.211 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/067 2023-11-27T22:42:04.211 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/067 2023-11-27T22:42:04.211 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:04.213 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:04.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:04.221 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-27T22:42:04.383 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:04.387 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:04.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:04.509 INFO:teuthology.orchestra.run.smithi154.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:04.512 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/068 2023-11-27T22:42:04.512 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/068 2023-11-27T22:42:04.512 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:04.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:04.534 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-27T22:42:04.693 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:04.697 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:04.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:04.802 INFO:teuthology.orchestra.run.smithi154.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:04.806 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/069 2023-11-27T22:42:04.806 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/069 2023-11-27T22:42:04.806 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:04.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:04.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:04.817 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-27T22:42:04.979 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:04.983 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:19.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:19.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:50.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:50.158 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:58.475 INFO:teuthology.orchestra.run.smithi154.stdout:generic/070 54s 2023-11-27T22:42:58.480 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/070 2023-11-27T22:42:58.480 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:58.482 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:58.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:58.493 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-27T22:42:58.878 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:58.882 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:58.882 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:58.996 INFO:teuthology.orchestra.run.smithi154.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:42:59.001 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/071 2023-11-27T22:42:59.001 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/071 2023-11-27T22:42:59.001 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:42:59.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:42:59.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:42:59.010 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-27T22:42:59.171 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:42:59.175 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:42:59.175 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:43:00.350 INFO:teuthology.orchestra.run.smithi154.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-27T22:43:00.354 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/072 2023-11-27T22:43:00.354 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/072 2023-11-27T22:43:00.354 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:43:00.357 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:43:00.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:43:00.371 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-27T22:43:00.612 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:43:00.617 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:43:00.617 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:43:00.781 INFO:teuthology.orchestra.run.smithi154.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T22:43:00.784 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/073 2023-11-27T22:43:00.785 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/073 2023-11-27T22:43:00.785 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T22:43:00.787 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:43:00.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T22:43:00.799 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-27T22:43:01.042 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T22:43:01.045 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T22:43:01.045 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T22:43:20.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:20.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:50.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:50.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:21.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:21.433 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:51.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:51.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:21.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:21.751 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:52.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:52.008 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:22.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:22.252 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:52.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:52.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:22.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:22.705 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:52.849 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:52.852 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:22.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:23.437 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:53.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:53.505 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:23.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:23.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:53.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:53.984 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:24.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:24.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:54.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:54.398 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:24.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:25.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:55.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:55.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:25.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:25.272 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:55.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:55.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:25.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:25.464 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:55.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:55.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:25.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:25.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:56.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:56.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:26.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:26.127 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:56.508 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:56.511 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:26.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:26.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:56.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:56.813 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:26.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:26.914 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:57.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:57.014 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:27.121 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:27.124 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:57.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:57.375 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:27.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:27.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:57.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:57.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:27.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:27.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:58.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:58.254 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:16.340 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T23:01:16.338+0000 7f09ff715640 -1 bdev(0x55b971fa9500 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2023-11-27T23:01:16.340 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T23:01:16.339+0000 7f0a00717640 -1 bdev(0x55b971fa9500 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 4 2023-11-27T23:01:28.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:28.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:58.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:58.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:28.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:28.806 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:59.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:59.072 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:29.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:29.202 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:59.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:59.656 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:29.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:29.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:59.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:59.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:59.895 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T23:04:59.894+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198549) UID: 0 2023-11-27T23:04:59.895 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T23:04:59.894+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198549) UID: 0 2023-11-27T23:04:59.895 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T23:04:59.894+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198549) UID: 0 2023-11-27T23:04:59.896 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T23:04:59.894+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198549) UID: 0 2023-11-27T23:08:34.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:34.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:34.317 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T23:08:34.315+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97802) UID: 0 2023-11-27T23:08:34.317 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T23:08:34.315+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97802) UID: 0 2023-11-27T23:08:34.317 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T23:08:34.316+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97802) UID: 0 2023-11-27T23:08:34.329 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T23:08:34.315+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97802) UID: 0 2023-11-27T23:11:34.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:34.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:59.599 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T23:11:59.598+0000 7f836bc7a640 -1 bdev(0x56262305ce00 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2023-11-27T23:12:04.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:04.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:04.619 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T23:12:04.618+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97845) UID: 0 2023-11-27T23:12:04.619 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T23:12:04.618+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97845) UID: 0 2023-11-27T23:12:04.619 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T23:12:04.618+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97845) UID: 0 2023-11-27T23:12:04.620 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T23:12:04.618+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97845) UID: 0 2023-11-27T23:12:45.544 INFO:teuthology.orchestra.run.smithi154.stdout:generic/074 1784s 2023-11-27T23:12:45.603 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/074 2023-11-27T23:12:45.603 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:12:45.612 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:12:45.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:12:45.650 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-27T23:12:46.237 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:12:46.241 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:12:46.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:24.282 INFO:teuthology.orchestra.run.smithi154.stdout:generic/075 38s 2023-11-27T23:13:24.286 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/075 2023-11-27T23:13:24.286 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:24.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:24.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:24.314 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-27T23:13:24.718 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:24.722 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:24.835 INFO:teuthology.orchestra.run.smithi154.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:24.838 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/076 2023-11-27T23:13:24.838 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/076 2023-11-27T23:13:24.838 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:24.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:24.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:24.849 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-27T23:13:25.010 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:25.014 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:25.014 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:25.830 INFO:teuthology.orchestra.run.smithi154.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:25.833 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/077 2023-11-27T23:13:25.833 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/077 2023-11-27T23:13:25.833 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:25.835 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:25.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:25.844 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-27T23:13:26.008 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:26.012 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:26.012 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:26.166 INFO:teuthology.orchestra.run.smithi154.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-27T23:13:26.169 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/078 2023-11-27T23:13:26.169 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/078 2023-11-27T23:13:26.169 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:26.172 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:26.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:26.181 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-27T23:13:26.597 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:26.601 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:26.602 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:26.789 INFO:teuthology.orchestra.run.smithi154.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-27T23:13:26.793 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/079 2023-11-27T23:13:26.793 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/079 2023-11-27T23:13:26.793 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:26.795 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:26.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:26.803 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-27T23:13:26.966 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:26.970 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:26.970 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:29.128 INFO:teuthology.orchestra.run.smithi154.stdout:generic/080 3s 2023-11-27T23:13:29.135 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/080 2023-11-27T23:13:29.135 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:29.138 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:29.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:29.148 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-27T23:13:29.316 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:29.320 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:29.320 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:29.433 INFO:teuthology.orchestra.run.smithi154.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:29.437 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/081 2023-11-27T23:13:29.437 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/081 2023-11-27T23:13:29.437 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:29.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:29.447 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-27T23:13:29.609 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:29.613 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:29.613 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:29.723 INFO:teuthology.orchestra.run.smithi154.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:29.727 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/082 2023-11-27T23:13:29.727 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/082 2023-11-27T23:13:29.727 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:29.729 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:29.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:29.738 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-27T23:13:29.900 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:29.904 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:29.905 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:30.014 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/083 2023-11-27T23:13:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/083 2023-11-27T23:13:30.015 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:30.016 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:30.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:30.025 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-27T23:13:30.191 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:30.195 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:30.195 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:30.300 INFO:teuthology.orchestra.run.smithi154.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:30.304 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/084 2023-11-27T23:13:30.304 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/084 2023-11-27T23:13:30.304 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:30.306 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:30.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:30.315 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-27T23:13:30.478 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:30.482 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:30.482 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:30.609 INFO:teuthology.orchestra.run.smithi154.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:13:30.613 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/085 2023-11-27T23:13:30.613 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/085 2023-11-27T23:13:30.613 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:30.615 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:30.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:30.623 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-27T23:13:30.787 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:30.791 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:30.791 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:35.544 INFO:teuthology.orchestra.run.smithi154.stdout:generic/086 5s 2023-11-27T23:13:35.581 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/086 2023-11-27T23:13:35.581 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:35.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:35.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:35.681 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-27T23:13:36.754 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:36.764 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:36.764 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:37.131 INFO:teuthology.orchestra.run.smithi154.stdout:generic/087 1s 2023-11-27T23:13:37.137 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/087 2023-11-27T23:13:37.137 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:37.139 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:37.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:37.148 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-27T23:13:37.564 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:37.569 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:37.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:37.748 INFO:teuthology.orchestra.run.smithi154.stdout:generic/088 0s 2023-11-27T23:13:37.753 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/088 2023-11-27T23:13:37.753 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:13:37.756 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:13:37.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:13:37.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-27T23:13:38.181 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:13:38.185 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:13:38.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:14:27.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:27.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:58.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:58.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:28.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:28.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:58.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:58.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:28.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:28.626 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:29.048 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-27T23:16:29.046+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 206311) UID: 0 2023-11-27T23:16:29.048 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-27T23:16:29.046+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 206311) UID: 0 2023-11-27T23:19:57.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:57.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:28.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:28.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:28.104 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-27T23:20:28.103+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 206563) UID: 0 2023-11-27T23:20:28.104 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-27T23:20:28.103+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 206563) UID: 0 2023-11-27T23:22:56.729 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T23:22:56.727+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 208573) UID: 0 2023-11-27T23:22:56.730 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T23:22:56.727+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 208573) UID: 0 2023-11-27T23:22:56.730 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T23:22:56.727+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 208573) UID: 0 2023-11-27T23:22:56.731 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T23:22:56.727+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 208573) UID: 0 2023-11-27T23:27:02.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:02.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:02.134 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-27T23:27:02.133+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98003) UID: 0 2023-11-27T23:27:02.134 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-27T23:27:02.133+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98003) UID: 0 2023-11-27T23:27:02.135 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-27T23:27:02.133+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98003) UID: 0 2023-11-27T23:27:02.135 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-27T23:27:02.133+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98003) UID: 0 2023-11-27T23:27:02.322 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-27T23:27:02.321+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 208599) UID: 0 2023-11-27T23:27:02.322 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-27T23:27:02.321+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 208599) UID: 0 2023-11-27T23:28:04.623 INFO:teuthology.orchestra.run.smithi154.stdout:generic/089 866s 2023-11-27T23:28:04.710 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/089 2023-11-27T23:28:04.710 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:28:04.712 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:28:04.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:28:04.739 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-27T23:28:05.473 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:28:05.477 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:28:05.477 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:28:05.858 INFO:teuthology.orchestra.run.smithi154.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:28:05.862 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/090 2023-11-27T23:28:05.862 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/090 2023-11-27T23:28:05.862 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:28:05.864 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:28:05.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:28:05.873 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-27T23:28:06.036 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:28:06.040 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:28:06.040 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:08.983 INFO:teuthology.orchestra.run.smithi154.stdout:generic/091 122s 2023-11-27T23:30:08.988 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/091 2023-11-27T23:30:08.988 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:08.991 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:09.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:09.001 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-27T23:30:09.473 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:09.477 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:09.650 INFO:teuthology.orchestra.run.smithi154.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T23:30:09.654 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/092 2023-11-27T23:30:09.654 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/092 2023-11-27T23:30:09.654 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:09.656 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:09.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:09.665 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-27T23:30:10.106 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:10.112 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:10.939 INFO:teuthology.orchestra.run.smithi154.stdout:generic/093 0s 2023-11-27T23:30:10.944 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/093 2023-11-27T23:30:10.944 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:10.946 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:10.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:10.956 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-27T23:30:11.409 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:11.416 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:11.416 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:11.546 INFO:teuthology.orchestra.run.smithi154.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:11.549 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/094 2023-11-27T23:30:11.549 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/094 2023-11-27T23:30:11.549 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:11.552 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:11.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:11.561 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-27T23:30:11.728 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:11.731 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:11.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:11.837 INFO:teuthology.orchestra.run.smithi154.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:11.841 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/095 2023-11-27T23:30:11.841 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/095 2023-11-27T23:30:11.841 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:11.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:11.852 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-27T23:30:12.015 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:12.019 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:12.019 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:12.125 INFO:teuthology.orchestra.run.smithi154.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:12.129 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/096 2023-11-27T23:30:12.129 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/096 2023-11-27T23:30:12.129 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:12.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:12.140 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-27T23:30:12.306 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:12.310 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:12.310 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:12.923 INFO:teuthology.orchestra.run.smithi154.stdout:generic/097 0s 2023-11-27T23:30:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/097 2023-11-27T23:30:12.930 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:12.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:12.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:12.943 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-27T23:30:13.109 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:13.113 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:13.113 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:13.217 INFO:teuthology.orchestra.run.smithi154.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:13.220 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/098 2023-11-27T23:30:13.221 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/098 2023-11-27T23:30:13.221 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:13.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:13.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:13.231 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-27T23:30:13.396 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:13.400 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:13.543 INFO:teuthology.orchestra.run.smithi154.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-27T23:30:13.546 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/099 2023-11-27T23:30:13.546 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/099 2023-11-27T23:30:13.547 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:13.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:13.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:13.557 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-27T23:30:13.721 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:13.725 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:13.725 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:41.620 INFO:teuthology.orchestra.run.smithi154.stdout:generic/100 28s 2023-11-27T23:30:41.625 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/100 2023-11-27T23:30:41.625 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:41.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:41.644 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-27T23:30:42.123 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:42.138 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:42.138 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:42.354 INFO:teuthology.orchestra.run.smithi154.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:42.358 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/101 2023-11-27T23:30:42.359 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/101 2023-11-27T23:30:42.359 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:42.361 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:42.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:42.370 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-27T23:30:42.554 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:42.558 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:42.558 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:42.663 INFO:teuthology.orchestra.run.smithi154.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:42.674 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/102 2023-11-27T23:30:42.674 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/102 2023-11-27T23:30:42.674 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:42.674 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:42.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:42.677 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-27T23:30:42.842 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:42.846 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:42.951 INFO:teuthology.orchestra.run.smithi154.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:42.955 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/103 2023-11-27T23:30:42.955 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/103 2023-11-27T23:30:42.955 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:42.957 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:42.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:42.966 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-27T23:30:43.132 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:43.136 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:43.136 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:43.251 INFO:teuthology.orchestra.run.smithi154.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:43.255 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/104 2023-11-27T23:30:43.255 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/104 2023-11-27T23:30:43.255 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:43.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:43.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:43.266 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-27T23:30:43.428 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:43.432 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:43.432 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:43.537 INFO:teuthology.orchestra.run.smithi154.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:43.540 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/105 2023-11-27T23:30:43.540 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/105 2023-11-27T23:30:43.540 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:43.542 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:43.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:43.551 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-27T23:30:43.714 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:43.717 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:43.718 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:43.844 INFO:teuthology.orchestra.run.smithi154.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:43.847 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/106 2023-11-27T23:30:43.847 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/106 2023-11-27T23:30:43.847 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:43.849 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:43.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:43.858 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-27T23:30:44.025 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:44.029 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:44.029 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:44.146 INFO:teuthology.orchestra.run.smithi154.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:44.149 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/107 2023-11-27T23:30:44.149 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/107 2023-11-27T23:30:44.150 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:44.152 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:44.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:44.160 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-27T23:30:44.322 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:44.326 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:44.635 INFO:teuthology.orchestra.run.smithi154.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:44.638 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/108 2023-11-27T23:30:44.639 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/108 2023-11-27T23:30:44.639 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:44.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:44.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:44.650 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-27T23:30:44.813 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:44.817 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:44.817 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:44.925 INFO:teuthology.orchestra.run.smithi154.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:30:44.929 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/109 2023-11-27T23:30:44.929 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/109 2023-11-27T23:30:44.929 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:44.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:44.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:44.940 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-27T23:30:45.108 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:45.112 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:45.112 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:45.266 INFO:teuthology.orchestra.run.smithi154.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:30:45.270 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/110 2023-11-27T23:30:45.270 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/110 2023-11-27T23:30:45.270 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:45.272 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:45.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:45.281 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-27T23:30:45.738 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:45.745 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:45.745 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:46.139 INFO:teuthology.orchestra.run.smithi154.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:30:46.142 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/111 2023-11-27T23:30:46.142 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/111 2023-11-27T23:30:46.142 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:30:46.144 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:30:46.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:30:46.189 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-27T23:30:46.626 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:30:46.631 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:30:46.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:31:28.451 INFO:teuthology.orchestra.run.smithi154.stdout:generic/112 42s 2023-11-27T23:31:28.456 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/112 2023-11-27T23:31:28.456 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:31:28.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:31:28.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:31:28.467 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-27T23:31:28.918 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:31:28.924 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:31:28.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:14.175 INFO:teuthology.orchestra.run.smithi154.stdout:generic/113 46s 2023-11-27T23:32:14.181 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/113 2023-11-27T23:32:14.181 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:14.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:14.199 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-27T23:32:14.685 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:14.690 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:14.690 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:14.897 INFO:teuthology.orchestra.run.smithi154.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-27T23:32:14.900 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/114 2023-11-27T23:32:14.900 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/114 2023-11-27T23:32:14.900 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:14.903 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:14.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:14.912 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-27T23:32:15.074 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:15.078 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:15.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:15.227 INFO:teuthology.orchestra.run.smithi154.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:32:15.231 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/115 2023-11-27T23:32:15.231 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/115 2023-11-27T23:32:15.231 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:15.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:15.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:15.242 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-27T23:32:15.668 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:15.673 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:15.673 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:15.822 INFO:teuthology.orchestra.run.smithi154.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:32:15.825 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/116 2023-11-27T23:32:15.825 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/116 2023-11-27T23:32:15.826 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:15.828 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:15.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:15.837 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-27T23:32:16.284 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:16.288 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:16.288 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:16.395 INFO:teuthology.orchestra.run.smithi154.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:32:16.399 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/117 2023-11-27T23:32:16.399 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/117 2023-11-27T23:32:16.399 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:16.401 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:16.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:16.409 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-27T23:32:16.573 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:16.577 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:16.577 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:16.722 INFO:teuthology.orchestra.run.smithi154.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:32:16.726 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/118 2023-11-27T23:32:16.726 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/118 2023-11-27T23:32:16.726 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:16.728 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:16.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:16.737 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-27T23:32:17.168 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:17.172 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:17.172 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:17.318 INFO:teuthology.orchestra.run.smithi154.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:32:17.321 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/119 2023-11-27T23:32:17.321 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/119 2023-11-27T23:32:17.321 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:17.324 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:17.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:17.334 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-27T23:32:17.773 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:17.778 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:17.778 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:18.057 INFO:teuthology.orchestra.run.smithi154.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:32:18.061 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/120 2023-11-27T23:32:18.061 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/120 2023-11-27T23:32:18.061 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:18.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:18.071 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-27T23:32:18.233 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:18.237 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:18.237 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:18.386 INFO:teuthology.orchestra.run.smithi154.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-27T23:32:18.390 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/121 2023-11-27T23:32:18.390 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/121 2023-11-27T23:32:18.390 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:18.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:18.401 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-27T23:32:18.828 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:18.832 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:18.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:18.998 INFO:teuthology.orchestra.run.smithi154.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-27T23:32:19.001 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/122 2023-11-27T23:32:19.001 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/122 2023-11-27T23:32:19.001 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:19.003 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:19.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:19.012 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-27T23:32:19.434 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:19.438 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:19.438 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:20.057 INFO:teuthology.orchestra.run.smithi154.stdout:generic/123 1s 2023-11-27T23:32:20.062 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/123 2023-11-27T23:32:20.062 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:20.065 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:20.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:20.074 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-27T23:32:20.512 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:20.517 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:20.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:20.628 INFO:teuthology.orchestra.run.smithi154.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:32:20.631 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/124 2023-11-27T23:32:20.631 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/124 2023-11-27T23:32:20.631 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:32:20.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:20.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:32:20.643 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-27T23:32:20.806 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:32:20.810 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:32:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:32:42.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:42.185 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:12.249 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:12.252 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:22.148 INFO:teuthology.orchestra.run.smithi154.stdout:generic/125 62s 2023-11-27T23:33:22.154 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/125 2023-11-27T23:33:22.154 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:33:22.157 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:33:22.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:33:22.190 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-27T23:33:22.590 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:33:22.594 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:33:22.594 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:33:23.118 INFO:teuthology.orchestra.run.smithi154.stdout:generic/126 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/126.out.bad) 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/126.out 2023-11-27 22:30:53.823023342 +0000 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/126.out.bad 2023-11-27 23:33:23.116500732 +0000 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,7 +1,7 @@ 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 126 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-11-27T23:33:23.120 INFO:teuthology.orchestra.run.smithi154.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-11-27T23:33:23.121 INFO:teuthology.orchestra.run.smithi154.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-11-27T23:33:23.121 INFO:teuthology.orchestra.run.smithi154.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-11-27T23:33:23.121 INFO:teuthology.orchestra.run.smithi154.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-11-27T23:33:23.121 INFO:teuthology.orchestra.run.smithi154.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-11-27T23:33:23.121 INFO:teuthology.orchestra.run.smithi154.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-11-27T23:33:23.122 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/126 2023-11-27T23:33:23.122 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/126 2023-11-27T23:33:23.122 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T23:33:23.125 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:33:23.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:33:23.133 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:33:23.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:33:23.133 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-27T23:33:23.583 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:33:23.588 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:33:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:33:42.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:42.323 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:12.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:12.490 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:42.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:42.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:12.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:12.648 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:42.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:42.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:12.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:12.799 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:42.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:42.938 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:12.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:12.995 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:43.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:43.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:13.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:13.161 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:43.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:43.284 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:13.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:13.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:43.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:43.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:13.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:13.806 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:43.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:43.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:13.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:13.984 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:44.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:44.067 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:14.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:14.119 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:44.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:44.266 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:14.652 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:14.660 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:44.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:44.727 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:14.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:14.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:45.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:45.154 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:15.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:15.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:45.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:45.350 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:15.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:15.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:24.670 INFO:teuthology.orchestra.run.smithi154.stdout:generic/127 781s 2023-11-27T23:46:24.675 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/127 2023-11-27T23:46:24.675 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:46:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:24.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:46:24.687 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-27T23:46:25.126 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:46:25.130 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:46:25.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:25.236 INFO:teuthology.orchestra.run.smithi154.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:46:25.239 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/128 2023-11-27T23:46:25.240 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/128 2023-11-27T23:46:25.240 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:46:25.242 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:25.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:46:25.250 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-27T23:46:25.416 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:46:25.420 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:46:25.420 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:25.525 INFO:teuthology.orchestra.run.smithi154.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:46:25.529 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/129 2023-11-27T23:46:25.529 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/129 2023-11-27T23:46:25.529 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:46:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:25.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:46:25.540 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-27T23:46:25.706 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:46:25.710 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:46:25.710 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:25.815 INFO:teuthology.orchestra.run.smithi154.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:46:25.818 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/130 2023-11-27T23:46:25.818 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/130 2023-11-27T23:46:25.818 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:46:25.821 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:25.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:46:25.829 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-27T23:46:25.995 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:46:25.999 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:46:25.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:27.293 INFO:teuthology.orchestra.run.smithi154.stdout:generic/131 1s 2023-11-27T23:46:27.299 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/131 2023-11-27T23:46:27.299 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:46:27.301 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:27.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:46:27.310 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-27T23:46:27.748 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:46:27.752 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:46:27.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:27.865 INFO:teuthology.orchestra.run.smithi154.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:46:27.868 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/132 2023-11-27T23:46:27.868 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/132 2023-11-27T23:46:27.868 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:46:27.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:27.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:46:27.879 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-27T23:46:28.045 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:46:28.049 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:46:28.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:46:45.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:45.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:15.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:15.738 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:45.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:45.793 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:15.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:15.852 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:45.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:45.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:16.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:16.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:46.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:46.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:06.882 INFO:teuthology.orchestra.run.smithi154.stdout:generic/133 218s 2023-11-27T23:50:06.887 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/133 2023-11-27T23:50:06.887 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:06.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:06.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:06.898 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-27T23:50:07.341 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:07.345 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:07.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:07.491 INFO:teuthology.orchestra.run.smithi154.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:07.495 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/134 2023-11-27T23:50:07.495 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/134 2023-11-27T23:50:07.495 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:07.497 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:07.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:07.505 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-27T23:50:07.973 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:07.980 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:08.178 INFO:teuthology.orchestra.run.smithi154.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/135 2023-11-27T23:50:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/135 2023-11-27T23:50:08.182 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:08.184 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:08.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:08.193 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-27T23:50:08.357 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:08.360 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:08.361 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:08.511 INFO:teuthology.orchestra.run.smithi154.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:08.515 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/136 2023-11-27T23:50:08.515 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/136 2023-11-27T23:50:08.515 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:08.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:08.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:08.526 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-27T23:50:08.956 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:08.961 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:09.120 INFO:teuthology.orchestra.run.smithi154.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:09.123 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/137 2023-11-27T23:50:09.123 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/137 2023-11-27T23:50:09.123 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:09.125 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:09.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:09.134 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-27T23:50:09.574 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:09.578 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:09.579 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:09.730 INFO:teuthology.orchestra.run.smithi154.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:09.734 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/138 2023-11-27T23:50:09.734 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/138 2023-11-27T23:50:09.734 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:09.736 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:09.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:09.745 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-27T23:50:10.178 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:10.183 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:10.183 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:10.332 INFO:teuthology.orchestra.run.smithi154.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:10.336 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/139 2023-11-27T23:50:10.336 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/139 2023-11-27T23:50:10.336 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:10.338 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:10.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:10.347 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-27T23:50:10.760 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:10.766 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:10.766 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:10.919 INFO:teuthology.orchestra.run.smithi154.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:10.923 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/140 2023-11-27T23:50:10.923 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/140 2023-11-27T23:50:10.923 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:10.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:10.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:10.935 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-27T23:50:11.357 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:11.362 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:11.362 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:11.473 INFO:teuthology.orchestra.run.smithi154.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:11.476 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/141 2023-11-27T23:50:11.476 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/141 2023-11-27T23:50:11.477 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:11.479 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:11.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:11.487 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-27T23:50:11.651 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:11.655 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:11.655 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:11.802 INFO:teuthology.orchestra.run.smithi154.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:11.806 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/142 2023-11-27T23:50:11.806 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/142 2023-11-27T23:50:11.806 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:11.808 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:11.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:11.817 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-27T23:50:12.257 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:12.261 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:12.261 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:12.411 INFO:teuthology.orchestra.run.smithi154.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:12.414 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/143 2023-11-27T23:50:12.414 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/143 2023-11-27T23:50:12.414 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:12.417 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:12.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:12.425 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-27T23:50:12.867 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:12.871 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:12.871 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:13.021 INFO:teuthology.orchestra.run.smithi154.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:13.024 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/144 2023-11-27T23:50:13.024 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/144 2023-11-27T23:50:13.024 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:13.026 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:13.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:13.035 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-27T23:50:13.466 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:13.470 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:13.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:13.620 INFO:teuthology.orchestra.run.smithi154.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:13.624 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/145 2023-11-27T23:50:13.624 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/145 2023-11-27T23:50:13.624 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:13.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:13.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:13.635 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-27T23:50:14.073 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:14.078 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:14.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:14.224 INFO:teuthology.orchestra.run.smithi154.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:14.228 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/146 2023-11-27T23:50:14.228 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/146 2023-11-27T23:50:14.228 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:14.230 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:14.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:14.239 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-27T23:50:14.674 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:14.678 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:14.679 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:14.831 INFO:teuthology.orchestra.run.smithi154.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:14.834 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/147 2023-11-27T23:50:14.834 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/147 2023-11-27T23:50:14.835 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:14.836 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:14.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:14.885 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-27T23:50:15.289 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:15.293 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:15.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:15.440 INFO:teuthology.orchestra.run.smithi154.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:15.443 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/148 2023-11-27T23:50:15.443 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/148 2023-11-27T23:50:15.443 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:15.445 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:15.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:15.468 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-27T23:50:15.884 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:15.889 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:15.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:16.042 INFO:teuthology.orchestra.run.smithi154.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:16.045 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/149 2023-11-27T23:50:16.045 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/149 2023-11-27T23:50:16.046 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:16.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:16.056 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-27T23:50:16.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:16.223 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:16.490 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:16.494 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:16.494 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:16.641 INFO:teuthology.orchestra.run.smithi154.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:16.645 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/150 2023-11-27T23:50:16.645 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/150 2023-11-27T23:50:16.645 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:16.647 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:16.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:16.656 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-27T23:50:17.096 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:17.100 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:17.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:17.251 INFO:teuthology.orchestra.run.smithi154.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:17.254 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/151 2023-11-27T23:50:17.254 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/151 2023-11-27T23:50:17.255 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:17.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:17.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:17.266 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-27T23:50:17.697 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:17.702 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:17.702 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:17.859 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/152 2023-11-27T23:50:17.860 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/152 2023-11-27T23:50:17.860 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:17.862 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:17.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:17.871 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-27T23:50:18.315 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:18.319 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:18.319 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:18.467 INFO:teuthology.orchestra.run.smithi154.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:18.470 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/153 2023-11-27T23:50:18.470 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/153 2023-11-27T23:50:18.470 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:18.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:18.497 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-27T23:50:18.919 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:18.923 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:18.923 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:19.076 INFO:teuthology.orchestra.run.smithi154.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:19.080 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/154 2023-11-27T23:50:19.080 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/154 2023-11-27T23:50:19.080 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:19.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:19.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:19.091 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-27T23:50:19.532 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:19.536 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:19.536 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:19.685 INFO:teuthology.orchestra.run.smithi154.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:19.689 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/155 2023-11-27T23:50:19.689 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/155 2023-11-27T23:50:19.689 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:19.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:19.700 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-27T23:50:20.118 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:20.124 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:20.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:20.280 INFO:teuthology.orchestra.run.smithi154.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:20.283 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/156 2023-11-27T23:50:20.283 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/156 2023-11-27T23:50:20.284 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:20.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:20.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:20.295 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-27T23:50:20.731 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:20.735 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:20.735 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:20.887 INFO:teuthology.orchestra.run.smithi154.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:20.890 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/157 2023-11-27T23:50:20.891 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/157 2023-11-27T23:50:20.891 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:20.893 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:20.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:20.902 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-27T23:50:21.335 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:21.339 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:21.339 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:21.490 INFO:teuthology.orchestra.run.smithi154.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:21.494 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/158 2023-11-27T23:50:21.494 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/158 2023-11-27T23:50:21.494 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:21.496 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:21.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:21.506 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-27T23:50:21.945 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:21.949 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:21.949 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:22.114 INFO:teuthology.orchestra.run.smithi154.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-27T23:50:22.117 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/159 2023-11-27T23:50:22.118 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/159 2023-11-27T23:50:22.118 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:22.120 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:22.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:22.140 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-27T23:50:22.304 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:22.308 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:22.308 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:22.452 INFO:teuthology.orchestra.run.smithi154.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-27T23:50:22.456 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/160 2023-11-27T23:50:22.456 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/160 2023-11-27T23:50:22.456 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:22.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:22.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:22.467 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-27T23:50:22.633 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:22.637 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:22.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:22.741 INFO:teuthology.orchestra.run.smithi154.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:22.744 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/161 2023-11-27T23:50:22.744 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/161 2023-11-27T23:50:22.745 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:22.747 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:22.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:22.755 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-27T23:50:22.918 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:22.922 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:22.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.028 INFO:teuthology.orchestra.run.smithi154.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:23.031 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/162 2023-11-27T23:50:23.031 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/162 2023-11-27T23:50:23.031 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:23.033 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:23.042 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-27T23:50:23.205 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:23.209 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.325 INFO:teuthology.orchestra.run.smithi154.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:23.328 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/163 2023-11-27T23:50:23.328 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/163 2023-11-27T23:50:23.329 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:23.330 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:23.339 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-27T23:50:23.503 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:23.507 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:23.507 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.613 INFO:teuthology.orchestra.run.smithi154.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:23.617 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/164 2023-11-27T23:50:23.617 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/164 2023-11-27T23:50:23.617 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:23.628 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-27T23:50:23.791 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:23.795 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:23.795 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.906 INFO:teuthology.orchestra.run.smithi154.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:23.910 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/165 2023-11-27T23:50:23.910 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/165 2023-11-27T23:50:23.910 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:23.912 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:23.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:23.921 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-27T23:50:24.084 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:24.088 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:24.088 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:24.199 INFO:teuthology.orchestra.run.smithi154.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:24.203 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/166 2023-11-27T23:50:24.203 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/166 2023-11-27T23:50:24.203 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:24.205 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:24.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:24.214 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-27T23:50:24.380 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:24.384 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:24.384 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:24.488 INFO:teuthology.orchestra.run.smithi154.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:24.492 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/167 2023-11-27T23:50:24.492 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/167 2023-11-27T23:50:24.492 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:24.494 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:24.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:24.503 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-27T23:50:24.666 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:24.670 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:24.671 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:24.776 INFO:teuthology.orchestra.run.smithi154.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:24.780 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/168 2023-11-27T23:50:24.780 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/168 2023-11-27T23:50:24.780 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:24.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:24.791 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-27T23:50:24.955 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:24.959 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:24.959 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.065 INFO:teuthology.orchestra.run.smithi154.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:25.069 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/169 2023-11-27T23:50:25.069 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/169 2023-11-27T23:50:25.069 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:25.070 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:25.092 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-27T23:50:25.257 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:25.261 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:25.261 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.366 INFO:teuthology.orchestra.run.smithi154.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:25.370 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/170 2023-11-27T23:50:25.370 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/170 2023-11-27T23:50:25.370 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:25.372 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:25.381 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-27T23:50:25.545 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:25.549 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.675 INFO:teuthology.orchestra.run.smithi154.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:25.678 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/171 2023-11-27T23:50:25.678 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/171 2023-11-27T23:50:25.679 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:25.681 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:25.708 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-27T23:50:25.873 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:25.877 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:25.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:25.988 INFO:teuthology.orchestra.run.smithi154.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:25.991 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/172 2023-11-27T23:50:25.992 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/172 2023-11-27T23:50:25.992 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:25.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:26.002 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-27T23:50:26.164 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:26.168 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:26.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.277 INFO:teuthology.orchestra.run.smithi154.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:26.281 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/173 2023-11-27T23:50:26.281 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/173 2023-11-27T23:50:26.281 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:26.283 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:26.292 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-27T23:50:26.456 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:26.460 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:26.460 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.570 INFO:teuthology.orchestra.run.smithi154.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:26.573 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/174 2023-11-27T23:50:26.573 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/174 2023-11-27T23:50:26.574 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:26.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:26.584 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-27T23:50:26.747 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:26.751 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:26.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.858 INFO:teuthology.orchestra.run.smithi154.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:26.862 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/175 2023-11-27T23:50:26.862 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/175 2023-11-27T23:50:26.862 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:26.864 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:26.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:26.872 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-27T23:50:27.035 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:27.039 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:27.040 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:27.150 INFO:teuthology.orchestra.run.smithi154.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:27.153 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/176 2023-11-27T23:50:27.154 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/176 2023-11-27T23:50:27.154 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:27.156 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:27.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:27.173 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-27T23:50:27.337 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:27.341 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:27.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:27.479 INFO:teuthology.orchestra.run.smithi154.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:27.482 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/177 2023-11-27T23:50:27.482 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/177 2023-11-27T23:50:27.482 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:27.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:27.493 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-27T23:50:27.657 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:27.661 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:27.661 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:27.811 INFO:teuthology.orchestra.run.smithi154.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:27.814 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/178 2023-11-27T23:50:27.814 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/178 2023-11-27T23:50:27.814 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:27.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:27.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:27.825 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-27T23:50:28.260 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:28.265 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:28.265 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:28.413 INFO:teuthology.orchestra.run.smithi154.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:28.416 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/179 2023-11-27T23:50:28.416 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/179 2023-11-27T23:50:28.416 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:28.419 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:28.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:28.427 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-27T23:50:28.860 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:28.865 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:28.866 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:29.273 INFO:teuthology.orchestra.run.smithi154.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:29.277 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/180 2023-11-27T23:50:29.277 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/180 2023-11-27T23:50:29.277 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:29.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:29.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:29.324 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-27T23:50:29.727 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:29.731 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:29.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:29.887 INFO:teuthology.orchestra.run.smithi154.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:29.890 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/181 2023-11-27T23:50:29.890 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/181 2023-11-27T23:50:29.890 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:29.893 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:29.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:29.901 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-27T23:50:30.328 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:30.333 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:30.333 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:30.489 INFO:teuthology.orchestra.run.smithi154.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-27T23:50:30.492 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/182 2023-11-27T23:50:30.492 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/182 2023-11-27T23:50:30.492 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:30.495 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:30.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:30.503 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-27T23:50:30.935 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:30.939 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:30.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.048 INFO:teuthology.orchestra.run.smithi154.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:31.051 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/183 2023-11-27T23:50:31.051 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/183 2023-11-27T23:50:31.051 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:31.053 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:31.062 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-27T23:50:31.226 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:31.230 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:31.230 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.385 INFO:teuthology.orchestra.run.smithi154.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/184.out.bad) 2023-11-27T23:50:31.387 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/184.out 2023-11-27 22:30:53.827023239 +0000 2023-11-27T23:50:31.387 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/184.out.bad 2023-11-27 23:50:31.382939362 +0000 2023-11-27T23:50:31.387 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1 +1,2 @@ 2023-11-27T23:50:31.387 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 184 2023-11-27T23:50:31.387 INFO:teuthology.orchestra.run.smithi154.stdout: +/tmp/tmp.1EbDOAX7rXxfstests-dev/tests/generic/184: line 23: /tmp/tmp.0kYt7WHchItest/null: Permission denied 2023-11-27T23:50:31.389 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/184 2023-11-27T23:50:31.389 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/184 2023-11-27T23:50:31.390 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T23:50:31.392 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:50:31.400 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:50:31.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:50:31.400 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-27T23:50:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.674 INFO:teuthology.orchestra.run.smithi154.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:31.678 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/185 2023-11-27T23:50:31.678 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/185 2023-11-27T23:50:31.678 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:31.680 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:31.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-27T23:50:31.856 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:31.859 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:31.860 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.966 INFO:teuthology.orchestra.run.smithi154.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:31.969 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/186 2023-11-27T23:50:31.969 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/186 2023-11-27T23:50:31.970 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:31.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:31.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:31.980 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-27T23:50:32.143 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:32.147 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:32.147 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:32.253 INFO:teuthology.orchestra.run.smithi154.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:32.256 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/187 2023-11-27T23:50:32.256 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/187 2023-11-27T23:50:32.256 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:32.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:32.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:32.277 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-27T23:50:32.440 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:32.444 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:32.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:32.551 INFO:teuthology.orchestra.run.smithi154.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:32.554 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/188 2023-11-27T23:50:32.554 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/188 2023-11-27T23:50:32.554 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:32.556 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:32.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:32.565 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-27T23:50:32.729 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:32.733 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:32.839 INFO:teuthology.orchestra.run.smithi154.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:32.843 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/189 2023-11-27T23:50:32.843 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/189 2023-11-27T23:50:32.843 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:32.845 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:32.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:32.854 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-27T23:50:33.018 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:33.022 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:33.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:33.128 INFO:teuthology.orchestra.run.smithi154.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:33.131 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/190 2023-11-27T23:50:33.131 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/190 2023-11-27T23:50:33.131 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:33.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:33.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:33.142 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-27T23:50:33.307 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:33.311 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:33.311 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:33.417 INFO:teuthology.orchestra.run.smithi154.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:33.420 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/191 2023-11-27T23:50:33.420 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/191 2023-11-27T23:50:33.420 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:33.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:33.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:33.431 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-27T23:50:33.596 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:33.599 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:33.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:33.713 INFO:teuthology.orchestra.run.smithi154.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-11-27T23:50:33.717 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/192 2023-11-27T23:50:33.717 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/192 2023-11-27T23:50:33.717 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:33.719 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:33.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:33.728 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-27T23:50:33.891 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:33.895 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:33.895 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:34.867 INFO:teuthology.orchestra.run.smithi154.stdout:generic/193 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/193.out.bad) 2023-11-27T23:50:34.869 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/193.out 2023-11-27 22:30:53.828023213 +0000 2023-11-27T23:50:34.869 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/193.out.bad 2023-11-27 23:50:34.566857339 +0000 2023-11-27T23:50:34.869 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -24,7 +24,6 @@ 2023-11-27T23:50:34.869 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:34.869 INFO:teuthology.orchestra.run.smithi154.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-11-27T23:50:34.870 INFO:teuthology.orchestra.run.smithi154.stdout: user: chmod a+r on root owned file (should fail) 2023-11-27T23:50:34.870 INFO:teuthology.orchestra.run.smithi154.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-11-27T23:50:34.870 INFO:teuthology.orchestra.run.smithi154.stdout: check that the sgid bit is cleared 2023-11-27T23:50:34.870 INFO:teuthology.orchestra.run.smithi154.stdout: -rw-rw-rw- 2023-11-27T23:50:34.870 INFO:teuthology.orchestra.run.smithi154.stdout: check that suid bit is not cleared 2023-11-27T23:50:34.871 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/193 2023-11-27T23:50:34.871 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/193 2023-11-27T23:50:34.871 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T23:50:34.874 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:34.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:50:34.886 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:50:34.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:50:34.886 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-27T23:50:35.328 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:35.333 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:35.334 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:35.437 INFO:teuthology.orchestra.run.smithi154.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:35.440 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/194 2023-11-27T23:50:35.441 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/194 2023-11-27T23:50:35.441 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:35.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:35.452 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-27T23:50:35.618 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:35.622 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:35.622 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:35.728 INFO:teuthology.orchestra.run.smithi154.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:35.731 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/195 2023-11-27T23:50:35.731 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/195 2023-11-27T23:50:35.731 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:35.733 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:35.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:35.742 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-27T23:50:35.913 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:35.917 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:35.917 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:36.022 INFO:teuthology.orchestra.run.smithi154.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:36.025 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/196 2023-11-27T23:50:36.025 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/196 2023-11-27T23:50:36.025 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:36.028 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:36.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:36.036 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-27T23:50:36.201 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:36.205 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:36.311 INFO:teuthology.orchestra.run.smithi154.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:36.315 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/197 2023-11-27T23:50:36.315 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/197 2023-11-27T23:50:36.315 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:36.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:36.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:36.341 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-27T23:50:36.506 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:36.510 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:37.173 INFO:teuthology.orchestra.run.smithi154.stdout:generic/198 1s 2023-11-27T23:50:37.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/198 2023-11-27T23:50:37.178 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:37.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:37.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:37.190 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-27T23:50:37.621 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:37.625 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:37.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:37.742 INFO:teuthology.orchestra.run.smithi154.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:37.745 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/199 2023-11-27T23:50:37.745 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/199 2023-11-27T23:50:37.746 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:37.748 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:37.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:37.757 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-27T23:50:37.963 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:37.967 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:37.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.078 INFO:teuthology.orchestra.run.smithi154.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:38.082 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/200 2023-11-27T23:50:38.082 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/200 2023-11-27T23:50:38.082 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:38.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:38.093 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-27T23:50:38.257 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:38.262 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:38.262 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.371 INFO:teuthology.orchestra.run.smithi154.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:38.374 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/201 2023-11-27T23:50:38.374 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/201 2023-11-27T23:50:38.374 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:38.377 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:38.399 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-27T23:50:38.565 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:38.569 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:38.679 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/202 2023-11-27T23:50:38.679 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/202 2023-11-27T23:50:38.679 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:38.682 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:38.690 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-27T23:50:38.855 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:38.859 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:38.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.965 INFO:teuthology.orchestra.run.smithi154.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:38.968 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/203 2023-11-27T23:50:38.968 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/203 2023-11-27T23:50:38.968 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:38.971 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:38.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:38.979 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-27T23:50:39.144 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:39.148 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:39.148 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:40.317 INFO:teuthology.orchestra.run.smithi154.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:40.321 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/204 2023-11-27T23:50:40.321 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/204 2023-11-27T23:50:40.322 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:40.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:40.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:40.349 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-27T23:50:40.521 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:40.525 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:40.525 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:40.635 INFO:teuthology.orchestra.run.smithi154.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:40.638 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/205 2023-11-27T23:50:40.638 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/205 2023-11-27T23:50:40.639 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:40.640 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:40.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:40.649 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-27T23:50:40.814 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:40.818 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:40.818 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:40.925 INFO:teuthology.orchestra.run.smithi154.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:50:40.928 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/206 2023-11-27T23:50:40.928 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/206 2023-11-27T23:50:40.928 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:40.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:40.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:40.939 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-27T23:50:41.103 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:41.107 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:41.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:46.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:46.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:55.253 INFO:teuthology.orchestra.run.smithi154.stdout:generic/207 14s 2023-11-27T23:50:55.258 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/207 2023-11-27T23:50:55.259 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:50:55.261 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:50:55.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:50:55.270 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-27T23:50:55.707 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:50:55.710 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:50:55.711 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:51:16.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:16.646 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:46.735 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:46.741 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:17.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:17.016 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:47.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:47.339 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:17.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:17.403 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:47.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:47.542 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:16.011 INFO:teuthology.orchestra.run.smithi154.stdout:generic/208 200s 2023-11-27T23:54:16.016 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/208 2023-11-27T23:54:16.016 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:16.018 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:16.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:16.028 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-27T23:54:16.466 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:16.470 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:16.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:17.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:17.611 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:24.761 INFO:teuthology.orchestra.run.smithi154.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/209.out.bad) 2023-11-27T23:54:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/209.out 2023-11-27 22:30:53.829023188 +0000 2023-11-27T23:54:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/209.out.bad 2023-11-27 23:54:24.689921815 +0000 2023-11-27T23:54:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,2 @@ 2023-11-27T23:54:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 209 2023-11-27T23:54:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: -test ran for 30 seconds without error 2023-11-27T23:54:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: +reader found old byte at pos 4096 2023-11-27T23:54:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: \ No newline at end of file 2023-11-27T23:54:24.772 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/209 2023-11-27T23:54:24.773 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/209 2023-11-27T23:54:24.773 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T23:54:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:24.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:54:24.788 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:54:24.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:54:24.788 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-27T23:54:25.123 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:25.127 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:25.127 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:25.523 INFO:teuthology.orchestra.run.smithi154.stdout:generic/210 0s 2023-11-27T23:54:25.575 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/210 2023-11-27T23:54:25.575 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:25.577 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:25.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:25.586 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-27T23:54:26.021 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:26.025 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:26.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:26.391 INFO:teuthology.orchestra.run.smithi154.stdout:generic/211 0s 2023-11-27T23:54:26.396 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/211 2023-11-27T23:54:26.396 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:26.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:26.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:26.408 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-27T23:54:26.573 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:26.577 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:26.577 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:26.778 INFO:teuthology.orchestra.run.smithi154.stdout:generic/212 0s 2023-11-27T23:54:26.783 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/212 2023-11-27T23:54:26.783 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:26.786 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:26.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:26.795 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-27T23:54:26.961 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:26.965 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:26.965 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:27.353 INFO:teuthology.orchestra.run.smithi154.stdout:generic/213 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/213.out.bad) 2023-11-27T23:54:27.354 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/213.out 2023-11-27 22:30:53.829023188 +0000 2023-11-27T23:54:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/213.out.bad 2023-11-27 23:54:27.349853019 +0000 2023-11-27T23:54:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,4 +1,3 @@ 2023-11-27T23:54:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 213 2023-11-27T23:54:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: We should get: fallocate: No space left on device 2023-11-27T23:54:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-11-27T23:54:27.355 INFO:teuthology.orchestra.run.smithi154.stdout: -fallocate: No space left on device 2023-11-27T23:54:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/213 2023-11-27T23:54:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/213 2023-11-27T23:54:27.357 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T23:54:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:27.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:54:27.369 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:54:27.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:54:27.369 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-27T23:54:27.805 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:27.810 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:27.810 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:28.239 INFO:teuthology.orchestra.run.smithi154.stdout:generic/214 1s 2023-11-27T23:54:28.245 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/214 2023-11-27T23:54:28.245 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:28.247 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:28.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:28.258 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-27T23:54:28.754 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:28.760 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:28.760 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:31.725 INFO:teuthology.orchestra.run.smithi154.stdout:generic/215 3s 2023-11-27T23:54:31.734 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/215 2023-11-27T23:54:31.734 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:31.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:31.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:31.752 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-27T23:54:32.002 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:32.008 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:32.008 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:32.154 INFO:teuthology.orchestra.run.smithi154.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:32.159 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/216 2023-11-27T23:54:32.159 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/216 2023-11-27T23:54:32.159 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:32.161 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:32.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:32.172 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-27T23:54:32.405 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:32.412 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:32.412 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:32.555 INFO:teuthology.orchestra.run.smithi154.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:32.561 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/217 2023-11-27T23:54:32.561 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/217 2023-11-27T23:54:32.561 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:32.563 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:32.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:32.577 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-27T23:54:32.809 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:32.813 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:32.813 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:32.963 INFO:teuthology.orchestra.run.smithi154.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:32.967 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/218 2023-11-27T23:54:32.967 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/218 2023-11-27T23:54:32.967 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:32.970 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:32.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:32.982 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-27T23:54:33.219 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:33.225 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:33.379 INFO:teuthology.orchestra.run.smithi154.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:33.384 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/219 2023-11-27T23:54:33.384 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/219 2023-11-27T23:54:33.384 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:33.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:33.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:33.400 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-27T23:54:33.626 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:33.633 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:33.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:33.777 INFO:teuthology.orchestra.run.smithi154.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:33.781 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/220 2023-11-27T23:54:33.782 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/220 2023-11-27T23:54:33.782 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:33.784 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:33.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:33.797 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-27T23:54:34.030 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:34.035 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:34.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:35.228 INFO:teuthology.orchestra.run.smithi154.stdout:generic/221 1s 2023-11-27T23:54:35.236 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/221 2023-11-27T23:54:35.237 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:35.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:35.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:35.254 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-27T23:54:35.510 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:35.514 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:35.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:35.674 INFO:teuthology.orchestra.run.smithi154.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:35.679 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/222 2023-11-27T23:54:35.679 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/222 2023-11-27T23:54:35.679 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:35.682 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:35.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:35.694 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-27T23:54:35.933 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:35.939 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:35.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:36.094 INFO:teuthology.orchestra.run.smithi154.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:36.099 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/223 2023-11-27T23:54:36.099 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/223 2023-11-27T23:54:36.099 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:36.102 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:36.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:36.114 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-27T23:54:36.360 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:36.365 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:36.365 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:36.531 INFO:teuthology.orchestra.run.smithi154.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:36.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/224 2023-11-27T23:54:36.535 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/224 2023-11-27T23:54:36.535 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:36.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:36.548 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-27T23:54:36.769 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:36.774 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:36.774 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:36.918 INFO:teuthology.orchestra.run.smithi154.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:36.922 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/225 2023-11-27T23:54:36.922 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/225 2023-11-27T23:54:36.923 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:36.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:36.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:36.940 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-27T23:54:37.195 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:37.201 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:37.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:37.349 INFO:teuthology.orchestra.run.smithi154.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:37.353 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/226 2023-11-27T23:54:37.353 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/226 2023-11-27T23:54:37.353 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:37.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:37.367 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-27T23:54:37.596 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:37.600 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:37.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:37.744 INFO:teuthology.orchestra.run.smithi154.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:37.748 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/227 2023-11-27T23:54:37.749 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/227 2023-11-27T23:54:37.749 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:37.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:37.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:37.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-27T23:54:37.991 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:37.996 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:37.997 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:38.305 INFO:teuthology.orchestra.run.smithi154.stdout:generic/228 0s 2023-11-27T23:54:38.313 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/228 2023-11-27T23:54:38.313 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:38.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:38.329 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-27T23:54:38.788 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:38.795 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:38.796 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:38.940 INFO:teuthology.orchestra.run.smithi154.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:38.944 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/229 2023-11-27T23:54:38.945 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/229 2023-11-27T23:54:38.945 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:38.948 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:38.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:38.959 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-27T23:54:39.193 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:39.200 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:39.200 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:39.354 INFO:teuthology.orchestra.run.smithi154.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:39.359 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/230 2023-11-27T23:54:39.359 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/230 2023-11-27T23:54:39.359 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:39.369 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:39.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:39.383 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-27T23:54:39.625 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:39.630 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:39.630 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:39.779 INFO:teuthology.orchestra.run.smithi154.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:39.784 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/231 2023-11-27T23:54:39.784 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/231 2023-11-27T23:54:39.784 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:39.787 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:39.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:39.799 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-27T23:54:40.024 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:40.030 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:40.030 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:40.174 INFO:teuthology.orchestra.run.smithi154.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:40.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/232 2023-11-27T23:54:40.178 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/232 2023-11-27T23:54:40.178 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:40.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:40.192 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-27T23:54:40.418 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:40.422 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:40.573 INFO:teuthology.orchestra.run.smithi154.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:40.578 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/233 2023-11-27T23:54:40.578 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/233 2023-11-27T23:54:40.578 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:40.580 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:40.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:40.598 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-27T23:54:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:40.844 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:40.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:40.988 INFO:teuthology.orchestra.run.smithi154.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:40.993 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/234 2023-11-27T23:54:40.993 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/234 2023-11-27T23:54:40.993 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:40.995 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:41.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:41.007 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-27T23:54:41.249 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:41.254 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:41.254 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:41.396 INFO:teuthology.orchestra.run.smithi154.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:41.401 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/235 2023-11-27T23:54:41.401 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/235 2023-11-27T23:54:41.401 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:41.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:41.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:41.416 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-27T23:54:41.653 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:41.658 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:41.658 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:42.920 INFO:teuthology.orchestra.run.smithi154.stdout:generic/236 1s 2023-11-27T23:54:42.927 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/236 2023-11-27T23:54:42.927 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:42.930 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:42.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:42.942 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-27T23:54:43.408 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:43.415 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:43.415 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:43.624 INFO:teuthology.orchestra.run.smithi154.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-27T23:54:43.628 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/237 2023-11-27T23:54:43.628 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/237 2023-11-27T23:54:43.628 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:43.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:43.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:43.641 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-27T23:54:43.879 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:43.884 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:44.031 INFO:teuthology.orchestra.run.smithi154.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:54:44.036 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/238 2023-11-27T23:54:44.037 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/238 2023-11-27T23:54:44.037 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:54:44.039 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:44.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:54:44.052 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-27T23:54:44.290 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:54:44.295 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:54:44.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:54:47.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:47.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:17.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:17.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:47.927 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:47.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:18.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:18.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:48.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:48.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:59.409 INFO:teuthology.orchestra.run.smithi154.stdout:generic/239 135s 2023-11-27T23:56:59.416 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/239 2023-11-27T23:56:59.416 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:56:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:56:59.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:56:59.434 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-27T23:56:59.863 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:56:59.868 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:56:59.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:57:02.748 INFO:teuthology.orchestra.run.smithi154.stdout:generic/240 3s 2023-11-27T23:57:02.755 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/240 2023-11-27T23:57:02.755 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:57:02.759 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:57:02.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:57:02.793 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-27T23:57:03.243 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:57:03.249 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:57:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:57:18.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:18.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:48.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:48.752 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:17.000 INFO:teuthology.orchestra.run.smithi154.stdout:generic/241 73s 2023-11-27T23:58:17.041 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/241 2023-11-27T23:58:17.041 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:58:17.044 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:17.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:58:17.061 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-27T23:58:18.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:18.824 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:19.049 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-27T23:58:19.047+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290933) UID: 0 2023-11-27T23:58:19.050 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-27T23:58:19.047+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290933) UID: 0 2023-11-27T23:58:19.050 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-27T23:58:19.047+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290933) UID: 0 2023-11-27T23:58:19.050 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-27T23:58:19.047+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290933) UID: 0 2023-11-27T23:58:19.416 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:58:19.421 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:58:19.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:19.695 INFO:teuthology.orchestra.run.smithi154.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:58:19.700 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/242 2023-11-27T23:58:19.700 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/242 2023-11-27T23:58:19.700 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:58:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:19.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:58:19.714 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-27T23:58:19.931 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:58:19.936 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:58:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:20.181 INFO:teuthology.orchestra.run.smithi154.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:58:20.185 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/243 2023-11-27T23:58:20.185 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/243 2023-11-27T23:58:20.185 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:58:20.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:20.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:58:20.198 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-27T23:58:20.439 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:58:20.444 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:58:20.444 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:20.649 INFO:teuthology.orchestra.run.smithi154.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-27T23:58:20.653 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/244 2023-11-27T23:58:20.654 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/244 2023-11-27T23:58:20.654 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:58:20.659 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:20.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:58:20.675 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-27T23:58:20.904 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:58:20.908 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:58:20.908 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:21.248 INFO:teuthology.orchestra.run.smithi154.stdout:generic/245 1s 2023-11-27T23:58:21.259 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/245 2023-11-27T23:58:21.259 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:58:21.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:21.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:58:21.276 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-27T23:58:21.733 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:58:21.741 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:58:21.741 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:22.319 INFO:teuthology.orchestra.run.smithi154.stdout:generic/246 1s 2023-11-27T23:58:22.374 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/246 2023-11-27T23:58:22.375 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:58:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:58:22.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:58:22.390 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-27T23:58:22.844 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:58:22.850 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:58:22.850 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:13.585 INFO:teuthology.orchestra.run.smithi154.stdout:generic/247 51s 2023-11-27T23:59:13.592 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/247 2023-11-27T23:59:13.592 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:13.597 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:13.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:13.616 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-27T23:59:13.896 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:13.902 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:13.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:14.170 INFO:teuthology.orchestra.run.smithi154.stdout:generic/248 1s 2023-11-27T23:59:14.178 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/248 2023-11-27T23:59:14.178 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:14.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:14.194 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-27T23:59:14.452 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:14.458 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:14.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:16.599 INFO:teuthology.orchestra.run.smithi154.stdout:generic/249 2s 2023-11-27T23:59:16.605 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/249 2023-11-27T23:59:16.606 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:16.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:16.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:16.620 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-27T23:59:17.141 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:17.148 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:17.148 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:17.395 INFO:teuthology.orchestra.run.smithi154.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:17.399 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/250 2023-11-27T23:59:17.399 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/250 2023-11-27T23:59:17.399 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:17.402 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:17.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:17.415 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-27T23:59:17.677 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:17.683 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:17.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:17.868 INFO:teuthology.orchestra.run.smithi154.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:17.874 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/251 2023-11-27T23:59:17.874 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/251 2023-11-27T23:59:17.874 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:17.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:17.888 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-27T23:59:18.172 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:18.177 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:18.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:18.358 INFO:teuthology.orchestra.run.smithi154.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:18.364 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/252 2023-11-27T23:59:18.364 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/252 2023-11-27T23:59:18.364 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:18.367 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:18.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:18.379 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-27T23:59:18.629 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:18.635 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:18.635 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:18.793 INFO:teuthology.orchestra.run.smithi154.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:18.798 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/253 2023-11-27T23:59:18.798 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/253 2023-11-27T23:59:18.798 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:18.801 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:18.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:18.815 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-27T23:59:19.076 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:19.081 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:19.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:19.234 INFO:teuthology.orchestra.run.smithi154.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/254 2023-11-27T23:59:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/254 2023-11-27T23:59:19.237 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:19.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:19.253 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-27T23:59:19.518 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:19.523 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:19.523 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:20.909 INFO:teuthology.orchestra.run.smithi154.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T23:59:20.914 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/255 2023-11-27T23:59:20.914 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/255 2023-11-27T23:59:20.914 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:20.917 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:20.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:20.929 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-27T23:59:21.410 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:21.421 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:21.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:22.742 INFO:teuthology.orchestra.run.smithi154.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/256 2023-11-27T23:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/256 2023-11-27T23:59:22.746 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:22.749 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:22.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:22.774 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-27T23:59:23.032 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:23.043 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:23.043 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:24.680 INFO:teuthology.orchestra.run.smithi154.stdout:generic/257 1s 2023-11-27T23:59:24.687 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/257 2023-11-27T23:59:24.687 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:24.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:24.703 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-27T23:59:25.230 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:25.258 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:25.258 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:25.448 INFO:teuthology.orchestra.run.smithi154.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/258.out.bad) 2023-11-27T23:59:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/258.out 2023-11-27 22:30:53.832023110 +0000 2023-11-27T23:59:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/258.out.bad 2023-11-27 23:59:25.445140202 +0000 2023-11-27T23:59:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,5 +1,6 @@ 2023-11-27T23:59:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 258 2023-11-27T23:59:25.451 INFO:teuthology.orchestra.run.smithi154.stdout: Creating file with timestamp of Jan 1, 1960 2023-11-27T23:59:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: Testing for negative seconds since epoch 2023-11-27T23:59:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: -Remounting to flush cache 2023-11-27T23:59:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: -Testing for negative seconds since epoch 2023-11-27T23:59:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: +Timestamp wrapped: 3979351756 2023-11-27T23:59:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: +Timestamp wrapped 2023-11-27T23:59:25.452 INFO:teuthology.orchestra.run.smithi154.stdout: +(see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/258.full for details) 2023-11-27T23:59:25.454 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/258 2023-11-27T23:59:25.455 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/258 2023-11-27T23:59:25.455 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-27T23:59:25.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:25.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T23:59:25.469 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-27T23:59:25.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-27T23:59:25.469 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-27T23:59:25.743 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:25.749 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:25.749 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:25.928 INFO:teuthology.orchestra.run.smithi154.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:25.933 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/259 2023-11-27T23:59:25.933 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/259 2023-11-27T23:59:25.933 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:25.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:25.949 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-27T23:59:26.225 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:26.231 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:26.231 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:26.413 INFO:teuthology.orchestra.run.smithi154.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:26.418 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/260 2023-11-27T23:59:26.418 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/260 2023-11-27T23:59:26.418 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:26.422 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:26.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:26.431 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-27T23:59:26.698 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:26.704 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:26.704 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:26.872 INFO:teuthology.orchestra.run.smithi154.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:26.877 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/261 2023-11-27T23:59:26.877 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/261 2023-11-27T23:59:26.877 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:26.879 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:26.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:26.891 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-27T23:59:27.148 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:27.154 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:27.155 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:27.321 INFO:teuthology.orchestra.run.smithi154.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-11-27T23:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/262 2023-11-27T23:59:27.325 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/262 2023-11-27T23:59:27.326 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-27T23:59:27.328 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-27T23:59:27.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-27T23:59:27.339 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-27T23:59:27.610 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-27T23:59:27.614 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-27T23:59:27.614 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:generic/263 64s 2023-11-28T00:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/263 2023-11-28T00:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:31.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:31.561 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-28T00:00:32.041 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:32.045 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:32.045 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:32.355 INFO:teuthology.orchestra.run.smithi154.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:32.359 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/264 2023-11-28T00:00:32.359 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/264 2023-11-28T00:00:32.359 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:32.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:32.371 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-28T00:00:32.534 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:32.538 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:32.538 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:32.791 INFO:teuthology.orchestra.run.smithi154.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/265 2023-11-28T00:00:32.794 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/265 2023-11-28T00:00:32.795 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:32.797 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:32.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:32.806 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-28T00:00:32.974 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:32.978 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:32.978 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:33.104 INFO:teuthology.orchestra.run.smithi154.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:33.107 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/266 2023-11-28T00:00:33.107 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/266 2023-11-28T00:00:33.107 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:33.109 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:33.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:33.119 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-28T00:00:33.285 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:33.289 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:33.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:33.411 INFO:teuthology.orchestra.run.smithi154.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:33.414 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/267 2023-11-28T00:00:33.415 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/267 2023-11-28T00:00:33.415 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:33.417 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:33.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:33.425 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-28T00:00:33.591 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:33.595 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:33.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:33.710 INFO:teuthology.orchestra.run.smithi154.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:33.714 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/268 2023-11-28T00:00:33.714 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/268 2023-11-28T00:00:33.714 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:33.716 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:33.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:33.725 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-28T00:00:33.890 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:33.894 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:33.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:34.008 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/269 2023-11-28T00:00:34.008 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/269 2023-11-28T00:00:34.008 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:34.010 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:34.019 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-28T00:00:34.183 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:34.187 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.313 INFO:teuthology.orchestra.run.smithi154.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T00:00:34.316 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/270 2023-11-28T00:00:34.316 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/270 2023-11-28T00:00:34.316 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:34.318 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:34.328 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-28T00:00:34.493 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:34.497 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:34.497 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.630 INFO:teuthology.orchestra.run.smithi154.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:34.634 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/271 2023-11-28T00:00:34.634 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/271 2023-11-28T00:00:34.634 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:34.636 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:34.645 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-28T00:00:34.811 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:34.815 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:34.815 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.932 INFO:teuthology.orchestra.run.smithi154.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:34.935 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/272 2023-11-28T00:00:34.935 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/272 2023-11-28T00:00:34.935 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:34.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:34.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:34.958 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-28T00:00:35.123 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:35.128 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:35.128 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:35.236 INFO:teuthology.orchestra.run.smithi154.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:35.239 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/273 2023-11-28T00:00:35.239 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/273 2023-11-28T00:00:35.239 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:35.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:35.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:35.250 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-28T00:00:35.417 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:35.421 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:35.528 INFO:teuthology.orchestra.run.smithi154.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:35.532 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/274 2023-11-28T00:00:35.532 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/274 2023-11-28T00:00:35.532 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:35.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:35.543 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-28T00:00:35.714 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:35.718 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:35.718 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:35.826 INFO:teuthology.orchestra.run.smithi154.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:35.829 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/275 2023-11-28T00:00:35.830 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/275 2023-11-28T00:00:35.830 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:35.832 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:35.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:35.841 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-28T00:00:36.005 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:36.008 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:36.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:36.137 INFO:teuthology.orchestra.run.smithi154.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:36.141 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/276 2023-11-28T00:00:36.141 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/276 2023-11-28T00:00:36.141 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:36.143 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:36.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:36.152 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-28T00:00:36.317 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:36.321 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:36.321 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:36.441 INFO:teuthology.orchestra.run.smithi154.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:36.444 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/277 2023-11-28T00:00:36.444 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/277 2023-11-28T00:00:36.444 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:36.447 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:36.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:36.455 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-28T00:00:36.621 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:36.745 INFO:teuthology.orchestra.run.smithi154.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:36.833 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/278 2023-11-28T00:00:36.834 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/278 2023-11-28T00:00:36.834 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:36.834 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:36.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:36.834 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-28T00:00:36.998 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:37.002 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:37.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:37.120 INFO:teuthology.orchestra.run.smithi154.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:37.124 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/279 2023-11-28T00:00:37.124 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/279 2023-11-28T00:00:37.124 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:37.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:37.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:37.135 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-28T00:00:37.303 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:37.307 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:37.489 INFO:teuthology.orchestra.run.smithi154.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:37.492 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/280 2023-11-28T00:00:37.492 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/280 2023-11-28T00:00:37.492 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:37.494 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:37.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:37.516 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-28T00:00:37.679 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:37.683 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:37.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:37.801 INFO:teuthology.orchestra.run.smithi154.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:37.804 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/281 2023-11-28T00:00:37.805 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/281 2023-11-28T00:00:37.805 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:37.807 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:37.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:37.816 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-28T00:00:37.981 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:37.985 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:37.985 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:38.111 INFO:teuthology.orchestra.run.smithi154.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/282 2023-11-28T00:00:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/282 2023-11-28T00:00:38.114 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:38.116 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:38.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:38.125 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-28T00:00:38.291 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:38.295 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:38.295 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:38.418 INFO:teuthology.orchestra.run.smithi154.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:38.421 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/283 2023-11-28T00:00:38.421 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/283 2023-11-28T00:00:38.422 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:38.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:38.445 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-28T00:00:38.609 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:38.613 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:38.719 INFO:teuthology.orchestra.run.smithi154.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:00:38.722 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/284 2023-11-28T00:00:38.722 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/284 2023-11-28T00:00:38.722 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:38.725 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:38.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:38.734 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-28T00:00:38.898 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:38.902 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:38.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:40.739 INFO:teuthology.orchestra.run.smithi154.stdout:generic/285 2s 2023-11-28T00:00:40.744 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/285 2023-11-28T00:00:40.745 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:00:40.747 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:00:40.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:00:40.756 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-28T00:00:41.263 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:00:41.268 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:00:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:11.653 INFO:teuthology.orchestra.run.smithi154.stdout:generic/286 30s 2023-11-28T00:01:11.656 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/286 2023-11-28T00:01:11.656 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:11.658 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:11.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:11.675 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-28T00:01:12.170 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:12.176 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:12.317 INFO:teuthology.orchestra.run.smithi154.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:12.322 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/287 2023-11-28T00:01:12.323 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/287 2023-11-28T00:01:12.323 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:12.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:12.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:12.341 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-28T00:01:12.606 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:12.620 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:12.620 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:12.717 INFO:teuthology.orchestra.run.smithi154.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:12.720 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/288 2023-11-28T00:01:12.721 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/288 2023-11-28T00:01:12.721 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:12.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:12.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:12.733 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-28T00:01:12.910 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:12.914 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:12.914 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:13.018 INFO:teuthology.orchestra.run.smithi154.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:13.021 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/289 2023-11-28T00:01:13.021 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/289 2023-11-28T00:01:13.022 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:13.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:13.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:13.032 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-28T00:01:13.194 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:13.198 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:13.198 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:13.420 INFO:teuthology.orchestra.run.smithi154.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:13.424 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/290 2023-11-28T00:01:13.424 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/290 2023-11-28T00:01:13.424 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:13.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:13.434 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-28T00:01:13.624 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:13.628 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:13.628 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:13.752 INFO:teuthology.orchestra.run.smithi154.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:13.756 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/291 2023-11-28T00:01:13.756 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/291 2023-11-28T00:01:13.756 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:13.758 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:13.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:13.768 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-28T00:01:13.937 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:13.941 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:13.941 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.048 INFO:teuthology.orchestra.run.smithi154.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:14.051 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/292 2023-11-28T00:01:14.052 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/292 2023-11-28T00:01:14.052 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:14.054 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:14.063 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-28T00:01:14.237 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:14.241 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:14.241 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.349 INFO:teuthology.orchestra.run.smithi154.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:14.352 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/293 2023-11-28T00:01:14.353 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/293 2023-11-28T00:01:14.353 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:14.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:14.364 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-28T00:01:14.534 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:14.538 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.643 INFO:teuthology.orchestra.run.smithi154.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:14.646 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/294 2023-11-28T00:01:14.647 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/294 2023-11-28T00:01:14.647 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:14.649 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:14.657 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-28T00:01:14.823 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:14.827 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:14.827 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.934 INFO:teuthology.orchestra.run.smithi154.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/295 2023-11-28T00:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/295 2023-11-28T00:01:14.937 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:14.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:14.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:14.948 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-28T00:01:15.113 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:15.117 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:15.117 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:15.223 INFO:teuthology.orchestra.run.smithi154.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:15.227 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/296 2023-11-28T00:01:15.227 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/296 2023-11-28T00:01:15.228 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:15.229 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:15.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:15.238 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-28T00:01:15.402 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:15.406 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:15.406 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:15.523 INFO:teuthology.orchestra.run.smithi154.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:15.526 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/297 2023-11-28T00:01:15.526 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/297 2023-11-28T00:01:15.527 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:15.529 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:15.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:15.538 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-28T00:01:15.704 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:15.708 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:15.708 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:15.831 INFO:teuthology.orchestra.run.smithi154.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:15.834 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/298 2023-11-28T00:01:15.834 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/298 2023-11-28T00:01:15.835 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:15.837 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:15.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:15.845 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-28T00:01:16.010 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:16.014 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:16.014 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:16.291 INFO:teuthology.orchestra.run.smithi154.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:16.294 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/299 2023-11-28T00:01:16.294 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/299 2023-11-28T00:01:16.294 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:16.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:16.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:16.305 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-28T00:01:16.466 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:16.470 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:16.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:16.756 INFO:teuthology.orchestra.run.smithi154.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:16.760 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/300 2023-11-28T00:01:16.760 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/300 2023-11-28T00:01:16.760 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:16.762 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:16.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:16.770 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-28T00:01:16.933 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:16.938 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:16.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:17.072 INFO:teuthology.orchestra.run.smithi154.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:17.075 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/301 2023-11-28T00:01:17.076 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/301 2023-11-28T00:01:17.076 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:17.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:17.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:17.087 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-28T00:01:17.250 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:17.254 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:17.254 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:17.368 INFO:teuthology.orchestra.run.smithi154.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:17.372 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/302 2023-11-28T00:01:17.372 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/302 2023-11-28T00:01:17.372 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:17.374 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:17.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:17.396 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-28T00:01:17.557 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:17.561 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:17.561 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:17.743 INFO:teuthology.orchestra.run.smithi154.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T00:01:17.746 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/303 2023-11-28T00:01:17.746 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/303 2023-11-28T00:01:17.747 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:17.749 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:17.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:17.758 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-28T00:01:18.212 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:18.216 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:18.216 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:18.520 INFO:teuthology.orchestra.run.smithi154.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T00:01:18.523 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/304 2023-11-28T00:01:18.523 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/304 2023-11-28T00:01:18.523 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:18.525 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:18.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:18.572 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-28T00:01:18.990 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:18.994 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:18.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:19.188 INFO:teuthology.orchestra.run.smithi154.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:19.192 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/305 2023-11-28T00:01:19.192 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/305 2023-11-28T00:01:19.192 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:19.194 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:19.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:19.203 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-28T00:01:19.367 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:19.371 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:19.506 INFO:teuthology.orchestra.run.smithi154.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/306 2023-11-28T00:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/306 2023-11-28T00:01:19.509 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:19.511 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:19.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:19.536 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-28T00:01:19.700 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:19.704 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:20.092 INFO:teuthology.orchestra.run.smithi154.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:01:20.095 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/307 2023-11-28T00:01:20.096 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/307 2023-11-28T00:01:20.096 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:20.098 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:20.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:20.124 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-28T00:01:20.289 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:20.293 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:20.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:20.506 INFO:teuthology.orchestra.run.smithi154.stdout:generic/308 0s 2023-11-28T00:01:20.522 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/308 2023-11-28T00:01:20.522 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:20.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:20.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:20.533 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-28T00:01:20.696 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:20.700 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:20.700 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:22.511 INFO:teuthology.orchestra.run.smithi154.stdout:generic/309 2s 2023-11-28T00:01:22.559 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/309 2023-11-28T00:01:22.560 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:01:22.562 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:22.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:01:22.572 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-28T00:01:23.006 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:01:23.011 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:01:23.011 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:01:44.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:01:44.984 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:15.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:15.117 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:42.344 INFO:teuthology.orchestra.run.smithi154.stdout:generic/310 79s 2023-11-28T00:02:42.373 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/310 2023-11-28T00:02:42.374 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:42.376 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:42.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:42.391 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-28T00:02:42.560 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:42.564 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:42.564 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:43.645 INFO:teuthology.orchestra.run.smithi154.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:43.650 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/311 2023-11-28T00:02:43.650 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/311 2023-11-28T00:02:43.650 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:43.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:43.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:43.672 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-28T00:02:43.941 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:43.942 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:44.104 INFO:teuthology.orchestra.run.smithi154.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:44.108 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/312 2023-11-28T00:02:44.108 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/312 2023-11-28T00:02:44.108 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:44.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:44.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:44.119 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-28T00:02:44.356 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:44.360 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:45.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:45.266 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:02:45.802 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T00:02:45.801+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 327529) UID: 0 2023-11-28T00:02:45.803 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T00:02:45.801+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 327529) UID: 0 2023-11-28T00:02:48.950 INFO:teuthology.orchestra.run.smithi154.stdout:generic/313 4s 2023-11-28T00:02:48.980 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/313 2023-11-28T00:02:48.981 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:48.983 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:48.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:48.994 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-28T00:02:49.168 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:49.172 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:49.172 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:51.980 INFO:teuthology.orchestra.run.smithi154.stdout:generic/314 2s 2023-11-28T00:02:51.985 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/314 2023-11-28T00:02:51.985 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:51.987 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:51.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:51.997 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-28T00:02:52.164 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:52.168 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:52.168 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:56.260 INFO:teuthology.orchestra.run.smithi154.stdout:generic/315 4s 2023-11-28T00:02:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/315 2023-11-28T00:02:56.266 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:56.269 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:56.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:56.279 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-28T00:02:56.754 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:56.758 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:56.759 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:57.682 INFO:teuthology.orchestra.run.smithi154.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T00:02:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/316 2023-11-28T00:02:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/316 2023-11-28T00:02:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:57.688 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:57.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:57.697 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-28T00:02:58.174 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:58.179 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:58.179 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:58.298 INFO:teuthology.orchestra.run.smithi154.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:58.302 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/317 2023-11-28T00:02:58.302 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/317 2023-11-28T00:02:58.302 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:58.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:58.313 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-28T00:02:58.484 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:58.488 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:58.488 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:58.603 INFO:teuthology.orchestra.run.smithi154.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:58.607 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/318 2023-11-28T00:02:58.607 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/318 2023-11-28T00:02:58.607 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:58.610 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:58.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:58.619 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-28T00:02:58.781 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:58.785 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:58.785 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:58.945 INFO:teuthology.orchestra.run.smithi154.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T00:02:58.948 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/319 2023-11-28T00:02:58.948 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/319 2023-11-28T00:02:58.948 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:58.950 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:58.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:58.959 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-28T00:02:59.130 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:59.134 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:59.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:59.242 INFO:teuthology.orchestra.run.smithi154.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:59.246 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/320 2023-11-28T00:02:59.246 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/320 2023-11-28T00:02:59.246 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:59.248 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:59.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:59.257 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-28T00:02:59.421 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:59.425 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:59.540 INFO:teuthology.orchestra.run.smithi154.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:59.544 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/321 2023-11-28T00:02:59.544 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/321 2023-11-28T00:02:59.544 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:59.546 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:59.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:59.555 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-28T00:02:59.720 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:02:59.723 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:02:59.724 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:59.839 INFO:teuthology.orchestra.run.smithi154.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:02:59.842 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/322 2023-11-28T00:02:59.842 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/322 2023-11-28T00:02:59.843 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:02:59.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:02:59.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:02:59.854 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-28T00:03:00.021 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:03:00.025 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:03:00.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:01.137 INFO:teuthology.orchestra.run.smithi154.stdout:generic/323 121s 2023-11-28T00:05:01.142 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/323 2023-11-28T00:05:01.142 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:01.144 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:01.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:01.188 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-28T00:05:01.933 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:01.937 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:01.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:02.125 INFO:teuthology.orchestra.run.smithi154.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:02.128 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/324 2023-11-28T00:05:02.128 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/324 2023-11-28T00:05:02.128 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:02.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:02.139 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-28T00:05:02.303 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:02.307 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:02.307 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:02.490 INFO:teuthology.orchestra.run.smithi154.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:02.494 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/325 2023-11-28T00:05:02.494 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/325 2023-11-28T00:05:02.494 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:02.496 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:02.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:02.505 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-28T00:05:02.669 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:02.674 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:02.782 INFO:teuthology.orchestra.run.smithi154.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:02.785 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/326 2023-11-28T00:05:02.785 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/326 2023-11-28T00:05:02.786 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:02.788 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:02.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:02.797 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-28T00:05:02.961 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:02.964 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.078 INFO:teuthology.orchestra.run.smithi154.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:03.082 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/327 2023-11-28T00:05:03.082 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/327 2023-11-28T00:05:03.082 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:03.085 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:03.093 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-28T00:05:03.260 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:03.264 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.374 INFO:teuthology.orchestra.run.smithi154.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:03.377 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/328 2023-11-28T00:05:03.377 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/328 2023-11-28T00:05:03.377 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:03.379 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:03.389 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-28T00:05:03.555 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:03.560 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:03.560 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.676 INFO:teuthology.orchestra.run.smithi154.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:03.680 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/329 2023-11-28T00:05:03.681 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/329 2023-11-28T00:05:03.681 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:03.682 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:03.692 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-28T00:05:03.882 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:03.886 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:03.887 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:03.993 INFO:teuthology.orchestra.run.smithi154.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:03.996 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/330 2023-11-28T00:05:03.996 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/330 2023-11-28T00:05:03.996 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:03.998 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:04.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:04.007 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-28T00:05:04.175 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:04.176 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:04.176 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:04.372 INFO:teuthology.orchestra.run.smithi154.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:04.375 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/331 2023-11-28T00:05:04.375 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/331 2023-11-28T00:05:04.376 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:04.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:04.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:04.412 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-28T00:05:04.719 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:04.723 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:04.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:04.836 INFO:teuthology.orchestra.run.smithi154.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:04.840 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/332 2023-11-28T00:05:04.840 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/332 2023-11-28T00:05:04.841 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:04.842 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:04.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:04.852 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-28T00:05:05.018 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:05.022 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:05.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:05.127 INFO:teuthology.orchestra.run.smithi154.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:05.131 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/333 2023-11-28T00:05:05.131 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/333 2023-11-28T00:05:05.131 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:05.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:05.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:05.142 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-28T00:05:05.309 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:05.313 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:05.422 INFO:teuthology.orchestra.run.smithi154.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:05.425 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/334 2023-11-28T00:05:05.425 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/334 2023-11-28T00:05:05.426 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:05.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:05.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:05.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-28T00:05:05.604 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:05.608 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:05.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:05.735 INFO:teuthology.orchestra.run.smithi154.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:05.735 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/335 2023-11-28T00:05:05.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/335 2023-11-28T00:05:05.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:05.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:05.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:05.746 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-28T00:05:05.983 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:06.006 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:06.006 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:06.198 INFO:teuthology.orchestra.run.smithi154.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:06.202 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/336 2023-11-28T00:05:06.202 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/336 2023-11-28T00:05:06.202 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:06.204 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:06.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:06.213 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-28T00:05:06.483 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:06.487 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:06.594 INFO:teuthology.orchestra.run.smithi154.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:06.597 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/337 2023-11-28T00:05:06.598 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/337 2023-11-28T00:05:06.598 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:06.600 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:06.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:06.609 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-28T00:05:06.772 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:06.776 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:06.994 INFO:teuthology.orchestra.run.smithi154.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:06.998 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/338 2023-11-28T00:05:06.998 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/338 2023-11-28T00:05:06.998 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:07.000 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:07.008 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-28T00:05:07.170 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:07.174 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.313 INFO:teuthology.orchestra.run.smithi154.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:07.316 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/339 2023-11-28T00:05:07.316 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/339 2023-11-28T00:05:07.316 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:07.318 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:07.328 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-28T00:05:07.489 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:07.493 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:07.493 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.615 INFO:teuthology.orchestra.run.smithi154.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/340 2023-11-28T00:05:07.618 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/340 2023-11-28T00:05:07.619 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:07.621 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:07.630 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-28T00:05:07.793 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:07.796 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:07.797 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.916 INFO:teuthology.orchestra.run.smithi154.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:07.920 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/341 2023-11-28T00:05:07.920 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/341 2023-11-28T00:05:07.920 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:07.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:07.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:07.931 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-28T00:05:08.094 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:08.098 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:08.098 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:08.215 INFO:teuthology.orchestra.run.smithi154.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/342 2023-11-28T00:05:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/342 2023-11-28T00:05:08.218 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:08.220 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:08.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:08.229 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-28T00:05:08.394 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:08.398 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:08.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:08.518 INFO:teuthology.orchestra.run.smithi154.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:08.522 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/343 2023-11-28T00:05:08.522 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/343 2023-11-28T00:05:08.522 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:08.524 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:08.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:08.533 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-28T00:05:08.699 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:08.703 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:08.703 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:08.810 INFO:teuthology.orchestra.run.smithi154.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:08.817 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/344 2023-11-28T00:05:08.818 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/344 2023-11-28T00:05:08.818 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:08.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:08.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:08.841 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-28T00:05:09.007 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:09.011 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:09.011 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:09.126 INFO:teuthology.orchestra.run.smithi154.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:09.130 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/345 2023-11-28T00:05:09.130 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/345 2023-11-28T00:05:09.130 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:09.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:09.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:09.142 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-28T00:05:09.311 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:09.315 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:09.419 INFO:teuthology.orchestra.run.smithi154.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:09.422 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/346 2023-11-28T00:05:09.422 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/346 2023-11-28T00:05:09.423 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:09.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:09.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:09.434 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-28T00:05:09.599 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:09.603 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:09.603 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:09.813 INFO:teuthology.orchestra.run.smithi154.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:09.817 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/347 2023-11-28T00:05:09.817 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/347 2023-11-28T00:05:09.817 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:09.819 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:09.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:09.840 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-28T00:05:10.005 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:10.009 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:10.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:10.125 INFO:teuthology.orchestra.run.smithi154.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:10.129 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/348 2023-11-28T00:05:10.129 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/348 2023-11-28T00:05:10.129 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:10.131 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:10.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:10.140 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-28T00:05:10.314 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:10.318 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:10.318 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:11.319 INFO:teuthology.orchestra.run.smithi154.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T00:05:11.322 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/349 2023-11-28T00:05:11.322 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/349 2023-11-28T00:05:11.323 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:11.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:11.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:11.343 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-28T00:05:11.515 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:11.518 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:11.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:13.025 INFO:teuthology.orchestra.run.smithi154.stdout:generic/350 2s 2023-11-28T00:05:13.042 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/350 2023-11-28T00:05:13.043 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:13.044 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:13.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:13.053 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-28T00:05:13.218 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:13.222 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:13.222 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:14.057 INFO:teuthology.orchestra.run.smithi154.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T00:05:14.100 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/351 2023-11-28T00:05:14.100 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/351 2023-11-28T00:05:14.100 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:14.100 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:14.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:14.101 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-28T00:05:14.539 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:14.543 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:14.675 INFO:teuthology.orchestra.run.smithi154.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:14.679 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/352 2023-11-28T00:05:14.679 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/352 2023-11-28T00:05:14.679 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:14.681 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:14.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:14.689 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-28T00:05:14.851 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:14.855 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:14.855 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:14.981 INFO:teuthology.orchestra.run.smithi154.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:14.985 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/353 2023-11-28T00:05:14.985 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/353 2023-11-28T00:05:14.985 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:14.987 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:15.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:15.005 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-28T00:05:15.167 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:15.171 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:15.171 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:15.273 INFO:teuthology.orchestra.run.smithi154.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/354 2023-11-28T00:05:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/354 2023-11-28T00:05:15.277 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:15.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:15.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:15.289 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-28T00:05:15.454 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:15.458 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:15.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:16.425 INFO:teuthology.orchestra.run.smithi154.stdout:generic/355 1s 2023-11-28T00:05:16.431 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/355 2023-11-28T00:05:16.431 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:16.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:16.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:16.443 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-28T00:05:16.913 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:16.918 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:16.918 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.029 INFO:teuthology.orchestra.run.smithi154.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:17.033 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/356 2023-11-28T00:05:17.033 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/356 2023-11-28T00:05:17.033 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:17.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:17.052 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-28T00:05:17.217 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:17.221 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:17.221 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.332 INFO:teuthology.orchestra.run.smithi154.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:17.336 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/357 2023-11-28T00:05:17.336 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/357 2023-11-28T00:05:17.336 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:17.338 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:17.347 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-28T00:05:17.512 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:17.516 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:17.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.620 INFO:teuthology.orchestra.run.smithi154.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:17.624 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/358 2023-11-28T00:05:17.624 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/358 2023-11-28T00:05:17.624 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:17.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:17.635 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-28T00:05:17.799 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:17.803 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:17.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.919 INFO:teuthology.orchestra.run.smithi154.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:17.922 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/359 2023-11-28T00:05:17.922 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/359 2023-11-28T00:05:17.922 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:17.924 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:17.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:17.933 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-28T00:05:18.097 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:18.101 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:18.304 INFO:teuthology.orchestra.run.smithi154.stdout:generic/360 0s 2023-11-28T00:05:18.309 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/360 2023-11-28T00:05:18.309 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:18.311 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:18.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:18.321 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-28T00:05:18.484 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:18.488 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:18.489 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:18.654 INFO:teuthology.orchestra.run.smithi154.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:18.658 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/361 2023-11-28T00:05:18.658 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/361 2023-11-28T00:05:18.658 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:18.660 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:18.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:18.669 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-28T00:05:18.851 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:18.855 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:18.855 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.002 INFO:teuthology.orchestra.run.smithi154.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:19.005 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/362 2023-11-28T00:05:19.005 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/362 2023-11-28T00:05:19.005 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:19.007 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:19.016 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-28T00:05:19.181 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:19.185 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:19.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.292 INFO:teuthology.orchestra.run.smithi154.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:19.295 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/363 2023-11-28T00:05:19.295 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/363 2023-11-28T00:05:19.296 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:19.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:19.307 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-28T00:05:19.474 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:19.478 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:19.478 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.603 INFO:teuthology.orchestra.run.smithi154.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:19.606 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/364 2023-11-28T00:05:19.606 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/364 2023-11-28T00:05:19.606 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:19.618 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-28T00:05:19.787 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:19.790 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:19.790 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.898 INFO:teuthology.orchestra.run.smithi154.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:19.902 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/365 2023-11-28T00:05:19.902 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/365 2023-11-28T00:05:19.902 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:19.904 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:19.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:19.913 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-28T00:05:20.078 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:20.082 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:20.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:20.186 INFO:teuthology.orchestra.run.smithi154.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:20.189 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/366 2023-11-28T00:05:20.190 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/366 2023-11-28T00:05:20.190 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:20.192 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:20.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:20.201 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-28T00:05:20.377 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:20.381 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:20.381 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:20.485 INFO:teuthology.orchestra.run.smithi154.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:20.489 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/367 2023-11-28T00:05:20.489 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/367 2023-11-28T00:05:20.489 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:20.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:20.502 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-28T00:05:20.665 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:20.669 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:20.669 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:20.774 INFO:teuthology.orchestra.run.smithi154.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:20.777 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/368 2023-11-28T00:05:20.777 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/368 2023-11-28T00:05:20.778 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:20.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:20.788 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-28T00:05:20.959 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:20.963 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:20.963 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.069 INFO:teuthology.orchestra.run.smithi154.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:21.073 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/369 2023-11-28T00:05:21.073 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/369 2023-11-28T00:05:21.073 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:21.074 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:21.083 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-28T00:05:21.248 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:21.253 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:21.253 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.354 INFO:teuthology.orchestra.run.smithi154.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:21.358 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/370 2023-11-28T00:05:21.358 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/370 2023-11-28T00:05:21.358 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:21.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:21.369 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-28T00:05:21.534 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:21.538 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:21.538 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.664 INFO:teuthology.orchestra.run.smithi154.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:21.667 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/371 2023-11-28T00:05:21.667 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/371 2023-11-28T00:05:21.667 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:21.669 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:21.695 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-28T00:05:21.862 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:21.866 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:21.866 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:21.990 INFO:teuthology.orchestra.run.smithi154.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:21.992 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/372 2023-11-28T00:05:21.993 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/372 2023-11-28T00:05:21.993 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:21.996 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:22.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:22.005 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-28T00:05:22.253 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:22.256 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:22.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:22.381 INFO:teuthology.orchestra.run.smithi154.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:22.384 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/373 2023-11-28T00:05:22.385 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/373 2023-11-28T00:05:22.385 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:22.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:22.399 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-28T00:05:22.572 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:22.576 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:22.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:22.683 INFO:teuthology.orchestra.run.smithi154.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:22.686 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/374 2023-11-28T00:05:22.686 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/374 2023-11-28T00:05:22.687 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:22.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:22.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:22.706 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-28T00:05:22.874 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:22.878 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:22.878 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:23.054 INFO:teuthology.orchestra.run.smithi154.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T00:05:23.057 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/375 2023-11-28T00:05:23.057 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/375 2023-11-28T00:05:23.058 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:23.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:23.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:23.068 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-28T00:05:23.236 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:23.240 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:23.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:23.400 INFO:teuthology.orchestra.run.smithi154.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:23.403 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/376 2023-11-28T00:05:23.404 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/376 2023-11-28T00:05:23.404 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:23.406 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:23.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:23.415 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-28T00:05:23.582 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:23.585 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:23.693 INFO:teuthology.orchestra.run.smithi154.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:23.696 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/377 2023-11-28T00:05:23.696 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/377 2023-11-28T00:05:23.696 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:23.698 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:23.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:23.707 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-28T00:05:23.883 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:23.887 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:23.887 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:24.305 INFO:teuthology.orchestra.run.smithi154.stdout:generic/378 1s 2023-11-28T00:05:24.311 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/378 2023-11-28T00:05:24.311 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:24.313 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:24.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:24.323 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-28T00:05:24.812 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:24.820 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:24.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:24.952 INFO:teuthology.orchestra.run.smithi154.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:24.956 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/379 2023-11-28T00:05:24.956 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/379 2023-11-28T00:05:24.956 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:24.958 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:24.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:28.808 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-28T00:05:28.985 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:28.989 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:28.989 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.102 INFO:teuthology.orchestra.run.smithi154.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:29.105 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/380 2023-11-28T00:05:29.105 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/380 2023-11-28T00:05:29.105 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:29.117 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-28T00:05:29.283 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:29.287 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:29.287 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.398 INFO:teuthology.orchestra.run.smithi154.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:29.401 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/381 2023-11-28T00:05:29.402 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/381 2023-11-28T00:05:29.402 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:29.413 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-28T00:05:29.577 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:29.581 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:29.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.686 INFO:teuthology.orchestra.run.smithi154.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:29.689 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/382 2023-11-28T00:05:29.689 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/382 2023-11-28T00:05:29.689 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:29.692 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:29.701 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-28T00:05:29.867 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:29.871 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:29.871 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.979 INFO:teuthology.orchestra.run.smithi154.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/383 2023-11-28T00:05:29.983 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/383 2023-11-28T00:05:29.984 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:29.986 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:29.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:29.995 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-28T00:05:30.162 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:30.166 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:30.166 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:30.275 INFO:teuthology.orchestra.run.smithi154.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T00:05:30.279 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/384 2023-11-28T00:05:30.279 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/384 2023-11-28T00:05:30.279 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:30.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:30.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:30.300 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-28T00:05:30.471 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:30.475 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:30.475 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:30.592 INFO:teuthology.orchestra.run.smithi154.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:30.596 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/385 2023-11-28T00:05:30.596 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/385 2023-11-28T00:05:30.596 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:30.599 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:30.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:30.608 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-28T00:05:30.770 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:30.774 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:30.774 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:30.883 INFO:teuthology.orchestra.run.smithi154.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T00:05:30.886 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/386 2023-11-28T00:05:30.886 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/386 2023-11-28T00:05:30.886 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:30.888 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:30.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:30.897 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-28T00:05:31.065 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:31.069 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:31.069 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:31.196 INFO:teuthology.orchestra.run.smithi154.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:31.199 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/387 2023-11-28T00:05:31.199 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/387 2023-11-28T00:05:31.199 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:31.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:31.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:31.213 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-28T00:05:31.385 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:31.388 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:31.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/388 2023-11-28T00:05:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/388 2023-11-28T00:05:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:31.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:31.528 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-28T00:05:31.698 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:31.702 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:31.702 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:31.837 INFO:teuthology.orchestra.run.smithi154.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-28T00:05:31.840 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/389 2023-11-28T00:05:31.840 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/389 2023-11-28T00:05:31.841 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:31.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:31.853 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-28T00:05:32.022 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:32.025 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:32.026 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:32.179 INFO:teuthology.orchestra.run.smithi154.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:32.182 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/390 2023-11-28T00:05:32.182 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/390 2023-11-28T00:05:32.182 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:32.184 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:32.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:32.194 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-28T00:05:32.367 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:32.371 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:52.348 INFO:teuthology.orchestra.run.smithi154.stdout:generic/391 20s 2023-11-28T00:05:52.398 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/391 2023-11-28T00:05:52.398 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:52.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:52.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:52.419 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-28T00:05:53.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:53.458 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:53.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:53.626 INFO:teuthology.orchestra.run.smithi154.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:53.631 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/392 2023-11-28T00:05:53.631 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/392 2023-11-28T00:05:53.631 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:53.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:53.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:53.644 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-28T00:05:53.888 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:53.894 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:54.049 INFO:teuthology.orchestra.run.smithi154.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:54.053 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/393 2023-11-28T00:05:54.053 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/393 2023-11-28T00:05:54.053 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:54.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:54.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:54.067 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-28T00:05:54.292 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:54.297 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:54.298 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:54.527 INFO:teuthology.orchestra.run.smithi154.stdout:generic/394 0s 2023-11-28T00:05:54.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/394 2023-11-28T00:05:54.534 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:54.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:54.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:54.547 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-28T00:05:55.027 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:55.031 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:55.031 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:55.204 INFO:teuthology.orchestra.run.smithi154.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:55.209 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/395 2023-11-28T00:05:55.209 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/395 2023-11-28T00:05:55.209 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:55.212 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:55.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:55.221 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-28T00:05:55.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:55.458 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:55.635 INFO:teuthology.orchestra.run.smithi154.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:55.640 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/396 2023-11-28T00:05:55.640 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/396 2023-11-28T00:05:55.640 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:55.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:55.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:55.653 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-28T00:05:55.898 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:55.903 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:55.903 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:56.103 INFO:teuthology.orchestra.run.smithi154.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/397 2023-11-28T00:05:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/397 2023-11-28T00:05:56.108 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:56.111 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:56.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:56.123 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-28T00:05:56.354 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:56.359 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:56.359 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:56.497 INFO:teuthology.orchestra.run.smithi154.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:56.501 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/398 2023-11-28T00:05:56.501 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/398 2023-11-28T00:05:56.501 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:56.503 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:56.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:56.513 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-28T00:05:56.677 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:56.681 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:56.815 INFO:teuthology.orchestra.run.smithi154.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:56.819 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/399 2023-11-28T00:05:56.819 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/399 2023-11-28T00:05:56.819 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:56.821 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:56.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:56.830 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-28T00:05:56.992 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:56.996 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:56.996 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.104 INFO:teuthology.orchestra.run.smithi154.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T00:05:57.108 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/400 2023-11-28T00:05:57.108 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/400 2023-11-28T00:05:57.108 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:57.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:57.120 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-28T00:05:57.285 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:57.290 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:57.290 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.396 INFO:teuthology.orchestra.run.smithi154.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/401 2023-11-28T00:05:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/401 2023-11-28T00:05:57.400 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:57.402 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:57.411 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-28T00:05:57.574 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:57.578 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:57.578 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.685 INFO:teuthology.orchestra.run.smithi154.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/402 2023-11-28T00:05:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/402 2023-11-28T00:05:57.689 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:57.691 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:57.699 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-28T00:05:57.863 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:57.867 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:57.867 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.972 INFO:teuthology.orchestra.run.smithi154.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:57.976 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/403 2023-11-28T00:05:57.976 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/403 2023-11-28T00:05:57.976 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:57.978 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:57.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:57.990 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-28T00:05:58.153 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:58.157 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:58.157 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:58.982 INFO:teuthology.orchestra.run.smithi154.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T00:05:58.985 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/404 2023-11-28T00:05:58.985 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/404 2023-11-28T00:05:58.985 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:58.988 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:58.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:58.996 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-28T00:05:59.424 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:59.428 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:59.622 INFO:teuthology.orchestra.run.smithi154.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:59.623 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/405 2023-11-28T00:05:59.623 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/405 2023-11-28T00:05:59.623 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:59.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:59.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:59.644 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-28T00:05:59.816 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:05:59.820 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:05:59.820 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:59.926 INFO:teuthology.orchestra.run.smithi154.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:05:59.929 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/406 2023-11-28T00:05:59.929 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/406 2023-11-28T00:05:59.929 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:05:59.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:05:59.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:05:59.940 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-28T00:06:00.104 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:00.108 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:00.108 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:00.262 INFO:teuthology.orchestra.run.smithi154.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T00:06:00.265 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/407 2023-11-28T00:06:00.265 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/407 2023-11-28T00:06:00.265 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:00.267 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:00.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:00.276 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-28T00:06:00.711 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:00.716 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:00.716 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:00.869 INFO:teuthology.orchestra.run.smithi154.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T00:06:00.873 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/408 2023-11-28T00:06:00.873 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/408 2023-11-28T00:06:00.873 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:00.875 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:00.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:00.884 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-28T00:06:01.306 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:01.311 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:01.312 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:01.422 INFO:teuthology.orchestra.run.smithi154.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:01.425 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/409 2023-11-28T00:06:01.426 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/409 2023-11-28T00:06:01.426 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:01.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:01.436 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-28T00:06:01.598 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:01.601 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:01.716 INFO:teuthology.orchestra.run.smithi154.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:01.720 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/410 2023-11-28T00:06:01.720 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/410 2023-11-28T00:06:01.720 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:01.722 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:01.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:01.731 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-28T00:06:01.894 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:01.898 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:01.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.007 INFO:teuthology.orchestra.run.smithi154.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:02.011 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/411 2023-11-28T00:06:02.011 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/411 2023-11-28T00:06:02.011 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:02.013 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:02.022 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-28T00:06:02.187 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:02.191 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:02.191 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.304 INFO:teuthology.orchestra.run.smithi154.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:02.308 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/412 2023-11-28T00:06:02.308 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/412 2023-11-28T00:06:02.308 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:02.310 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:02.319 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-28T00:06:02.489 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:02.491 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:02.491 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.602 INFO:teuthology.orchestra.run.smithi154.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:02.606 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/413 2023-11-28T00:06:02.606 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/413 2023-11-28T00:06:02.606 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:02.608 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:02.628 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-28T00:06:02.793 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:02.797 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:02.797 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.902 INFO:teuthology.orchestra.run.smithi154.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:02.905 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/414 2023-11-28T00:06:02.906 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/414 2023-11-28T00:06:02.906 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:02.908 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:02.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:02.916 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-28T00:06:03.083 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:03.087 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:03.087 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:03.211 INFO:teuthology.orchestra.run.smithi154.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:03.215 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/415 2023-11-28T00:06:03.215 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/415 2023-11-28T00:06:03.215 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:03.217 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:03.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:03.227 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-28T00:06:03.392 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:03.395 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:03.395 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:03.501 INFO:teuthology.orchestra.run.smithi154.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:03.504 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/416 2023-11-28T00:06:03.504 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/416 2023-11-28T00:06:03.505 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:03.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:03.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:03.515 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-28T00:06:03.677 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:03.680 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:03.681 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:03.793 INFO:teuthology.orchestra.run.smithi154.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:03.797 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/417 2023-11-28T00:06:03.797 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/417 2023-11-28T00:06:03.797 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:03.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:03.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:03.807 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-28T00:06:03.984 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:03.988 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:03.988 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:04.147 INFO:teuthology.orchestra.run.smithi154.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-11-28T00:06:04.150 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/418 2023-11-28T00:06:04.150 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/418 2023-11-28T00:06:04.150 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:04.152 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:04.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:04.162 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-28T00:06:04.325 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:04.330 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:04.330 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:04.456 INFO:teuthology.orchestra.run.smithi154.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:04.460 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/419 2023-11-28T00:06:04.460 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/419 2023-11-28T00:06:04.460 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:04.462 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:04.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:04.471 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-28T00:06:04.637 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:04.640 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:04.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:05.525 INFO:teuthology.orchestra.run.smithi154.stdout:generic/420 1s 2023-11-28T00:06:05.530 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/420 2023-11-28T00:06:05.530 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:05.533 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:05.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:05.541 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-28T00:06:05.979 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:05.983 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:05.983 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:06.120 INFO:teuthology.orchestra.run.smithi154.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:06.123 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/421 2023-11-28T00:06:06.123 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/421 2023-11-28T00:06:06.123 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:06.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:06.146 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-28T00:06:06.309 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:06.313 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:06.313 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:06.422 INFO:teuthology.orchestra.run.smithi154.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:06.426 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/422 2023-11-28T00:06:06.426 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/422 2023-11-28T00:06:06.426 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:06.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:06.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-28T00:06:06.602 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:06.605 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:06.606 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:06.838 INFO:teuthology.orchestra.run.smithi154.stdout:generic/423 0s 2023-11-28T00:06:06.843 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/423 2023-11-28T00:06:06.844 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:06.846 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:06.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:06.878 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-28T00:06:07.297 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:07.301 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:07.301 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:07.451 INFO:teuthology.orchestra.run.smithi154.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-11-28T00:06:07.455 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/424 2023-11-28T00:06:07.455 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/424 2023-11-28T00:06:07.455 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:07.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:07.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:07.466 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-28T00:06:07.633 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:07.637 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:07.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:07.758 INFO:teuthology.orchestra.run.smithi154.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/425 2023-11-28T00:06:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/425 2023-11-28T00:06:07.762 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:07.764 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:07.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:07.772 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-28T00:06:07.935 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:07.939 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:07.939 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:18.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:06:18.672 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:06:19.027 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T00:06:19.025+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99116) UID: 0 2023-11-28T00:06:19.027 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T00:06:19.025+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99116) UID: 0 2023-11-28T00:06:19.028 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T00:06:19.025+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99116) UID: 0 2023-11-28T00:06:19.028 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T00:06:19.026+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99116) UID: 0 2023-11-28T00:06:38.294 INFO:teuthology.orchestra.run.smithi154.stdout:generic/426 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/426.out.bad) 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/426.out 2023-11-27 22:30:53.844022801 +0000 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/426.out.bad 2023-11-28 00:06:38.249956352 +0000 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,5 +1,424 @@ 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 426 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir -d 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000193) opened an unlinked file! 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000194) opened an unlinked file! 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000195) opened an unlinked file! 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000608) opened an unlinked file! 2023-11-28T00:06:38.314 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000609) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000610) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000611) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000612) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000613) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000614) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000615) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000616) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000617) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000618) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000619) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000620) opened an unlinked file! 2023-11-28T00:06:38.315 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000621) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000622) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000623) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000624) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000625) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000626) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000627) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000628) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000629) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000630) opened an unlinked file! 2023-11-28T00:06:38.316 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000631) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000632) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000633) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000634) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000635) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000636) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000637) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000638) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000639) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000640) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000641) opened an unlinked file! 2023-11-28T00:06:38.317 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000642) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000643) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000644) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000645) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000646) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000647) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000648) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000649) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000650) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000651) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000652) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000653) opened an unlinked file! 2023-11-28T00:06:38.318 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000654) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000655) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000656) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000657) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000658) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000659) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000660) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000661) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000662) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000663) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000664) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000665) opened an unlinked file! 2023-11-28T00:06:38.319 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000666) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000667) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000668) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000669) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000670) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000671) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000672) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000673) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000674) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000675) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000676) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000677) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000678) opened an unlinked file! 2023-11-28T00:06:38.320 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000679) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000680) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000681) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000682) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000683) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000684) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000685) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000686) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000687) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000688) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000689) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000690) opened an unlinked file! 2023-11-28T00:06:38.321 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000691) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000692) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000693) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000694) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000695) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000696) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000697) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000698) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000699) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000700) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000701) opened an unlinked file! 2023-11-28T00:06:38.322 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000702) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000703) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000704) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000705) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000706) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000707) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000708) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000709) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000710) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000711) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000712) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000713) opened an unlinked file! 2023-11-28T00:06:38.323 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000714) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000715) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000716) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000717) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000718) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000719) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000720) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000721) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000722) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000723) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000724) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000725) opened an unlinked file! 2023-11-28T00:06:38.324 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000726) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000727) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000728) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000729) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000730) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000731) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000732) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000733) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000734) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000735) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000736) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000737) opened an unlinked file! 2023-11-28T00:06:38.325 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000738) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000739) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000740) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000741) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000742) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000743) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000744) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000745) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000746) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000747) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000748) opened an unlinked file! 2023-11-28T00:06:38.326 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000749) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000750) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000751) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000752) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000753) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000754) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000755) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000756) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000757) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000758) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000759) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000760) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000761) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000762) opened an unlinked file! 2023-11-28T00:06:38.327 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000763) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000764) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000765) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000766) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000767) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000768) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000769) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000770) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000771) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000772) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000773) opened an unlinked file! 2023-11-28T00:06:38.328 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000774) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000775) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000776) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000777) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000778) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000779) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000780) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000781) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000782) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000783) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000784) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000785) opened an unlinked file! 2023-11-28T00:06:38.329 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000786) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000787) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000788) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000789) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000790) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000791) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000792) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000793) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000794) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000795) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000796) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000797) opened an unlinked file! 2023-11-28T00:06:38.330 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000798) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000799) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000800) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000801) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000802) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000803) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000804) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000805) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000806) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000807) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000808) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000809) opened an unlinked file! 2023-11-28T00:06:38.331 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000810) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000811) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000812) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000813) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000814) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000815) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000816) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000817) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000818) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000819) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000820) opened an unlinked file! 2023-11-28T00:06:38.332 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000821) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000822) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000823) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000824) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000825) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000826) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000827) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000828) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000829) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000830) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000831) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000832) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000833) opened an unlinked file! 2023-11-28T00:06:38.333 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000834) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000835) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000836) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000837) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000838) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000839) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000840) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000841) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000842) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000843) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000844) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000845) opened an unlinked file! 2023-11-28T00:06:38.334 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000846) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000847) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000848) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000849) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000850) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000851) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000852) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000853) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000854) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000855) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000856) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000857) opened an unlinked file! 2023-11-28T00:06:38.335 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000858) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000859) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000860) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000861) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000862) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000863) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000864) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000865) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000866) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000867) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000868) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000869) opened an unlinked file! 2023-11-28T00:06:38.336 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000870) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000871) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000872) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000873) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000874) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000875) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000876) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000877) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000878) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000879) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000880) opened an unlinked file! 2023-11-28T00:06:38.337 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000881) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000882) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000883) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000884) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000885) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000886) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000887) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000888) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000889) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000890) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000891) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000892) opened an unlinked file! 2023-11-28T00:06:38.338 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000893) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000894) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000895) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000896) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000897) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000898) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000899) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000900) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000901) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000902) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000903) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000904) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000905) opened an unlinked file! 2023-11-28T00:06:38.339 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000906) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000907) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000908) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000909) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000910) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000911) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000912) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000913) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000914) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000915) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000916) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000917) opened an unlinked file! 2023-11-28T00:06:38.340 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000918) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000919) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000920) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000921) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000922) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000923) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000924) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000925) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000926) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000927) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000928) opened an unlinked file! 2023-11-28T00:06:38.341 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000929) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000930) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000931) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000932) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000933) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000934) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000935) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000936) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000937) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000938) opened an unlinked file! 2023-11-28T00:06:38.342 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000939) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000940) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000941) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000942) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000943) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000944) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000945) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000946) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000947) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000948) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000949) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000950) opened an unlinked file! 2023-11-28T00:06:38.343 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000951) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000952) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000953) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000954) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000955) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000956) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000957) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000958) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000959) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000960) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000961) opened an unlinked file! 2023-11-28T00:06:38.344 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000962) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000963) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000964) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000965) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000966) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000967) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000968) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000969) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000970) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000971) opened an unlinked file! 2023-11-28T00:06:38.345 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000972) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000973) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000974) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000975) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000976) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000977) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000978) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000979) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000980) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000981) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000982) opened an unlinked file! 2023-11-28T00:06:38.346 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000983) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000984) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000985) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000986) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000987) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000988) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000989) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000990) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000991) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000992) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000993) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000994) opened an unlinked file! 2023-11-28T00:06:38.347 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000995) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000996) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000997) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000998) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file000999) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001000) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001001) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001002) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001003) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001004) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001005) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001006) opened an unlinked file! 2023-11-28T00:06:38.348 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001007) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001008) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001009) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001010) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001011) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001012) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001013) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001014) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001015) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001016) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001017) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001018) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001019) opened an unlinked file! 2023-11-28T00:06:38.349 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001020) opened an unlinked file! 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001021) opened an unlinked file! 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001022) opened an unlinked file! 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/426-dir/file001023) opened an unlinked file! 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir -l 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/426-dir -u 2023-11-28T00:06:38.350 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/426 2023-11-28T00:06:38.351 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/426 2023-11-28T00:06:38.351 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T00:06:38.368 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:38.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T00:06:38.546 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T00:06:38.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T00:06:38.547 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-28T00:06:39.579 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:39.583 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:39.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:39.728 INFO:teuthology.orchestra.run.smithi154.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:39.731 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/427 2023-11-28T00:06:39.731 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/427 2023-11-28T00:06:39.731 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:39.733 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:39.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:39.742 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-28T00:06:39.919 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:39.923 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:39.923 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:40.094 INFO:teuthology.orchestra.run.smithi154.stdout:generic/428 1s 2023-11-28T00:06:40.099 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/428 2023-11-28T00:06:40.099 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:40.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:40.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:40.111 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-28T00:06:40.285 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:40.289 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:40.289 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:40.430 INFO:teuthology.orchestra.run.smithi154.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:40.434 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/429 2023-11-28T00:06:40.434 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/429 2023-11-28T00:06:40.434 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:40.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:40.444 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-28T00:06:40.627 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:40.631 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:40.631 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:40.880 INFO:teuthology.orchestra.run.smithi154.stdout:generic/430 0s 2023-11-28T00:06:40.885 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/430 2023-11-28T00:06:40.885 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:40.887 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:40.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:40.897 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-28T00:06:41.336 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:41.340 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:41.340 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:41.568 INFO:teuthology.orchestra.run.smithi154.stdout:generic/431 0s 2023-11-28T00:06:41.573 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/431 2023-11-28T00:06:41.573 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:41.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:41.584 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-28T00:06:42.028 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:42.032 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:42.032 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:42.259 INFO:teuthology.orchestra.run.smithi154.stdout:generic/432 0s 2023-11-28T00:06:42.265 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/432 2023-11-28T00:06:42.265 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:42.267 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:42.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:42.277 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-28T00:06:42.733 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:42.737 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:42.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:42.937 INFO:teuthology.orchestra.run.smithi154.stdout:generic/433 0s 2023-11-28T00:06:42.942 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/433 2023-11-28T00:06:42.942 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:42.944 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:42.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:42.953 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-28T00:06:43.395 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:43.400 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:43.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:43.612 INFO:teuthology.orchestra.run.smithi154.stdout:generic/434 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/434.out.bad) 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/434.out 2023-11-27 22:30:53.844022801 +0000 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/434.out.bad 2023-11-28 00:06:43.609817843 +0000 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -9,6 +9,6 @@ 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: copy_range: Bad file descriptor 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: Try to copy to a device 2023-11-28T00:06:43.614 INFO:teuthology.orchestra.run.smithi154.stdout: -copy_range: Invalid argument 2023-11-28T00:06:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: +/tmp/tmp.0kYt7WHchItest/test-434/dev1: Permission denied 2023-11-28T00:06:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: Try to copy to a fifo 2023-11-28T00:06:43.615 INFO:teuthology.orchestra.run.smithi154.stdout: copy_range: Invalid argument 2023-11-28T00:06:43.616 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/434 2023-11-28T00:06:43.616 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/434 2023-11-28T00:06:43.616 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T00:06:43.619 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:43.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T00:06:43.627 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T00:06:43.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T00:06:43.628 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-28T00:06:44.051 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:44.056 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:44.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:44.197 INFO:teuthology.orchestra.run.smithi154.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:06:44.201 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/435 2023-11-28T00:06:44.201 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/435 2023-11-28T00:06:44.201 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:44.203 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:44.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:44.212 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-28T00:06:44.374 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:44.378 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:45.174 INFO:teuthology.orchestra.run.smithi154.stdout:generic/436 1s 2023-11-28T00:06:45.179 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/436 2023-11-28T00:06:45.179 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:45.181 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:45.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:45.190 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-28T00:06:45.663 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:45.667 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:45.667 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:46.474 INFO:teuthology.orchestra.run.smithi154.stdout:generic/437 1s 2023-11-28T00:06:46.480 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/437 2023-11-28T00:06:46.480 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:06:46.482 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:06:46.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:06:46.491 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-28T00:06:46.653 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:06:46.657 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:06:46.657 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:33.810 INFO:teuthology.orchestra.run.smithi154.stdout:generic/438 47s 2023-11-28T00:07:33.815 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/438 2023-11-28T00:07:33.815 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:33.818 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:33.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:33.827 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-28T00:07:33.993 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:33.997 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:33.997 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:34.105 INFO:teuthology.orchestra.run.smithi154.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:34.109 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/439 2023-11-28T00:07:34.109 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/439 2023-11-28T00:07:34.109 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:34.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:34.120 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-28T00:07:34.286 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:34.290 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:34.290 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:34.422 INFO:teuthology.orchestra.run.smithi154.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:34.426 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/440 2023-11-28T00:07:34.426 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/440 2023-11-28T00:07:34.426 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:34.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:34.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:34.437 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-28T00:07:34.603 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:34.607 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:34.607 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:34.771 INFO:teuthology.orchestra.run.smithi154.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:34.775 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/441 2023-11-28T00:07:34.775 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/441 2023-11-28T00:07:34.775 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:34.777 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:34.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:34.786 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-28T00:07:34.949 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:34.953 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:34.953 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:35.085 INFO:teuthology.orchestra.run.smithi154.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:35.088 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/442 2023-11-28T00:07:35.088 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/442 2023-11-28T00:07:35.088 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:35.090 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:35.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:35.099 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-28T00:07:35.263 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:35.267 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:35.267 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:35.410 INFO:teuthology.orchestra.run.smithi154.stdout:generic/443 0s 2023-11-28T00:07:35.415 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/443 2023-11-28T00:07:35.415 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:35.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:35.426 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-28T00:07:35.590 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:35.594 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:35.594 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:35.732 INFO:teuthology.orchestra.run.smithi154.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T00:07:35.735 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/444 2023-11-28T00:07:35.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/444 2023-11-28T00:07:35.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:35.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:35.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:35.745 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-28T00:07:35.912 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:35.916 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:35.916 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:36.813 INFO:teuthology.orchestra.run.smithi154.stdout:generic/445 1s 2023-11-28T00:07:36.822 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/445 2023-11-28T00:07:36.823 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:36.823 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:36.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:36.831 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-28T00:07:37.255 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:37.260 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:37.260 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:37.376 INFO:teuthology.orchestra.run.smithi154.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:37.380 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/446 2023-11-28T00:07:37.380 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/446 2023-11-28T00:07:37.380 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:37.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:37.391 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-28T00:07:37.560 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:37.564 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:37.564 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:37.682 INFO:teuthology.orchestra.run.smithi154.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:37.685 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/447 2023-11-28T00:07:37.685 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/447 2023-11-28T00:07:37.685 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:37.687 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:37.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:37.696 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-28T00:07:37.860 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:37.863 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:37.864 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:38.789 INFO:teuthology.orchestra.run.smithi154.stdout:generic/448 1s 2023-11-28T00:07:38.794 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/448 2023-11-28T00:07:38.794 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:38.797 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:38.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:38.806 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-28T00:07:39.211 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:39.217 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:39.217 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:39.334 INFO:teuthology.orchestra.run.smithi154.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:39.338 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/449 2023-11-28T00:07:39.338 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/449 2023-11-28T00:07:39.338 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:39.340 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:39.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:39.360 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-28T00:07:39.524 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:39.528 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:39.528 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:40.537 INFO:teuthology.orchestra.run.smithi154.stdout:generic/450 1s 2023-11-28T00:07:40.542 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/450 2023-11-28T00:07:40.543 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:40.545 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:40.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:40.554 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-28T00:07:40.945 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:40.949 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:40.949 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:41.297 INFO:teuthology.orchestra.run.smithi154.stdout:generic/451 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/451.out.bad) 2023-11-28T00:07:41.298 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/451.out 2023-11-27 22:30:53.845022776 +0000 2023-11-28T00:07:41.299 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/451.out.bad 2023-11-28 00:07:41.294327168 +0000 2023-11-28T00:07:41.299 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,9 @@ 2023-11-28T00:07:41.299 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 451 2023-11-28T00:07:41.299 INFO:teuthology.orchestra.run.smithi154.stdout: +get stale data from buffer read 2023-11-28T00:07:41.299 INFO:teuthology.orchestra.run.smithi154.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-11-28T00:07:41.300 INFO:teuthology.orchestra.run.smithi154.stdout: +* 2023-11-28T00:07:41.300 INFO:teuthology.orchestra.run.smithi154.stdout: +00080000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-11-28T00:07:41.300 INFO:teuthology.orchestra.run.smithi154.stdout: +* 2023-11-28T00:07:41.300 INFO:teuthology.orchestra.run.smithi154.stdout: +00093000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-11-28T00:07:41.300 INFO:teuthology.orchestra.run.smithi154.stdout: +000a0000 2023-11-28T00:07:41.301 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2023-11-28T00:07:41.301 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/451 2023-11-28T00:07:41.301 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/451 2023-11-28T00:07:41.302 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T00:07:41.303 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:41.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T00:07:41.312 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T00:07:41.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T00:07:41.312 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-28T00:07:41.645 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:41.650 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:41.831 INFO:teuthology.orchestra.run.smithi154.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:41.834 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/452 2023-11-28T00:07:41.834 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/452 2023-11-28T00:07:41.834 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:41.837 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:41.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:41.849 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-28T00:07:42.016 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:42.020 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:42.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:42.242 INFO:teuthology.orchestra.run.smithi154.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:42.246 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/453 2023-11-28T00:07:42.246 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/453 2023-11-28T00:07:42.246 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:42.248 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:42.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:42.257 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-28T00:07:42.424 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:42.428 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:42.428 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:42.531 INFO:teuthology.orchestra.run.smithi154.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:42.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/454 2023-11-28T00:07:42.535 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/454 2023-11-28T00:07:42.535 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:42.537 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:42.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:42.545 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-28T00:07:42.709 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:42.713 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:42.713 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:43.128 INFO:teuthology.orchestra.run.smithi154.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:43.131 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/455 2023-11-28T00:07:43.131 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/455 2023-11-28T00:07:43.131 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:43.133 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:43.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:43.159 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-28T00:07:43.323 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:43.327 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:43.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:43.491 INFO:teuthology.orchestra.run.smithi154.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:43.494 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/456 2023-11-28T00:07:43.495 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/456 2023-11-28T00:07:43.495 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:43.497 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:43.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:43.519 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-28T00:07:43.684 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:43.687 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:43.688 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:43.841 INFO:teuthology.orchestra.run.smithi154.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:43.845 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/457 2023-11-28T00:07:43.845 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/457 2023-11-28T00:07:43.845 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:43.847 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:43.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:43.856 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-28T00:07:44.020 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:44.024 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:44.024 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:44.137 INFO:teuthology.orchestra.run.smithi154.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:44.141 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/458 2023-11-28T00:07:44.141 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/458 2023-11-28T00:07:44.141 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:44.143 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:44.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:44.152 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-28T00:07:44.316 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:44.319 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:44.569 INFO:teuthology.orchestra.run.smithi154.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:44.573 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/459 2023-11-28T00:07:44.573 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/459 2023-11-28T00:07:44.573 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:44.575 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:44.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:44.601 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-28T00:07:44.766 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:44.770 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:44.770 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:44.875 INFO:teuthology.orchestra.run.smithi154.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:44.879 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/460 2023-11-28T00:07:44.879 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/460 2023-11-28T00:07:44.879 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:44.881 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:44.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:44.890 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-28T00:07:45.055 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:45.058 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:45.059 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:45.171 INFO:teuthology.orchestra.run.smithi154.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:45.175 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/461 2023-11-28T00:07:45.175 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/461 2023-11-28T00:07:45.175 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:45.177 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:45.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:45.185 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-28T00:07:45.349 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:45.353 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:45.354 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:45.469 INFO:teuthology.orchestra.run.smithi154.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:45.472 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/462 2023-11-28T00:07:45.472 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/462 2023-11-28T00:07:45.473 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:45.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:45.484 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-28T00:07:45.647 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:45.651 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:45.809 INFO:teuthology.orchestra.run.smithi154.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T00:07:45.812 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/463 2023-11-28T00:07:45.812 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/463 2023-11-28T00:07:45.813 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:45.815 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:45.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:45.823 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-28T00:07:46.213 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:46.218 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:46.218 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:46.336 INFO:teuthology.orchestra.run.smithi154.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:07:46.339 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/464 2023-11-28T00:07:46.340 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/464 2023-11-28T00:07:46.340 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:07:46.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:07:46.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:07:46.350 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-28T00:07:46.514 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:07:46.518 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:07:46.519 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:01.007 INFO:teuthology.orchestra.run.smithi154.stdout:generic/465 14s 2023-11-28T00:08:01.015 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/465 2023-11-28T00:08:01.015 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:08:01.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:01.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:08:01.036 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-28T00:08:01.448 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:08:01.453 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:08:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:01.558 INFO:teuthology.orchestra.run.smithi154.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:08:01.562 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/466 2023-11-28T00:08:01.562 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/466 2023-11-28T00:08:01.562 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:08:01.564 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:01.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:08:01.573 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-28T00:08:01.736 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:08:01.740 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:08:01.740 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:07.520 INFO:teuthology.orchestra.run.smithi154.stdout:generic/467 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/467.out.bad) 2023-11-28T00:08:07.524 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/467.out 2023-11-27 22:30:53.846022750 +0000 2023-11-28T00:08:07.524 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/467.out.bad 2023-11-28 00:08:07.512649640 +0000 2023-11-28T00:08:07.525 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,5 +1,15 @@ 2023-11-28T00:08:07.525 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 467 2023-11-28T00:08:07.525 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-11-28T00:08:07.525 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000000) opened an unlinked file! 2023-11-28T00:08:07.525 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000001) opened an unlinked file! 2023-11-28T00:08:07.526 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000002) opened an unlinked file! 2023-11-28T00:08:07.526 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000003) opened an unlinked file! 2023-11-28T00:08:07.526 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000004) opened an unlinked file! 2023-11-28T00:08:07.526 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000005) opened an unlinked file! 2023-11-28T00:08:07.526 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000006) opened an unlinked file! 2023-11-28T00:08:07.526 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000007) opened an unlinked file! 2023-11-28T00:08:07.527 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000008) opened an unlinked file! 2023-11-28T00:08:07.527 INFO:teuthology.orchestra.run.smithi154.stdout: +open_by_handle(/tmp/tmp.0kYt7WHchItest/467-dir/file000009) opened an unlinked file! 2023-11-28T00:08:07.527 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-11-28T00:08:07.527 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-11-28T00:08:07.527 INFO:teuthology.orchestra.run.smithi154.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-11-28T00:08:07.534 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/467 2023-11-28T00:08:07.534 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/467 2023-11-28T00:08:07.535 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T00:08:07.568 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:07.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T00:08:07.720 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T00:08:07.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T00:08:07.720 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-28T00:08:08.761 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:08:08.765 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:08:08.765 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:08.904 INFO:teuthology.orchestra.run.smithi154.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:08:08.908 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/468 2023-11-28T00:08:08.908 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/468 2023-11-28T00:08:08.908 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:08:08.910 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:08.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:08:08.919 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-28T00:08:09.092 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:08:09.096 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:08:09.096 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:10.629 INFO:teuthology.orchestra.run.smithi154.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T00:08:10.630 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/469 2023-11-28T00:08:10.630 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/469 2023-11-28T00:08:10.630 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:08:10.632 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:10.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:08:10.641 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-28T00:08:11.141 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:08:11.144 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:08:11.145 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:11.308 INFO:teuthology.orchestra.run.smithi154.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:08:11.315 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/470 2023-11-28T00:08:11.315 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/470 2023-11-28T00:08:11.315 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:08:11.318 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:11.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:08:11.326 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-28T00:08:11.492 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:08:11.496 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:08:11.496 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:08:42.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:08:42.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:06.464 INFO:teuthology.orchestra.run.smithi154.stdout:generic/471 55s 2023-11-28T00:09:06.481 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/471 2023-11-28T00:09:06.481 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:06.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:06.507 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-28T00:09:07.058 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:07.069 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:07.069 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:07.317 INFO:teuthology.orchestra.run.smithi154.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:07.323 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/472 2023-11-28T00:09:07.323 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/472 2023-11-28T00:09:07.323 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:07.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:07.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:07.340 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-28T00:09:07.768 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:07.774 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:07.774 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:08.159 INFO:teuthology.orchestra.run.smithi154.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T00:09:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/473 2023-11-28T00:09:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/473 2023-11-28T00:09:08.164 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:08.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:08.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:08.183 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-28T00:09:08.368 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:08.372 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:08.372 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:08.478 INFO:teuthology.orchestra.run.smithi154.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:08.481 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/474 2023-11-28T00:09:08.481 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/474 2023-11-28T00:09:08.481 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:08.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:08.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:08.492 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-28T00:09:08.656 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:08.660 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:08.660 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:08.789 INFO:teuthology.orchestra.run.smithi154.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:08.793 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/475 2023-11-28T00:09:08.793 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/475 2023-11-28T00:09:08.794 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:08.795 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:08.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:08.804 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-28T00:09:08.970 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:08.974 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:09.093 INFO:teuthology.orchestra.run.smithi154.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:09.096 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/476 2023-11-28T00:09:09.097 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/476 2023-11-28T00:09:09.097 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:09.099 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:09.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:09.108 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-28T00:09:09.271 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:09.275 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:13.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:13.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:21.538 INFO:teuthology.orchestra.run.smithi154.stdout:generic/477 12s 2023-11-28T00:09:21.672 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/477 2023-11-28T00:09:21.672 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:21.678 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:21.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:21.740 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-28T00:09:23.077 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:23.081 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:23.081 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:33.098 INFO:teuthology.orchestra.run.smithi154.stdout:generic/478 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/478.out.bad) 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/478.out 2023-11-27 22:30:53.847022724 +0000 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/478.out.bad 2023-11-28 00:09:33.090438153 +0000 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -10,7 +10,7 @@ 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: get wrlck 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2023-11-28T00:09:33.100 INFO:teuthology.orchestra.run.smithi154.stdout: +get wrlck 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -25,7 +25,7 @@ 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: get wrlck 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: +get wrlck 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.101 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -37,7 +37,7 @@ 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: +get rdlck 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -46,7 +46,7 @@ 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2023-11-28T00:09:33.102 INFO:teuthology.orchestra.run.smithi154.stdout: get rdlck 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout: -lock could be placed 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout: +get rdlck 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout: lock could be placed 2023-11-28T00:09:33.103 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/478 2023-11-28T00:09:33.104 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/478 2023-11-28T00:09:33.104 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T00:09:33.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:33.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T00:09:33.115 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T00:09:33.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T00:09:33.116 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-28T00:09:33.297 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:33.301 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:33.301 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:33.453 INFO:teuthology.orchestra.run.smithi154.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:33.457 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/479 2023-11-28T00:09:33.457 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/479 2023-11-28T00:09:33.457 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:33.459 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:33.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:33.478 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-28T00:09:33.651 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:33.655 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:33.655 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:33.782 INFO:teuthology.orchestra.run.smithi154.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:33.786 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/480 2023-11-28T00:09:33.786 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/480 2023-11-28T00:09:33.786 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:33.789 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:33.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:33.796 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-28T00:09:33.962 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:33.966 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:33.966 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:34.081 INFO:teuthology.orchestra.run.smithi154.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:34.083 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/481 2023-11-28T00:09:34.083 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/481 2023-11-28T00:09:34.083 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:34.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:34.094 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-28T00:09:34.259 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:34.263 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:34.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:34.425 INFO:teuthology.orchestra.run.smithi154.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:34.428 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/482 2023-11-28T00:09:34.428 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/482 2023-11-28T00:09:34.429 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:34.431 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:34.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:34.440 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-28T00:09:34.605 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:34.609 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:34.609 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:34.739 INFO:teuthology.orchestra.run.smithi154.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:34.742 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/483 2023-11-28T00:09:34.743 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/483 2023-11-28T00:09:34.743 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:34.745 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:34.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:34.753 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-28T00:09:34.922 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:34.926 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:34.926 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:35.043 INFO:teuthology.orchestra.run.smithi154.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:35.046 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/484 2023-11-28T00:09:35.046 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/484 2023-11-28T00:09:35.046 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:35.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:35.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:35.057 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-28T00:09:35.239 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:35.243 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:35.243 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:36.056 INFO:teuthology.orchestra.run.smithi154.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T00:09:36.059 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/485 2023-11-28T00:09:36.059 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/485 2023-11-28T00:09:36.060 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:36.062 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:36.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:36.070 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-28T00:09:36.523 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:36.528 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:36.662 INFO:teuthology.orchestra.run.smithi154.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:36.666 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/486 2023-11-28T00:09:36.666 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/486 2023-11-28T00:09:36.666 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:36.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:36.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:36.677 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-28T00:09:36.850 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:36.854 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:36.854 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:36.975 INFO:teuthology.orchestra.run.smithi154.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:36.978 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/487 2023-11-28T00:09:36.978 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/487 2023-11-28T00:09:36.978 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:36.981 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:36.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:36.989 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-28T00:09:37.155 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:37.159 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:37.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:37.265 INFO:teuthology.orchestra.run.smithi154.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:37.269 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/488 2023-11-28T00:09:37.269 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/488 2023-11-28T00:09:37.269 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:37.271 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:37.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:37.280 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-28T00:09:37.443 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:37.447 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:37.563 INFO:teuthology.orchestra.run.smithi154.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:37.567 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/489 2023-11-28T00:09:37.567 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/489 2023-11-28T00:09:37.567 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:37.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:37.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:37.578 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-28T00:09:37.742 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:37.746 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:37.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:38.774 INFO:teuthology.orchestra.run.smithi154.stdout:generic/490 1s 2023-11-28T00:09:38.779 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/490 2023-11-28T00:09:38.779 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:38.781 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:38.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:38.791 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-28T00:09:39.246 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:39.250 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:39.250 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:39.386 INFO:teuthology.orchestra.run.smithi154.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:39.389 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/491 2023-11-28T00:09:39.389 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/491 2023-11-28T00:09:39.389 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:39.392 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:39.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:39.400 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-28T00:09:39.567 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:39.571 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:39.571 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:39.677 INFO:teuthology.orchestra.run.smithi154.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:39.681 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/492 2023-11-28T00:09:39.681 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/492 2023-11-28T00:09:39.681 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:39.683 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:39.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:39.702 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-28T00:09:39.866 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:39.870 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:39.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:39.985 INFO:teuthology.orchestra.run.smithi154.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:39.989 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/493 2023-11-28T00:09:39.989 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/493 2023-11-28T00:09:39.989 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:39.991 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:40.000 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-28T00:09:40.165 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:40.168 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:40.169 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.275 INFO:teuthology.orchestra.run.smithi154.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:40.278 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/494 2023-11-28T00:09:40.278 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/494 2023-11-28T00:09:40.279 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:40.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:40.289 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-28T00:09:40.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:40.457 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.563 INFO:teuthology.orchestra.run.smithi154.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:40.566 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/495 2023-11-28T00:09:40.567 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/495 2023-11-28T00:09:40.567 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:40.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:40.577 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-28T00:09:40.742 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:40.746 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:40.746 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.866 INFO:teuthology.orchestra.run.smithi154.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:40.869 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/496 2023-11-28T00:09:40.870 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/496 2023-11-28T00:09:40.870 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:40.872 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:40.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:40.880 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-28T00:09:41.048 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:41.051 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:41.052 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:41.164 INFO:teuthology.orchestra.run.smithi154.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:41.167 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/497 2023-11-28T00:09:41.168 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/497 2023-11-28T00:09:41.168 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:41.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:41.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:41.179 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-28T00:09:41.364 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:41.368 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:41.368 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:41.486 INFO:teuthology.orchestra.run.smithi154.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:41.489 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/498 2023-11-28T00:09:41.489 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/498 2023-11-28T00:09:41.490 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:41.492 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:41.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:41.500 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-28T00:09:41.664 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:41.668 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:41.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:41.772 INFO:teuthology.orchestra.run.smithi154.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:41.776 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/499 2023-11-28T00:09:41.776 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/499 2023-11-28T00:09:41.776 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:41.779 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:41.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:41.787 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-28T00:09:41.952 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:41.956 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:41.956 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:42.099 INFO:teuthology.orchestra.run.smithi154.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:42.103 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/500 2023-11-28T00:09:42.103 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/500 2023-11-28T00:09:42.103 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:42.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:42.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:42.114 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-28T00:09:42.276 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:42.280 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:42.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:42.403 INFO:teuthology.orchestra.run.smithi154.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:42.406 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/501 2023-11-28T00:09:42.406 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/501 2023-11-28T00:09:42.407 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:42.409 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:42.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:42.417 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-28T00:09:42.581 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:42.585 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:42.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:42.700 INFO:teuthology.orchestra.run.smithi154.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:42.704 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/502 2023-11-28T00:09:42.704 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/502 2023-11-28T00:09:42.704 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:42.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:42.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:42.732 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-28T00:09:42.898 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:42.902 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:42.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.010 INFO:teuthology.orchestra.run.smithi154.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:43.014 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/503 2023-11-28T00:09:43.014 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/503 2023-11-28T00:09:43.014 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:43.016 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:43.025 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-28T00:09:43.189 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:43.193 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:43.193 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.348 INFO:teuthology.orchestra.run.smithi154.stdout:generic/504 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/504.out.bad) 2023-11-28T00:09:43.350 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/504.out 2023-11-27 22:30:53.849022673 +0000 2023-11-28T00:09:43.350 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/504.out.bad 2023-11-28 00:09:43.346173126 +0000 2023-11-28T00:09:43.350 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,3 @@ 2023-11-28T00:09:43.351 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 504 2023-11-28T00:09:43.351 INFO:teuthology.orchestra.run.smithi154.stdout: +lock info not found 2023-11-28T00:09:43.351 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2023-11-28T00:09:43.353 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/504 2023-11-28T00:09:43.353 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/504 2023-11-28T00:09:43.353 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T00:09:43.355 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T00:09:43.364 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T00:09:43.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T00:09:43.365 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-28T00:09:43.528 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:43.532 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:43.533 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.637 INFO:teuthology.orchestra.run.smithi154.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/505 2023-11-28T00:09:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/505 2023-11-28T00:09:43.641 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:43.643 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:43.652 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-28T00:09:43.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:43.760 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:09:43.820 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:43.824 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:43.824 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.931 INFO:teuthology.orchestra.run.smithi154.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:43.935 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/506 2023-11-28T00:09:43.935 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/506 2023-11-28T00:09:43.935 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:43.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:43.946 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-28T00:09:44.110 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:44.114 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:44.114 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:44.279 INFO:teuthology.orchestra.run.smithi154.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-28T00:09:44.282 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/507 2023-11-28T00:09:44.283 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/507 2023-11-28T00:09:44.283 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:44.285 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:44.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:44.294 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-28T00:09:44.457 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:44.461 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:44.461 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:44.574 INFO:teuthology.orchestra.run.smithi154.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-11-28T00:09:44.577 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/508 2023-11-28T00:09:44.577 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/508 2023-11-28T00:09:44.577 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:44.579 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:44.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:44.588 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-28T00:09:44.752 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:44.756 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:44.756 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:44.877 INFO:teuthology.orchestra.run.smithi154.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:44.881 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/509 2023-11-28T00:09:44.881 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/509 2023-11-28T00:09:44.881 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:44.883 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:44.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:44.892 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-28T00:09:45.057 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:45.060 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:45.061 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:45.182 INFO:teuthology.orchestra.run.smithi154.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:45.185 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/510 2023-11-28T00:09:45.185 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/510 2023-11-28T00:09:45.185 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:45.188 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:45.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:45.196 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-28T00:09:45.360 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:45.364 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:45.364 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:45.468 INFO:teuthology.orchestra.run.smithi154.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:45.472 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/511 2023-11-28T00:09:45.472 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/511 2023-11-28T00:09:45.472 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:45.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:45.483 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-28T00:09:45.648 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:45.652 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:45.652 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:45.767 INFO:teuthology.orchestra.run.smithi154.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:45.771 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/512 2023-11-28T00:09:45.771 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/512 2023-11-28T00:09:45.771 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:45.773 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:45.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:45.794 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-28T00:09:45.960 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:45.964 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:45.965 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:46.073 INFO:teuthology.orchestra.run.smithi154.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:46.076 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/513 2023-11-28T00:09:46.076 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/513 2023-11-28T00:09:46.076 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:46.079 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:46.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:46.087 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-28T00:09:46.251 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:46.255 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:46.367 INFO:teuthology.orchestra.run.smithi154.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:46.408 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/514 2023-11-28T00:09:46.408 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/514 2023-11-28T00:09:46.409 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:46.409 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:46.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:46.409 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-28T00:09:46.573 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:46.577 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:46.577 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:46.685 INFO:teuthology.orchestra.run.smithi154.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:46.688 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/515 2023-11-28T00:09:46.688 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/515 2023-11-28T00:09:46.688 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:46.691 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:46.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:46.699 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-28T00:09:46.870 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:46.874 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:46.874 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:47.026 INFO:teuthology.orchestra.run.smithi154.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-28T00:09:47.029 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/516 2023-11-28T00:09:47.030 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/516 2023-11-28T00:09:47.030 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:47.032 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:47.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:47.040 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-28T00:09:47.512 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:47.515 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:47.516 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:47.627 INFO:teuthology.orchestra.run.smithi154.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:47.630 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/517 2023-11-28T00:09:47.630 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/517 2023-11-28T00:09:47.630 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:47.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:47.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:47.641 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-28T00:09:47.807 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:47.811 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:47.811 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:47.924 INFO:teuthology.orchestra.run.smithi154.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:47.927 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/518 2023-11-28T00:09:47.927 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/518 2023-11-28T00:09:47.927 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:47.929 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:47.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:47.938 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-28T00:09:48.104 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:48.107 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:48.107 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:48.212 INFO:teuthology.orchestra.run.smithi154.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:48.216 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/519 2023-11-28T00:09:48.216 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/519 2023-11-28T00:09:48.216 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:48.218 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:48.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:48.227 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-28T00:09:48.394 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:48.398 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:48.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:48.516 INFO:teuthology.orchestra.run.smithi154.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T00:09:48.519 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/520 2023-11-28T00:09:48.519 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/520 2023-11-28T00:09:48.519 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:09:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:09:48.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:09:48.530 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-28T00:09:48.694 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:09:48.698 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:09:48.698 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:10:13.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:13.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:43.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:10:43.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:14.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:14.049 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:44.167 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:11:44.170 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:14.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:14.246 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:44.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:12:44.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:14.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:14.438 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:44.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:13:44.623 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:14.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:14.713 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:44.764 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:14:44.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:14.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:14.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:45.058 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:15:45.061 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:15.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:15.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:45.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:16:45.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:15.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:15.710 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:45.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:17:45.849 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:15.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:15.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:46.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:18:46.044 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:16.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:16.164 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:46.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:19:46.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:16.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:16.403 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:46.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:20:46.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:16.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:16.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:46.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:21:46.693 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:16.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:16.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:46.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:22:46.849 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:16.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:16.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:47.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:23:47.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:17.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:17.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:47.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:24:47.371 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:17.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:17.493 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:47.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:25:47.598 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:17.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:17.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:47.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:26:47.775 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:17.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:17.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:47.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:27:47.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:18.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:18.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:48.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:28:48.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:18.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:18.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:48.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:29:48.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:18.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:18.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:48.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:30:48.764 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:18.884 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:18.888 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:31:18.921 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T00:31:18.919+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100037) UID: 0 2023-11-28T00:31:18.921 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T00:31:18.919+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100037) UID: 0 2023-11-28T00:31:18.921 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T00:31:18.919+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100037) UID: 0 2023-11-28T00:31:18.922 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T00:31:18.919+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100037) UID: 0 2023-11-28T00:33:42.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:33:42.373 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:12.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:12.468 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:42.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:34:42.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:12.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:12.629 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:42.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:35:42.760 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:12.817 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:12.821 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:42.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:36:42.928 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:13.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:13.020 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:43.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:37:43.182 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:13.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:13.605 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:43.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:38:43.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:13.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:13.903 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:43.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:39:43.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:14.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:14.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:44.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:40:44.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:14.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:14.266 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:44.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:41:44.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:14.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:14.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:44.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:42:44.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:14.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:14.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:44.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:43:44.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:14.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:14.863 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:44.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:44.958 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:44:44.989 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T00:44:44.988+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100463) UID: 0 2023-11-28T00:44:44.990 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T00:44:44.988+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100463) UID: 0 2023-11-28T00:44:44.990 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T00:44:44.988+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100463) UID: 0 2023-11-28T00:44:44.990 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T00:44:44.988+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100463) UID: 0 2023-11-28T00:46:59.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:46:59.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:29.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:29.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:59.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:47:59.559 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:48:29.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:48:34.992 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:05.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:05.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:35.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:49:35.136 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:05.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:05.213 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:35.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:50:35.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:05.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:05.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:35.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:51:35.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:05.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:05.667 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:35.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:52:35.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:05.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:05.897 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:36.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:53:36.073 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:06.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:06.161 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:36.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:54:36.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:06.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:06.348 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:36.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:55:36.568 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:06.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:06.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:36.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:36.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:56:37.033 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T00:56:37.032+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 535929) UID: 0 2023-11-28T00:56:37.034 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T00:56:37.032+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 535929) UID: 0 2023-11-28T00:56:51.349 INFO:teuthology.orchestra.run.smithi154.stdout:generic/521 2823s 2023-11-28T00:56:51.354 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/521 2023-11-28T00:56:51.354 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T00:56:51.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:56:51.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T00:56:51.367 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-28T00:56:51.864 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T00:56:51.868 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T00:56:51.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T00:59:12.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:12.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:42.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:59:42.874 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:12.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:12.948 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:43.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:00:43.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:13.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:13.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:43.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:01:43.249 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:13.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:13.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:43.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:02:43.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:13.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:13.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:43.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:03:43.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:14.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:14.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:44.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:04:44.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:14.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:14.179 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:44.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:05:44.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:14.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:14.373 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:44.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:06:44.470 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:14.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:14.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:44.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:07:44.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:14.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:14.895 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:45.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:08:45.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:15.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:15.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:45.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:09:45.400 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:15.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:16.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:47.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:10:47.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:17.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:17.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:47.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:11:47.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:17.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:17.548 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:47.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:12:47.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:18.031 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:18.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:13:18.066 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T01:13:18.064+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536935) UID: 0 2023-11-28T01:13:18.067 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T01:13:18.064+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536935) UID: 0 2023-11-28T01:13:18.067 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T01:13:18.064+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536935) UID: 0 2023-11-28T01:13:18.067 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T01:13:18.064+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 536935) UID: 0 2023-11-28T01:15:45.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:15:45.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:15.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:15.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:45.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:16:45.897 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:15.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:15.954 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:46.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:17:46.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:16.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:16.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:46.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:18:46.500 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:16.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:16.650 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:46.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:19:46.777 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:16.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:16.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:46.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:20:46.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:17.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:17.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:47.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:21:47.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:17.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:17.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:47.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:22:47.597 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:17.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:17.951 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:48.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:48.014 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:23:48.046 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T01:23:48.045+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101696) UID: 0 2023-11-28T01:23:48.047 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T01:23:48.045+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101696) UID: 0 2023-11-28T01:23:48.047 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T01:23:48.045+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101696) UID: 0 2023-11-28T01:23:48.048 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T01:23:48.045+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101696) UID: 0 2023-11-28T01:26:01.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:01.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:32.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:26:32.073 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:02.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:02.129 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:32.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:27:32.232 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:02.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:02.363 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:32.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:32.435 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:28:50.795 INFO:teuthology.orchestra.run.smithi154.stdout:generic/522 1919s 2023-11-28T01:28:50.831 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/522 2023-11-28T01:28:50.831 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:50.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:50.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:50.861 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-28T01:28:51.145 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:51.149 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:51.149 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:51.258 INFO:teuthology.orchestra.run.smithi154.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:51.261 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/523 2023-11-28T01:28:51.262 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/523 2023-11-28T01:28:51.262 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:51.263 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:51.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:51.272 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-28T01:28:51.435 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:51.440 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:51.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:51.545 INFO:teuthology.orchestra.run.smithi154.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:51.546 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/524 2023-11-28T01:28:51.546 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/524 2023-11-28T01:28:51.546 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:51.548 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:51.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:51.557 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-28T01:28:51.758 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:51.762 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:51.762 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:52.099 INFO:teuthology.orchestra.run.smithi154.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:52.102 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/525 2023-11-28T01:28:52.102 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/525 2023-11-28T01:28:52.102 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:52.105 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:52.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:52.113 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-28T01:28:52.277 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:52.281 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:52.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:52.439 INFO:teuthology.orchestra.run.smithi154.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:52.443 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/526 2023-11-28T01:28:52.443 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/526 2023-11-28T01:28:52.443 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:52.445 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:52.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:52.454 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-28T01:28:52.618 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:52.622 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:52.622 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:52.741 INFO:teuthology.orchestra.run.smithi154.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:52.745 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/527 2023-11-28T01:28:52.745 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/527 2023-11-28T01:28:52.745 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:52.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:52.755 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-28T01:28:52.923 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:52.925 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:52.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.058 INFO:teuthology.orchestra.run.smithi154.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-11-28T01:28:53.062 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/528 2023-11-28T01:28:53.062 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/528 2023-11-28T01:28:53.062 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:53.064 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:53.074 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-28T01:28:53.240 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:53.244 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:53.244 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.389 INFO:teuthology.orchestra.run.smithi154.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T01:28:53.392 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/529 2023-11-28T01:28:53.392 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/529 2023-11-28T01:28:53.392 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:53.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:53.403 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-28T01:28:53.570 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:53.574 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:53.574 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.679 INFO:teuthology.orchestra.run.smithi154.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:53.682 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/530 2023-11-28T01:28:53.682 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/530 2023-11-28T01:28:53.682 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:53.684 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:53.693 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-28T01:28:53.855 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:53.859 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:53.859 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.963 INFO:teuthology.orchestra.run.smithi154.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:53.967 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/531 2023-11-28T01:28:53.967 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/531 2023-11-28T01:28:53.967 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:53.969 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:53.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:53.978 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-28T01:28:54.146 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:54.150 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:54.151 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:54.307 INFO:teuthology.orchestra.run.smithi154.stdout:generic/532 0s 2023-11-28T01:28:54.314 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/532 2023-11-28T01:28:54.314 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:54.315 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:54.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:54.324 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-28T01:28:54.489 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:54.492 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:54.849 INFO:teuthology.orchestra.run.smithi154.stdout:generic/533 0s 2023-11-28T01:28:54.853 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/533 2023-11-28T01:28:54.854 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:54.857 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:54.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:54.864 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-28T01:28:55.031 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:55.035 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:55.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:55.159 INFO:teuthology.orchestra.run.smithi154.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:55.163 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/534 2023-11-28T01:28:55.163 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/534 2023-11-28T01:28:55.163 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:55.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:55.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:55.174 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-28T01:28:55.339 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:55.343 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:55.343 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:55.459 INFO:teuthology.orchestra.run.smithi154.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:55.462 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/535 2023-11-28T01:28:55.462 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/535 2023-11-28T01:28:55.462 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:55.464 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:55.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:55.473 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-28T01:28:55.636 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:55.642 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:55.642 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:55.745 INFO:teuthology.orchestra.run.smithi154.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:55.749 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/536 2023-11-28T01:28:55.749 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/536 2023-11-28T01:28:55.749 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:55.751 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:55.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:55.760 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-28T01:28:55.925 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:55.928 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:55.929 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:56.034 INFO:teuthology.orchestra.run.smithi154.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T01:28:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/537 2023-11-28T01:28:56.037 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/537 2023-11-28T01:28:56.038 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T01:28:56.040 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:28:56.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T01:28:56.049 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-28T01:28:56.215 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T01:28:56.219 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T01:28:56.219 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T01:29:02.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:02.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:32.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:29:32.647 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:03.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:03.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:33.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:30:33.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:03.209 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:03.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:33.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:31:33.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:03.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:03.705 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:33.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:32:33.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:03.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:03.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:33.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:33:33.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:04.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:04.109 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:34.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:34:34.265 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:04.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:04.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:34.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:35:34.492 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:04.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:04.565 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:34.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:36:34.665 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:04.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:04.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:35.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:37:35.142 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:05.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:05.214 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:35.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:38:35.307 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:05.449 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:05.451 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:35.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:39:35.617 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:05.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:05.755 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:35.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:40:35.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:05.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:05.947 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:36.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:41:36.037 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:06.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:06.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:36.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:42:36.226 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:06.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:06.362 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:36.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:43:36.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:06.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:06.548 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:36.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:44:36.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:06.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:06.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:37.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:45:37.053 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:07.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:07.114 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:37.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:46:37.224 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:07.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:07.313 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:37.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:47:37.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:07.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:07.533 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:37.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:48:37.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:07.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:07.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:37.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:49:37.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:50:07.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:50:07.932 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:50:38.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:50:38.063 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:08.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:08.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:38.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:51:38.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:08.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:08.580 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:38.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:52:38.693 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:08.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:08.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:39.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:39.137 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:53:39.169 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T01:53:39.167+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102731) UID: 0 2023-11-28T01:53:39.169 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T01:53:39.167+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102731) UID: 0 2023-11-28T01:53:39.170 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T01:53:39.167+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102731) UID: 0 2023-11-28T01:53:39.170 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T01:53:39.167+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102731) UID: 0 2023-11-28T01:55:57.943 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:55:57.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:28.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:28.289 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:58.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:56:58.575 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:28.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:28.642 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:58.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:57:58.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:28.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:28.934 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:59.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:58:59.023 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:29.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:29.105 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:59.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T01:59:59.202 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:29.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:29.330 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:59.382 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:00:59.385 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:29.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:29.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:59.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:01:59.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:29.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:29.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:59.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:59.817 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:02:59.852 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T02:02:59.850+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551020) UID: 0 2023-11-28T02:02:59.853 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T02:02:59.850+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551020) UID: 0 2023-11-28T02:02:59.853 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T02:02:59.850+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551020) UID: 0 2023-11-28T02:02:59.853 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T02:02:59.850+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551020) UID: 0 2023-11-28T02:05:18.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:18.216 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:48.496 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:48.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:05:48.528 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T02:05:48.527+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551486) UID: 0 2023-11-28T02:05:48.529 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T02:05:48.527+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551486) UID: 0 2023-11-28T02:05:48.529 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T02:05:48.527+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551486) UID: 0 2023-11-28T02:05:48.529 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T02:05:48.527+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 551486) UID: 0 2023-11-28T02:07:44.076 INFO:teuthology.orchestra.run.smithi154.stdout:generic/538 2328s 2023-11-28T02:07:44.083 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/538 2023-11-28T02:07:44.084 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:44.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:44.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:44.092 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-28T02:07:44.528 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:44.532 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:44.532 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:46.178 INFO:teuthology.orchestra.run.smithi154.stdout:generic/539 2s 2023-11-28T02:07:46.184 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/539 2023-11-28T02:07:46.184 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:46.186 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:46.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:46.195 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-28T02:07:46.629 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:46.633 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:46.634 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:46.741 INFO:teuthology.orchestra.run.smithi154.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:46.744 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/540 2023-11-28T02:07:46.745 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/540 2023-11-28T02:07:46.745 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:46.747 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:46.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:46.755 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-28T02:07:46.928 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:46.932 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:46.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.039 INFO:teuthology.orchestra.run.smithi154.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:47.042 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/541 2023-11-28T02:07:47.043 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/541 2023-11-28T02:07:47.043 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:47.045 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:47.053 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-28T02:07:47.217 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:47.221 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:47.221 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.327 INFO:teuthology.orchestra.run.smithi154.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:47.330 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/542 2023-11-28T02:07:47.330 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/542 2023-11-28T02:07:47.330 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:47.333 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:47.341 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-28T02:07:47.506 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:47.510 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:47.510 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.616 INFO:teuthology.orchestra.run.smithi154.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:47.619 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/543 2023-11-28T02:07:47.620 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/543 2023-11-28T02:07:47.620 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:47.622 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:47.630 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-28T02:07:47.795 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:47.799 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:47.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.910 INFO:teuthology.orchestra.run.smithi154.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:47.913 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/544 2023-11-28T02:07:47.913 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/544 2023-11-28T02:07:47.913 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:47.915 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:47.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:47.924 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-28T02:07:48.089 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:48.093 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:48.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:48.319 INFO:teuthology.orchestra.run.smithi154.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-28T02:07:48.322 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/545 2023-11-28T02:07:48.322 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/545 2023-11-28T02:07:48.322 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:48.325 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:48.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:48.333 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-28T02:07:48.496 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:48.500 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:48.500 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:48.687 INFO:teuthology.orchestra.run.smithi154.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:48.691 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/546 2023-11-28T02:07:48.691 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/546 2023-11-28T02:07:48.691 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:48.693 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:48.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:48.701 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-28T02:07:48.866 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:48.870 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:48.994 INFO:teuthology.orchestra.run.smithi154.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:48.997 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/547 2023-11-28T02:07:48.998 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/547 2023-11-28T02:07:48.998 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:49.000 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:49.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:49.008 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-28T02:07:49.174 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:49.177 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:49.178 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:49.323 INFO:teuthology.orchestra.run.smithi154.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:49.327 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/548 2023-11-28T02:07:49.327 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/548 2023-11-28T02:07:49.327 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:49.329 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:49.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:49.337 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-28T02:07:49.503 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:49.507 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:49.655 INFO:teuthology.orchestra.run.smithi154.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:49.658 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/549 2023-11-28T02:07:49.658 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/549 2023-11-28T02:07:49.659 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:49.661 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:49.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:49.669 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-28T02:07:49.835 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:49.839 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:49.839 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:49.988 INFO:teuthology.orchestra.run.smithi154.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:49.992 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/550 2023-11-28T02:07:49.992 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/550 2023-11-28T02:07:49.992 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:49.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:50.003 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-28T02:07:50.166 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:50.170 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:50.170 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.287 INFO:teuthology.orchestra.run.smithi154.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:50.291 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/551 2023-11-28T02:07:50.291 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/551 2023-11-28T02:07:50.291 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:50.293 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:50.302 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-28T02:07:50.468 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:50.472 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:50.472 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.588 INFO:teuthology.orchestra.run.smithi154.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:50.592 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/552 2023-11-28T02:07:50.592 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/552 2023-11-28T02:07:50.592 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:50.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:50.603 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-28T02:07:50.768 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:50.772 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:50.772 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.942 INFO:teuthology.orchestra.run.smithi154.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-11-28T02:07:50.946 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/553 2023-11-28T02:07:50.947 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/553 2023-11-28T02:07:50.947 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:50.948 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:50.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:50.956 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-28T02:07:51.394 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:51.399 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:51.399 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:51.507 INFO:teuthology.orchestra.run.smithi154.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:51.511 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/554 2023-11-28T02:07:51.511 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/554 2023-11-28T02:07:51.511 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:51.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:51.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:51.522 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-28T02:07:51.685 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:51.689 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:51.689 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:51.841 INFO:teuthology.orchestra.run.smithi154.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-11-28T02:07:51.845 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/555 2023-11-28T02:07:51.845 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/555 2023-11-28T02:07:51.845 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:51.847 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:51.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:51.899 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-28T02:07:52.309 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:52.313 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:52.313 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:52.419 INFO:teuthology.orchestra.run.smithi154.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:52.423 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/556 2023-11-28T02:07:52.423 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/556 2023-11-28T02:07:52.423 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:52.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:52.443 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-28T02:07:52.609 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:52.613 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:52.613 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:52.731 INFO:teuthology.orchestra.run.smithi154.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:52.734 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/557 2023-11-28T02:07:52.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/557 2023-11-28T02:07:52.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:52.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:52.745 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-28T02:07:52.910 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:52.914 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:52.914 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.050 INFO:teuthology.orchestra.run.smithi154.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:53.054 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/558 2023-11-28T02:07:53.054 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/558 2023-11-28T02:07:53.054 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:53.056 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:53.065 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-28T02:07:53.229 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:53.233 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:53.233 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.339 INFO:teuthology.orchestra.run.smithi154.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:53.342 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/559 2023-11-28T02:07:53.342 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/559 2023-11-28T02:07:53.343 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:53.354 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-28T02:07:53.521 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:53.525 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:53.525 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.632 INFO:teuthology.orchestra.run.smithi154.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:53.635 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/560 2023-11-28T02:07:53.635 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/560 2023-11-28T02:07:53.635 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:53.637 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:53.646 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-28T02:07:53.811 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:53.815 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:53.815 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.921 INFO:teuthology.orchestra.run.smithi154.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/561 2023-11-28T02:07:53.925 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/561 2023-11-28T02:07:53.925 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:53.927 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:53.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:53.942 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-28T02:07:54.108 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:54.112 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:54.220 INFO:teuthology.orchestra.run.smithi154.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:54.223 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/562 2023-11-28T02:07:54.223 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/562 2023-11-28T02:07:54.223 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:54.226 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:54.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:54.234 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-28T02:07:54.401 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:54.405 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:54.555 INFO:teuthology.orchestra.run.smithi154.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:54.559 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/563 2023-11-28T02:07:54.559 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/563 2023-11-28T02:07:54.559 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:54.561 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:54.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:54.570 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-28T02:07:54.734 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:54.738 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:54.738 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:55.144 INFO:teuthology.orchestra.run.smithi154.stdout:generic/564 1s 2023-11-28T02:07:55.150 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/564 2023-11-28T02:07:55.150 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:55.152 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:55.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:55.161 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-28T02:07:55.618 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:55.622 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:55.622 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:55.736 INFO:teuthology.orchestra.run.smithi154.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:55.739 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/565 2023-11-28T02:07:55.739 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/565 2023-11-28T02:07:55.739 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:55.741 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:55.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:55.750 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-28T02:07:55.918 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:55.922 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:55.922 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:56.042 INFO:teuthology.orchestra.run.smithi154.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/566 2023-11-28T02:07:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/566 2023-11-28T02:07:56.046 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:56.048 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:56.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:56.056 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-28T02:07:56.221 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:56.225 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:56.225 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:56.339 INFO:teuthology.orchestra.run.smithi154.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:56.343 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/567 2023-11-28T02:07:56.343 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/567 2023-11-28T02:07:56.343 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:56.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:56.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:56.354 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-28T02:07:56.526 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:56.530 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:56.530 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:56.696 INFO:teuthology.orchestra.run.smithi154.stdout:generic/568 0s 2023-11-28T02:07:56.705 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/568 2023-11-28T02:07:56.706 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:56.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:56.728 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-28T02:07:57.128 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:57.132 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:57.132 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:57.296 INFO:teuthology.orchestra.run.smithi154.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/569 2023-11-28T02:07:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/569 2023-11-28T02:07:57.300 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:57.303 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:57.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:57.312 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-28T02:07:57.481 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:57.485 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:57.590 INFO:teuthology.orchestra.run.smithi154.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:07:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/570 2023-11-28T02:07:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/570 2023-11-28T02:07:57.594 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:07:57.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:07:57.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:07:57.606 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-28T02:07:57.771 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:07:57.775 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:07:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:04.040 INFO:teuthology.orchestra.run.smithi154.stdout:generic/571 7s 2023-11-28T02:08:04.046 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/571 2023-11-28T02:08:04.047 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:04.049 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:04.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:04.058 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-28T02:08:04.517 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:04.521 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:04.648 INFO:teuthology.orchestra.run.smithi154.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:04.651 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/572 2023-11-28T02:08:04.651 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/572 2023-11-28T02:08:04.652 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:04.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:04.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:04.662 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-28T02:08:04.826 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:04.830 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:04.831 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:04.938 INFO:teuthology.orchestra.run.smithi154.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:04.941 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/573 2023-11-28T02:08:04.942 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/573 2023-11-28T02:08:04.942 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:04.944 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:04.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:04.952 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-28T02:08:05.117 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:05.121 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:05.121 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:05.228 INFO:teuthology.orchestra.run.smithi154.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:05.231 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/574 2023-11-28T02:08:05.231 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/574 2023-11-28T02:08:05.231 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:05.234 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:05.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:05.243 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-28T02:08:05.406 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:05.410 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:05.410 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:05.515 INFO:teuthology.orchestra.run.smithi154.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:05.519 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/575 2023-11-28T02:08:05.519 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/575 2023-11-28T02:08:05.519 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:05.521 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:05.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:05.529 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-28T02:08:05.694 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:05.698 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:05.698 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:05.834 INFO:teuthology.orchestra.run.smithi154.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:05.835 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/576 2023-11-28T02:08:05.835 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/576 2023-11-28T02:08:05.835 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:05.838 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:05.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:05.847 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-28T02:08:06.011 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:06.015 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:06.015 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:06.127 INFO:teuthology.orchestra.run.smithi154.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:06.130 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/577 2023-11-28T02:08:06.130 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/577 2023-11-28T02:08:06.130 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:06.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:06.141 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-28T02:08:06.307 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:06.311 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:06.311 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:06.451 INFO:teuthology.orchestra.run.smithi154.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T02:08:06.454 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/578 2023-11-28T02:08:06.454 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/578 2023-11-28T02:08:06.454 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:06.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:06.465 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-28T02:08:06.629 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:06.633 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:06.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:06.754 INFO:teuthology.orchestra.run.smithi154.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:06.757 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/579 2023-11-28T02:08:06.757 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/579 2023-11-28T02:08:06.757 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:06.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:06.769 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-28T02:08:06.936 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:06.940 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:06.940 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:07.072 INFO:teuthology.orchestra.run.smithi154.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:07.075 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/580 2023-11-28T02:08:07.075 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/580 2023-11-28T02:08:07.076 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:07.078 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:07.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:07.086 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-28T02:08:07.252 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:07.257 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:07.257 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:07.863 INFO:teuthology.orchestra.run.smithi154.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:07.866 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/581 2023-11-28T02:08:07.866 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/581 2023-11-28T02:08:07.867 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:07.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:07.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:07.878 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-28T02:08:08.043 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:08.047 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:08.047 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:08.179 INFO:teuthology.orchestra.run.smithi154.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/582 2023-11-28T02:08:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/582 2023-11-28T02:08:08.183 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:08.185 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:08.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:08.194 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-28T02:08:08.361 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:08.365 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:08.365 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:08.499 INFO:teuthology.orchestra.run.smithi154.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:08.503 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/583 2023-11-28T02:08:08.503 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/583 2023-11-28T02:08:08.503 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:08.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:08.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:08.514 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-28T02:08:08.681 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:08.685 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:08.685 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:08.818 INFO:teuthology.orchestra.run.smithi154.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:08.822 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/584 2023-11-28T02:08:08.822 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/584 2023-11-28T02:08:08.822 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:08.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:08.833 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-28T02:08:08.998 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:09.002 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:09.002 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:09.122 INFO:teuthology.orchestra.run.smithi154.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:09.125 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/585 2023-11-28T02:08:09.125 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/585 2023-11-28T02:08:09.126 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:09.128 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:09.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:09.137 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-28T02:08:09.305 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:09.308 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:14.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:14.560 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:27.353 INFO:teuthology.orchestra.run.smithi154.stdout:generic/586 18s 2023-11-28T02:08:27.358 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/586 2023-11-28T02:08:27.358 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:27.360 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:27.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:27.369 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-28T02:08:27.810 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:27.814 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:27.814 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.059 INFO:teuthology.orchestra.run.smithi154.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T02:08:28.062 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/587 2023-11-28T02:08:28.062 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/587 2023-11-28T02:08:28.063 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:28.064 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:28.074 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-28T02:08:28.239 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:28.243 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:28.243 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.366 INFO:teuthology.orchestra.run.smithi154.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:28.369 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/588 2023-11-28T02:08:28.369 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/588 2023-11-28T02:08:28.370 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:28.380 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-28T02:08:28.547 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:28.551 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:28.551 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.662 INFO:teuthology.orchestra.run.smithi154.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:28.665 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/589 2023-11-28T02:08:28.665 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/589 2023-11-28T02:08:28.666 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:28.677 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-28T02:08:28.840 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:28.844 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:28.844 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.951 INFO:teuthology.orchestra.run.smithi154.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:28.955 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/590 2023-11-28T02:08:28.955 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/590 2023-11-28T02:08:28.955 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:28.957 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:28.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:28.965 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-28T02:08:29.131 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:29.135 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:29.135 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:29.402 INFO:teuthology.orchestra.run.smithi154.stdout:generic/591 0s 2023-11-28T02:08:29.407 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/591 2023-11-28T02:08:29.408 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:29.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:29.418 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-28T02:08:29.872 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:29.877 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:29.877 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.007 INFO:teuthology.orchestra.run.smithi154.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/592 2023-11-28T02:08:30.010 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/592 2023-11-28T02:08:30.011 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:30.012 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:30.021 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-28T02:08:30.186 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:30.190 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:30.190 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.321 INFO:teuthology.orchestra.run.smithi154.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:30.325 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/593 2023-11-28T02:08:30.325 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/593 2023-11-28T02:08:30.325 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:30.327 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:30.336 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-28T02:08:30.501 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:30.505 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:30.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.612 INFO:teuthology.orchestra.run.smithi154.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:30.615 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/594 2023-11-28T02:08:30.616 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/594 2023-11-28T02:08:30.616 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:30.618 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:30.626 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-28T02:08:30.791 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:30.795 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:30.795 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.935 INFO:teuthology.orchestra.run.smithi154.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:30.938 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/595 2023-11-28T02:08:30.939 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/595 2023-11-28T02:08:30.939 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:30.940 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:30.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:30.949 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-28T02:08:31.114 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:31.117 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:31.117 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:31.311 INFO:teuthology.orchestra.run.smithi154.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-11-28T02:08:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/596 2023-11-28T02:08:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/596 2023-11-28T02:08:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:31.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:31.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:31.326 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-28T02:08:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:32.132 INFO:teuthology.orchestra.run.smithi154.stdout:generic/597 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/597.out.bad) 2023-11-28T02:08:32.134 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/597.out 2023-11-27 22:30:53.855022518 +0000 2023-11-28T02:08:32.134 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/597.out.bad 2023-11-28 02:08:32.130116775 +0000 2023-11-28T02:08:32.134 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -4,11 +4,11 @@ 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_symlinks = 0 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: successfully followed symlink 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_symlinks = 1 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: +successfully followed symlink 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: == Test hardlink create protection when 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: == process != target owner and process cannot read target 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_hardlinks = 0 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: -successfully created hardlink 2023-11-28T02:08:32.135 INFO:teuthology.orchestra.run.smithi154.stdout: +Permission denied 2023-11-28T02:08:32.136 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_hardlinks = 1 2023-11-28T02:08:32.136 INFO:teuthology.orchestra.run.smithi154.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-11-28T02:08:32.136 INFO:teuthology.orchestra.run.smithi154.stdout: +Permission denied 2023-11-28T02:08:32.137 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/597 2023-11-28T02:08:32.137 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/597 2023-11-28T02:08:32.137 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T02:08:32.139 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:32.148 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T02:08:32.148 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T02:08:32.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T02:08:32.148 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-28T02:08:32.578 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:32.584 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:32.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.079 INFO:teuthology.orchestra.run.smithi154.stdout:generic/598 - output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/598.out.bad) 2023-11-28T02:08:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/598.out 2023-11-27 22:30:53.855022518 +0000 2023-11-28T02:08:33.081 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/598.out.bad 2023-11-28 02:08:33.077092366 +0000 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -5,13 +5,10 @@ 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_regular = 1 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2023-11-28T02:08:33.082 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_regular = 2 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_fifos = 0 2023-11-28T02:08:33.083 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -19,10 +16,7 @@ 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_fifos = 1 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: fs.protected_fifos = 2 2023-11-28T02:08:33.084 INFO:teuthology.orchestra.run.smithi154.stdout: = group & world writable dir 2023-11-28T02:08:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: = only group writable dir 2023-11-28T02:08:33.085 INFO:teuthology.orchestra.run.smithi154.stdout: -Permission denied 2023-11-28T02:08:33.085 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/598 2023-11-28T02:08:33.085 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/598 2023-11-28T02:08:33.086 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T02:08:33.086 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T02:08:33.094 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T02:08:33.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T02:08:33.095 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-28T02:08:33.549 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:33.554 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:33.554 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.668 INFO:teuthology.orchestra.run.smithi154.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:33.672 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/599 2023-11-28T02:08:33.672 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/599 2023-11-28T02:08:33.672 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:33.674 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:33.683 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-28T02:08:33.849 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:33.853 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:33.853 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.962 INFO:teuthology.orchestra.run.smithi154.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:33.966 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/600 2023-11-28T02:08:33.966 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/600 2023-11-28T02:08:33.966 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:33.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:33.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:33.974 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-28T02:08:34.138 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:34.142 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:34.271 INFO:teuthology.orchestra.run.smithi154.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:34.275 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/601 2023-11-28T02:08:34.275 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/601 2023-11-28T02:08:34.275 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:34.277 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:34.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:34.285 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-28T02:08:34.450 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:34.454 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:34.454 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:34.587 INFO:teuthology.orchestra.run.smithi154.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:34.590 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/602 2023-11-28T02:08:34.591 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/602 2023-11-28T02:08:34.591 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:34.593 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:34.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:34.602 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-28T02:08:34.767 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:34.771 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:34.771 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:34.884 INFO:teuthology.orchestra.run.smithi154.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:34.888 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/603 2023-11-28T02:08:34.888 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/603 2023-11-28T02:08:34.888 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:34.890 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:34.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:34.899 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-28T02:08:35.065 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:35.068 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:35.068 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:35.180 INFO:teuthology.orchestra.run.smithi154.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:35.184 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/604 2023-11-28T02:08:35.184 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/604 2023-11-28T02:08:35.184 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:35.186 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:35.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:35.195 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-28T02:08:35.362 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:35.365 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:35.366 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:35.474 INFO:teuthology.orchestra.run.smithi154.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:35.478 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/605 2023-11-28T02:08:35.478 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/605 2023-11-28T02:08:35.478 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:35.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:35.489 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-28T02:08:35.654 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:35.658 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:35.658 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:35.766 INFO:teuthology.orchestra.run.smithi154.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:35.768 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/606 2023-11-28T02:08:35.769 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/606 2023-11-28T02:08:35.769 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:35.771 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:35.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:35.779 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-28T02:08:35.943 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:35.948 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:35.948 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:36.054 INFO:teuthology.orchestra.run.smithi154.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:36.057 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/607 2023-11-28T02:08:36.057 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/607 2023-11-28T02:08:36.058 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:36.060 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:36.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:36.068 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-28T02:08:36.234 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:36.238 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:36.238 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:36.343 INFO:teuthology.orchestra.run.smithi154.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:36.346 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/608 2023-11-28T02:08:36.346 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/608 2023-11-28T02:08:36.347 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:36.349 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:36.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:36.357 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-28T02:08:36.522 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:36.526 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:36.895 INFO:teuthology.orchestra.run.smithi154.stdout:generic/609 0s 2023-11-28T02:08:36.901 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/609 2023-11-28T02:08:36.901 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:36.903 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:36.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:36.912 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-28T02:08:37.352 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:37.356 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:37.356 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:37.463 INFO:teuthology.orchestra.run.smithi154.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:37.467 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/610 2023-11-28T02:08:37.467 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/610 2023-11-28T02:08:37.467 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:37.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:37.478 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-28T02:08:37.644 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:37.648 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:37.648 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:37.754 INFO:teuthology.orchestra.run.smithi154.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:37.758 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/611 2023-11-28T02:08:37.758 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/611 2023-11-28T02:08:37.758 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:37.760 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:37.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:37.769 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-28T02:08:37.937 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:37.941 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:37.941 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:38.097 INFO:teuthology.orchestra.run.smithi154.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T02:08:38.100 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/612 2023-11-28T02:08:38.100 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/612 2023-11-28T02:08:38.101 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:38.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:38.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:38.112 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-28T02:08:38.577 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:38.581 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:38.712 INFO:teuthology.orchestra.run.smithi154.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:38.715 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/613 2023-11-28T02:08:38.715 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/613 2023-11-28T02:08:38.715 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:38.717 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:38.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:38.726 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-28T02:08:38.894 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:38.898 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:38.898 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.003 INFO:teuthology.orchestra.run.smithi154.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:39.006 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/614 2023-11-28T02:08:39.007 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/614 2023-11-28T02:08:39.007 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:39.009 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:39.031 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-28T02:08:39.197 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:39.201 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:39.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.307 INFO:teuthology.orchestra.run.smithi154.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:39.311 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/615 2023-11-28T02:08:39.311 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/615 2023-11-28T02:08:39.311 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:39.313 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:39.321 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-28T02:08:39.485 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:39.489 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:39.489 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.600 INFO:teuthology.orchestra.run.smithi154.stdout:generic/616 [not run] kernel does not support IO_URING 2023-11-28T02:08:39.603 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/616 2023-11-28T02:08:39.603 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/616 2023-11-28T02:08:39.604 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:39.606 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:39.614 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-28T02:08:39.778 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:39.782 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:39.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.929 INFO:teuthology.orchestra.run.smithi154.stdout:generic/617 [not run] kernel does not support IO_URING 2023-11-28T02:08:39.932 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/617 2023-11-28T02:08:39.932 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/617 2023-11-28T02:08:39.932 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:39.934 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:39.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:39.944 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-28T02:08:40.109 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:40.113 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:40.113 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:40.219 INFO:teuthology.orchestra.run.smithi154.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:40.223 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/618 2023-11-28T02:08:40.223 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/618 2023-11-28T02:08:40.223 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:40.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:40.234 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-28T02:08:40.398 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:40.402 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:40.402 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:40.507 INFO:teuthology.orchestra.run.smithi154.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:40.511 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/619 2023-11-28T02:08:40.511 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/619 2023-11-28T02:08:40.511 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:40.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:40.532 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-28T02:08:40.698 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:40.702 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:40.702 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:40.835 INFO:teuthology.orchestra.run.smithi154.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:40.839 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/620 2023-11-28T02:08:40.839 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/620 2023-11-28T02:08:40.839 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:40.841 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:40.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:40.850 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-28T02:08:41.016 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:41.020 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:41.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:41.152 INFO:teuthology.orchestra.run.smithi154.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:41.156 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/621 2023-11-28T02:08:41.156 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/621 2023-11-28T02:08:41.156 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:41.158 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:41.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:41.167 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-28T02:08:41.331 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:41.335 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:41.335 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:41.442 INFO:teuthology.orchestra.run.smithi154.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:41.445 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/622 2023-11-28T02:08:41.445 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/622 2023-11-28T02:08:41.445 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:41.447 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:41.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:41.456 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-28T02:08:41.623 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:41.627 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:41.731 INFO:teuthology.orchestra.run.smithi154.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:41.735 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/623 2023-11-28T02:08:41.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/623 2023-11-28T02:08:41.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:41.737 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:41.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:41.746 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-28T02:08:41.910 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:41.914 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:41.914 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.021 INFO:teuthology.orchestra.run.smithi154.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:42.024 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/624 2023-11-28T02:08:42.024 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/624 2023-11-28T02:08:42.025 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:42.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:42.035 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-28T02:08:42.200 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:42.204 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:42.204 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.311 INFO:teuthology.orchestra.run.smithi154.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:42.315 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/625 2023-11-28T02:08:42.315 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/625 2023-11-28T02:08:42.315 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:42.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:42.325 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-28T02:08:42.491 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:42.495 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.604 INFO:teuthology.orchestra.run.smithi154.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:42.608 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/626 2023-11-28T02:08:42.608 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/626 2023-11-28T02:08:42.608 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:42.610 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:42.627 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-28T02:08:42.795 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:42.799 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.909 INFO:teuthology.orchestra.run.smithi154.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:42.912 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/627 2023-11-28T02:08:42.912 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/627 2023-11-28T02:08:42.913 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:42.915 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:42.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:42.924 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-28T02:08:43.092 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:43.096 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:43.096 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:43.218 INFO:teuthology.orchestra.run.smithi154.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:43.222 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/628 2023-11-28T02:08:43.222 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/628 2023-11-28T02:08:43.223 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:43.224 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:43.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:43.235 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-28T02:08:43.400 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:43.404 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:43.404 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:43.522 INFO:teuthology.orchestra.run.smithi154.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:43.526 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/629 2023-11-28T02:08:43.526 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/629 2023-11-28T02:08:43.526 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:43.528 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:43.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:43.537 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-28T02:08:43.702 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:43.706 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:43.706 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:43.811 INFO:teuthology.orchestra.run.smithi154.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:43.814 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/630 2023-11-28T02:08:43.815 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/630 2023-11-28T02:08:43.815 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:43.816 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:43.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:43.825 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-28T02:08:43.990 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:43.994 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:43.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:44.100 INFO:teuthology.orchestra.run.smithi154.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:44.103 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/631 2023-11-28T02:08:44.104 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/631 2023-11-28T02:08:44.104 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:44.106 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:44.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:44.125 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-28T02:08:44.290 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:44.294 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:44.294 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:44.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:44.623 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:08:46.832 INFO:teuthology.orchestra.run.smithi154.stdout:generic/632 2s 2023-11-28T02:08:46.838 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/632 2023-11-28T02:08:46.838 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:46.840 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:46.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:46.861 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-28T02:08:47.027 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:47.031 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:47.031 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:47.306 INFO:teuthology.orchestra.run.smithi154.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/633.out.bad) 2023-11-28T02:08:47.338 INFO:teuthology.orchestra.run.smithi154.stdout: --- tests/generic/633.out 2023-11-27 22:30:53.857022467 +0000 2023-11-28T02:08:47.338 INFO:teuthology.orchestra.run.smithi154.stdout: +++ /tmp/tmp.1EbDOAX7rXxfstests-dev/results//generic/633.out.bad 2023-11-28 02:08:47.303725665 +0000 2023-11-28T02:08:47.338 INFO:teuthology.orchestra.run.smithi154.stdout: @@ -1,2 +1,5 @@ 2023-11-28T02:08:47.338 INFO:teuthology.orchestra.run.smithi154.stdout: QA output created by 633 2023-11-28T02:08:47.338 INFO:teuthology.orchestra.run.smithi154.stdout: Silence is golden 2023-11-28T02:08:47.339 INFO:teuthology.orchestra.run.smithi154.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-11-28T02:08:47.339 INFO:teuthology.orchestra.run.smithi154.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-11-28T02:08:47.339 INFO:teuthology.orchestra.run.smithi154.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-11-28T02:08:47.343 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/633 2023-11-28T02:08:47.343 INFO:teuthology.orchestra.run.smithi154.stdout:Failures: generic/633 2023-11-28T02:08:47.343 INFO:teuthology.orchestra.run.smithi154.stdout:Failed 1 of 1 tests 2023-11-28T02:08:47.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:47.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T02:08:47.358 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-28T02:08:47.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-28T02:08:47.358 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-28T02:08:47.759 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:47.763 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:47.763 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:47.887 INFO:teuthology.orchestra.run.smithi154.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:47.891 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/634 2023-11-28T02:08:47.893 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/634 2023-11-28T02:08:47.893 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:47.893 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:47.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:47.901 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-28T02:08:48.067 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:48.071 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:48.071 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:48.177 INFO:teuthology.orchestra.run.smithi154.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:48.180 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/635 2023-11-28T02:08:48.180 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/635 2023-11-28T02:08:48.180 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:48.182 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:48.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:48.202 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-28T02:08:48.366 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:48.370 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:48.370 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:48.475 INFO:teuthology.orchestra.run.smithi154.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:48.479 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/636 2023-11-28T02:08:48.479 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/636 2023-11-28T02:08:48.479 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:48.481 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:48.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:48.490 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-28T02:08:48.655 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:48.659 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:48.659 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:49.696 INFO:teuthology.orchestra.run.smithi154.stdout:generic/637 1s 2023-11-28T02:08:49.700 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/637 2023-11-28T02:08:49.700 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:49.703 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:49.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:49.712 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-28T02:08:50.224 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:50.228 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:50.228 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:50.393 INFO:teuthology.orchestra.run.smithi154.stdout:generic/638 0s 2023-11-28T02:08:50.398 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/638 2023-11-28T02:08:50.398 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:50.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:50.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:50.409 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-28T02:08:50.575 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:50.579 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:50.579 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.074 INFO:teuthology.orchestra.run.smithi154.stdout:generic/639 5s 2023-11-28T02:08:55.080 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/639 2023-11-28T02:08:55.080 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:55.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:55.092 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-28T02:08:55.264 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:55.270 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:55.270 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.394 INFO:teuthology.orchestra.run.smithi154.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:55.398 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/640 2023-11-28T02:08:55.398 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/640 2023-11-28T02:08:55.398 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:55.400 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:55.409 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-28T02:08:55.575 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:55.579 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:55.579 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.691 INFO:teuthology.orchestra.run.smithi154.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:55.694 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/641 2023-11-28T02:08:55.694 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/641 2023-11-28T02:08:55.694 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:55.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:55.706 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-28T02:08:55.870 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:55.874 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:55.874 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:55.987 INFO:teuthology.orchestra.run.smithi154.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:55.991 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/642 2023-11-28T02:08:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/642 2023-11-28T02:08:55.992 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:55.993 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:56.003 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-28T02:08:56.169 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:56.173 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:56.174 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.280 INFO:teuthology.orchestra.run.smithi154.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/643 2023-11-28T02:08:56.284 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/643 2023-11-28T02:08:56.285 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:56.286 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:56.296 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-28T02:08:56.460 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:56.463 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:56.464 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.570 INFO:teuthology.orchestra.run.smithi154.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-11-28T02:08:56.574 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/644 2023-11-28T02:08:56.574 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/644 2023-11-28T02:08:56.574 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:56.576 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:56.584 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-28T02:08:56.748 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:56.753 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:56.753 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.865 INFO:teuthology.orchestra.run.smithi154.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-11-28T02:08:56.868 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/645 2023-11-28T02:08:56.868 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/645 2023-11-28T02:08:56.868 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:56.870 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:56.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:56.879 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-28T02:08:57.044 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:57.048 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:57.048 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:57.153 INFO:teuthology.orchestra.run.smithi154.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:57.157 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/646 2023-11-28T02:08:57.157 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/646 2023-11-28T02:08:57.157 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:57.159 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:57.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:57.168 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-28T02:08:57.333 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:57.337 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:57.337 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:57.612 INFO:teuthology.orchestra.run.smithi154.stdout:generic/647 0s 2023-11-28T02:08:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/647 2023-11-28T02:08:57.617 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:57.620 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:57.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:57.628 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-28T02:08:58.080 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:58.084 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:58.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:58.228 INFO:teuthology.orchestra.run.smithi154.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T02:08:58.232 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/648 2023-11-28T02:08:58.232 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/648 2023-11-28T02:08:58.232 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:58.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:58.243 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-28T02:08:58.407 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:58.411 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:58.411 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:58.579 INFO:teuthology.orchestra.run.smithi154.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-28T02:08:58.583 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/649 2023-11-28T02:08:58.583 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/649 2023-11-28T02:08:58.583 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T02:08:58.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:08:58.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T02:08:58.594 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-28T02:08:59.054 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T02:08:59.058 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T02:08:59.058 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T02:09:14.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:14.805 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:44.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:09:44.960 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:15.141 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:15.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:45.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:10:45.436 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:15.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:15.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:45.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:11:45.785 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:15.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:15.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:46.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:12:46.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:16.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:16.455 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:46.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:13:46.667 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:16.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:16.818 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:47.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:14:47.244 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:17.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:17.502 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:47.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:15:47.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:18.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:18.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:48.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:16:48.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:18.523 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:18.531 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:48.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:17:48.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:19.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:19.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:49.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:18:49.240 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:19.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:19.521 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:19:19.723 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T02:19:19.722+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 602987) UID: 0 2023-11-28T02:19:19.723 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T02:19:19.722+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 602987) UID: 0 2023-11-28T02:28:37.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:28:37.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:07.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:07.340 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:37.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:29:37.488 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:07.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:07.688 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:38.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:30:38.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:08.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:08.796 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:38.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:31:38.983 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:09.103 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:09.108 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:39.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:32:39.322 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:09.800 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:09.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:40.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:33:40.378 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:10.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:10.529 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:41.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:34:41.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:11.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:11.477 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:41.636 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:35:41.641 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:11.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:11.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:42.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:36:42.049 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:12.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:12.195 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:42.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:37:42.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:12.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:12.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:43.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:38:43.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:14.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:14.023 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:44.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:39:44.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:14.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:14.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:44.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:40:44.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:14.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:14.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:44.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:41:44.918 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:15.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:15.047 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:45.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:42:45.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:15.458 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:15.467 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:45.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:43:45.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:15.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:15.969 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:46.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:44:46.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:16.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:16.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:46.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:45:46.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:16.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:16.701 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:46.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:46:46.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:17.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:17.012 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:47.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:47:47.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:17.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:17.387 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:47.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:48:47.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:18.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:18.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:48.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:49:48.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:18.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:18.951 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:49.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:50:49.192 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:19.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:19.311 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:49.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:51:49.448 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:19.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:19.628 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:49.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:52:49.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:20.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:20.112 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:50.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:50.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:53:50.323 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T02:53:50.322+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104470) UID: 0 2023-11-28T02:53:50.324 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T02:53:50.322+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104470) UID: 0 2023-11-28T02:53:50.324 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T02:53:50.322+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104470) UID: 0 2023-11-28T02:53:50.324 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T02:53:50.322+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104470) UID: 0 2023-11-28T02:56:08.007 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:56:08.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T02:56:08.309 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T02:56:08.308+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 609353) UID: 0 2023-11-28T02:56:08.312 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T02:56:08.308+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 609353) UID: 0 2023-11-28T03:05:11.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:11.152 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:41.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:05:41.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:11.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:11.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:41.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:06:41.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:11.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:11.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:42.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:07:42.117 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:12.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:12.400 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:42.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:08:42.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:12.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:12.935 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:43.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:09:43.231 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:13.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:13.415 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:43.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:10:43.618 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:13.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:13.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:44.362 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:11:44.373 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:14.493 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:14.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:44.729 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:12:44.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:14.856 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:14.861 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:44.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:13:44.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:15.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:15.337 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:45.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:14:45.516 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:15.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:15.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:46.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:15:46.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:16.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:16.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:46.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:16:46.642 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:17.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:17.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:47.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:17:47.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:17.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:17.644 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:47.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:18:47.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:18.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:18.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:48.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:19:48.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:18.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:18.495 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:48.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:20:48.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:19.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:19.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:49.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:21:49.376 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:19.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:19.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:49.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:22:49.733 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:20.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:20.134 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:50.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:23:50.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:20.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:20.501 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:50.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:24:50.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:21.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:21.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:52.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:25:52.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:22.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:22.295 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:52.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:26:52.450 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:22.810 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:22.815 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:53.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:27:53.035 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:23.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:23.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:53.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:28:53.570 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:23.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:23.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:53.812 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:29:53.822 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:23.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:23.993 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:54.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:30:54.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:24.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:24.425 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:54.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:31:54.758 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:24.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:24.907 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:55.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:32:55.144 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:25.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:25.292 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:55.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:33:55.421 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:25.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:25.585 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:34:25.869 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T03:34:25.867+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616038) UID: 0 2023-11-28T03:34:25.870 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T03:34:25.868+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616038) UID: 0 2023-11-28T03:34:25.880 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T03:34:25.869+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616038) UID: 0 2023-11-28T03:34:25.880 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T03:34:25.869+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 616038) UID: 0 2023-11-28T03:43:25.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:43:25.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:43:25.749 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T03:43:25.748+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105666) UID: 0 2023-11-28T03:43:25.750 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T03:43:25.748+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105666) UID: 0 2023-11-28T03:43:25.750 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T03:43:25.748+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105666) UID: 0 2023-11-28T03:43:25.750 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T03:43:25.748+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105666) UID: 0 2023-11-28T03:43:25.763 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T03:43:25.762+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 617422) UID: 0 2023-11-28T03:43:25.765 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T03:43:25.764+0000 7f17f4dbb640 -1 Fail to open '/proc/617422/cmdline' error = (2) No such file or directory 2023-11-28T03:43:25.771 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T03:43:25.764+0000 7f17f4dbb640 -1 received signal: Hangup from (PID: 617422) UID: 0 2023-11-28T03:54:19.669 INFO:teuthology.orchestra.run.smithi154.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-11-28T03:54:19.692 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: stdin: file size changed while zipping 2023-11-28T03:54:54.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:54:54.824 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:54:54.858 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T03:54:54.857+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105719) UID: 0 2023-11-28T03:54:54.859 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T03:54:54.857+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105719) UID: 0 2023-11-28T03:54:54.859 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T03:54:54.857+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105719) UID: 0 2023-11-28T03:54:54.859 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T03:54:54.857+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105719) UID: 0 2023-11-28T03:57:20.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:20.912 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:51.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:57:51.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:21.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:21.258 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:51.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:58:51.410 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:21.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:21.651 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:52.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T03:59:52.219 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:22.357 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:22.385 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:52.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:00:52.534 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:22.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:22.697 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:52.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:01:52.844 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:23.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:23.140 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:53.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:02:53.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:23.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:23.487 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:53.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:03:53.631 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:23.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:23.830 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:54.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:04:54.014 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:24.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:24.191 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:54.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:05:54.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:24.592 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:24.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:54.946 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:06:54.956 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:25.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:25.345 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:55.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:07:55.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:25.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:25.804 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:55.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:55.956 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:08:55.987 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T04:08:55.986+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106194) UID: 0 2023-11-28T04:08:55.987 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T04:08:55.986+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106194) UID: 0 2023-11-28T04:08:55.987 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T04:08:55.986+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106194) UID: 0 2023-11-28T04:08:55.988 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T04:08:55.986+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106194) UID: 0 2023-11-28T04:11:21.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:21.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:51.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:11:51.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:22.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:22.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:52.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:12:52.429 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:22.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:22.622 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:52.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:13:52.797 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:23.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:23.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:53.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:14:53.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:23.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:23.403 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:53.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:15:53.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:23.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:23.767 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:53.963 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:16:53.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:24.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:24.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:54.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:17:54.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:24.553 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:24.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:54.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:18:54.854 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:25.045 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:25.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:55.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:19:55.397 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:25.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:25.585 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:55.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:20:55.783 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:25.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:25.955 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:56.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:21:56.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:26.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:26.539 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:56.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:22:56.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:26.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:26.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:57.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:23:57.062 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:27.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:27.209 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:24:27.364 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T04:24:27.363+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 624274) UID: 0 2023-11-28T04:24:27.364 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T04:24:27.363+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 624274) UID: 0 2023-11-28T04:33:14.099 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T04:33:14.096+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625446) UID: 0 2023-11-28T04:33:14.100 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T04:33:14.096+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625446) UID: 0 2023-11-28T04:33:14.100 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T04:33:14.097+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625446) UID: 0 2023-11-28T04:33:14.101 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T04:33:14.099+0000 7f02cb0f3640 -1 Fail to open '/proc/625446/cmdline' error = (2) No such file or directory 2023-11-28T04:33:14.101 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T04:33:14.099+0000 7f02cb0f3640 -1 received signal: Hangup from (PID: 625446) UID: 0 2023-11-28T04:42:08.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:42:08.468 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:42:08.844 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T04:42:08.843+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626765) UID: 0 2023-11-28T04:42:08.844 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T04:42:08.843+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626765) UID: 0 2023-11-28T04:42:08.844 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T04:42:08.843+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626765) UID: 0 2023-11-28T04:42:08.851 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T04:42:08.847+0000 7febf519d640 -1 Fail to open '/proc/626765/cmdline' error = (2) No such file or directory 2023-11-28T04:42:08.851 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T04:42:08.847+0000 7febf519d640 -1 received signal: Hangup from (PID: 626765) UID: 0 2023-11-28T04:51:36.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:51:36.585 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:06.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:06.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:37.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:52:38.500 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:08.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:08.707 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:38.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:53:38.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:08.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:08.991 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:39.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:54:39.149 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:09.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:09.298 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:39.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:55:39.536 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:09.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:09.697 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:39.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:56:39.859 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:10.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:10.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:40.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:57:40.794 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:11.058 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:11.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T04:58:11.208 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T04:58:11.206+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 628933) UID: 0 2023-11-28T04:58:11.209 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T04:58:11.206+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 628933) UID: 0 2023-11-28T05:03:56.463 INFO:teuthology.orchestra.run.smithi154.stdout:generic/650 10497s 2023-11-28T05:03:56.523 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/650 2023-11-28T05:03:56.523 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:03:56.534 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:03:56.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:03:56.610 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-11-28T05:03:57.793 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:03:57.809 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:03:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:03:58.317 INFO:teuthology.orchestra.run.smithi154.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:03:58.331 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/651 2023-11-28T05:03:58.331 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/651 2023-11-28T05:03:58.331 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:03:58.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:03:58.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:03:58.374 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-11-28T05:03:59.223 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:03:59.248 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:03:59.249 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:03:59.764 INFO:teuthology.orchestra.run.smithi154.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:03:59.770 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/652 2023-11-28T05:03:59.771 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/652 2023-11-28T05:03:59.771 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:03:59.782 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:03:59.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:03:59.815 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-11-28T05:04:00.628 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:00.644 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:00.644 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:01.135 INFO:teuthology.orchestra.run.smithi154.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/653 2023-11-28T05:04:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/653 2023-11-28T05:04:01.159 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:01.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:01.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:01.209 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-11-28T05:04:02.122 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:02.138 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:02.699 INFO:teuthology.orchestra.run.smithi154.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:02.712 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/654 2023-11-28T05:04:02.712 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/654 2023-11-28T05:04:02.712 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:02.724 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:02.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:02.760 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-11-28T05:04:03.655 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:03.672 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:03.672 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:04.159 INFO:teuthology.orchestra.run.smithi154.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:04.173 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/655 2023-11-28T05:04:04.173 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/655 2023-11-28T05:04:04.173 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:04.183 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:04.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:04.225 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-11-28T05:04:05.017 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:05.033 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:05.033 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:05.558 INFO:teuthology.orchestra.run.smithi154.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-11-28T05:04:05.571 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/656 2023-11-28T05:04:05.571 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/656 2023-11-28T05:04:05.571 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:05.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:05.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:05.615 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-11-28T05:04:06.473 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:06.492 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:07.003 INFO:teuthology.orchestra.run.smithi154.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:07.016 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/657 2023-11-28T05:04:07.017 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/657 2023-11-28T05:04:07.017 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:07.028 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:07.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:07.062 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-11-28T05:04:07.894 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:07.910 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:07.911 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:08.485 INFO:teuthology.orchestra.run.smithi154.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:08.498 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/658 2023-11-28T05:04:08.499 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/658 2023-11-28T05:04:08.499 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:08.509 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:08.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:08.544 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-11-28T05:04:09.410 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:09.430 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:09.430 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:10.181 INFO:teuthology.orchestra.run.smithi154.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:10.195 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/659 2023-11-28T05:04:10.195 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/659 2023-11-28T05:04:10.196 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:10.205 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:10.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:10.244 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-11-28T05:04:11.109 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:11.124 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:11.124 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:11.619 INFO:teuthology.orchestra.run.smithi154.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:11.633 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/660 2023-11-28T05:04:11.634 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/660 2023-11-28T05:04:11.634 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:11.644 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:11.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:11.687 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-11-28T05:04:12.537 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:12.553 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:12.553 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:13.078 INFO:teuthology.orchestra.run.smithi154.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:13.091 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/661 2023-11-28T05:04:13.092 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/661 2023-11-28T05:04:13.092 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:13.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:13.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:13.140 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-11-28T05:04:13.981 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:13.999 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:13.999 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:14.525 INFO:teuthology.orchestra.run.smithi154.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:14.539 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/662 2023-11-28T05:04:14.539 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/662 2023-11-28T05:04:14.540 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:14.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:14.591 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-11-28T05:04:15.453 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:15.469 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:15.469 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:15.949 INFO:teuthology.orchestra.run.smithi154.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:15.962 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/663 2023-11-28T05:04:15.963 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/663 2023-11-28T05:04:15.963 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:15.972 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:16.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:16.015 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-11-28T05:04:16.885 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:16.902 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:16.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:17.428 INFO:teuthology.orchestra.run.smithi154.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:17.442 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/664 2023-11-28T05:04:17.443 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/664 2023-11-28T05:04:17.443 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:17.455 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:17.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:17.493 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-11-28T05:04:18.346 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:18.362 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:18.363 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:18.899 INFO:teuthology.orchestra.run.smithi154.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:18.912 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/665 2023-11-28T05:04:18.913 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/665 2023-11-28T05:04:18.913 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:18.933 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:18.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:18.961 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-11-28T05:04:19.795 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:19.810 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:19.810 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:20.298 INFO:teuthology.orchestra.run.smithi154.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:20.312 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/666 2023-11-28T05:04:20.312 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/666 2023-11-28T05:04:20.312 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:20.322 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:20.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:20.365 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-11-28T05:04:21.180 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:21.200 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:21.201 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:21.721 INFO:teuthology.orchestra.run.smithi154.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:21.734 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/667 2023-11-28T05:04:21.735 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/667 2023-11-28T05:04:21.736 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:21.745 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:21.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:21.784 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-11-28T05:04:22.643 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:22.667 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:22.667 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:23.202 INFO:teuthology.orchestra.run.smithi154.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:23.207 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/668 2023-11-28T05:04:23.207 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/668 2023-11-28T05:04:23.208 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:23.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:23.260 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-11-28T05:04:24.093 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:24.110 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:24.110 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:24.629 INFO:teuthology.orchestra.run.smithi154.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:24.647 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/669 2023-11-28T05:04:24.647 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/669 2023-11-28T05:04:24.647 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:24.654 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:24.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:24.699 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-11-28T05:04:25.488 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:25.504 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:25.504 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:26.005 INFO:teuthology.orchestra.run.smithi154.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:26.020 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/670 2023-11-28T05:04:26.021 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/670 2023-11-28T05:04:26.021 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:26.032 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:26.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:26.070 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-11-28T05:04:26.907 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:26.931 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:26.932 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:27.446 INFO:teuthology.orchestra.run.smithi154.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:27.459 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/671 2023-11-28T05:04:27.460 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/671 2023-11-28T05:04:27.460 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:27.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:27.510 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-11-28T05:04:28.362 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:28.387 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:28.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:28.930 INFO:teuthology.orchestra.run.smithi154.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:28.944 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/672 2023-11-28T05:04:28.944 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/672 2023-11-28T05:04:28.944 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:28.953 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:28.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:28.988 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-11-28T05:04:29.834 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:29.850 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:29.850 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:31.161 INFO:teuthology.orchestra.run.smithi154.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:31.175 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/673 2023-11-28T05:04:31.176 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/673 2023-11-28T05:04:31.176 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:31.187 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:31.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:31.222 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-11-28T05:04:32.073 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:32.089 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:32.089 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:32.678 INFO:teuthology.orchestra.run.smithi154.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:32.692 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/674 2023-11-28T05:04:32.692 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/674 2023-11-28T05:04:32.692 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:32.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:32.741 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-11-28T05:04:33.552 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:33.569 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:33.569 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:34.203 INFO:teuthology.orchestra.run.smithi154.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T05:04:34.216 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/675 2023-11-28T05:04:34.217 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/675 2023-11-28T05:04:34.217 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T05:04:34.227 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:04:34.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T05:04:34.272 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-11-28T05:04:35.175 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T05:04:35.189 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T05:04:35.190 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T05:07:46.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:07:46.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:16.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:16.463 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:46.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:08:46.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:16.971 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:16.979 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:47.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:09:47.138 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:17.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:17.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:47.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:10:47.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:18.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:18.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:48.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:11:48.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:18.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:18.346 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:48.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:12:48.491 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:18.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:18.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:48.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:13:48.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:19.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:19.159 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:49.315 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:14:49.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:19.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:19.469 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:49.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:15:49.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:19.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:19.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:50.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:16:50.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:20.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:20.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:50.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:50.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:17:50.940 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T05:17:50.938+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640304) UID: 0 2023-11-28T05:17:50.940 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T05:17:50.938+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640304) UID: 0 2023-11-28T05:28:31.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:28:31.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:28:31.427 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T05:28:31.425+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107488) UID: 0 2023-11-28T05:28:31.427 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T05:28:31.425+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107488) UID: 0 2023-11-28T05:28:31.428 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T05:28:31.425+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107488) UID: 0 2023-11-28T05:28:31.428 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T05:28:31.426+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107488) UID: 0 2023-11-28T05:31:22.273 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:31:22.284 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:31:52.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:31:52.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:32:22.716 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:32:22.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:32:22.857 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T05:32:22.856+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640403) UID: 0 2023-11-28T05:32:22.858 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T05:32:22.856+0000 7f31aff79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640403) UID: 0 2023-11-28T05:32:22.858 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T05:32:22.856+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640403) UID: 0 2023-11-28T05:32:22.858 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T05:32:22.857+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640403) UID: 0 2023-11-28T05:43:10.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:43:10.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T05:43:11.059 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T05:43:11.057+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640429) UID: 0 2023-11-28T05:43:11.059 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T05:43:11.058+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640429) UID: 0 2023-11-28T05:55:53.075 INFO:tasks.ceph.osd.1.smithi154.stderr:2023-11-28T05:55:53.073+0000 7f02cb0f3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640437) UID: 0 2023-11-28T05:55:53.076 INFO:tasks.ceph.osd.2.smithi154.stderr:2023-11-28T05:55:53.073+0000 7f59645c9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640437) UID: 0 2023-11-28T05:55:53.076 INFO:tasks.ceph.osd.3.smithi154.stderr:2023-11-28T05:55:53.073+0000 7febf519d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 640437) UID: 0 2023-11-28T05:55:53.078 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T05:55:53.075+0000 7f31aff79640 -1 Fail to open '/proc/640437/cmdline' error = (2) No such file or directory 2023-11-28T05:55:53.078 INFO:tasks.ceph.osd.0.smithi154.stderr:2023-11-28T05:55:53.075+0000 7f31aff79640 -1 received signal: Hangup from (PID: 640437) UID: 0 2023-11-28T06:06:28.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:06:28.942 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:06:28.976 INFO:tasks.ceph.osd.4.smithi194.stderr:2023-11-28T06:06:28.974+0000 7f838c6b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107633) UID: 0 2023-11-28T06:06:28.977 INFO:tasks.ceph.osd.5.smithi194.stderr:2023-11-28T06:06:28.974+0000 7f78e650e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107633) UID: 0 2023-11-28T06:06:28.977 INFO:tasks.ceph.osd.6.smithi194.stderr:2023-11-28T06:06:28.974+0000 7f0a1f14b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107633) UID: 0 2023-11-28T06:06:28.977 INFO:tasks.ceph.osd.7.smithi194.stderr:2023-11-28T06:06:28.974+0000 7fb3cf5a4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107633) UID: 0 2023-11-28T06:06:29.384 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T06:06:29.383+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640479) UID: 0 2023-11-28T06:06:29.385 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T06:06:29.383+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640479) UID: 0 2023-11-28T06:18:50.110 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:18:50.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:19:20.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:19:20.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:19:50.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:19:50.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:20:20.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:20:20.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:20:51.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:20:51.078 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:21:21.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:21:21.253 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:21:51.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:21:51.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:22:21.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:22:21.882 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:22:52.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:22:52.266 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:23:22.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:23:22.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:23:52.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:23:52.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:24:22.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:24:22.880 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:24:53.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:24:53.235 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:25:23.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:25:23.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:25:53.550 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:25:53.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:26:23.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:26:23.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:26:54.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:26:54.446 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T06:26:54.715 INFO:tasks.ceph.mds.a.smithi154.stderr:2023-11-28T06:26:54.713+0000 7f043982b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640798) UID: 0 2023-11-28T06:26:54.715 INFO:tasks.ceph.mds.c.smithi154.stderr:2023-11-28T06:26:54.713+0000 7f17f4dbb640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 640798) UID: 0 2023-11-28T06:30:10.919 INFO:teuthology.orchestra.run.smithi154.stdout:generic/676 5135s 2023-11-28T06:30:11.047 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/676 2023-11-28T06:30:11.053 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:11.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:11.117 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-11-28T06:30:12.663 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:12.679 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:12.679 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:13.391 INFO:teuthology.orchestra.run.smithi154.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:30:13.404 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/677 2023-11-28T06:30:13.405 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/677 2023-11-28T06:30:13.405 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:13.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:13.461 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-11-28T06:30:14.325 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:14.341 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:14.341 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:15.003 INFO:teuthology.orchestra.run.smithi154.stdout:generic/678 [not run] kernel does not support IO_URING 2023-11-28T06:30:15.015 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/678 2023-11-28T06:30:15.016 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/678 2023-11-28T06:30:15.016 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:15.032 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:15.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:15.080 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-11-28T06:30:15.937 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:15.961 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:15.961 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:16.467 INFO:teuthology.orchestra.run.smithi154.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:30:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/679 2023-11-28T06:30:16.481 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/679 2023-11-28T06:30:16.482 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:16.492 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:16.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:16.528 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-11-28T06:30:17.314 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:17.332 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:17.333 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:19.401 INFO:teuthology.orchestra.run.smithi154.stdout:generic/680 2s 2023-11-28T06:30:19.424 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/680 2023-11-28T06:30:19.424 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:19.434 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:19.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:19.465 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-11-28T06:30:20.712 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:20.740 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:20.740 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:21.280 INFO:teuthology.orchestra.run.smithi154.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T06:30:21.281 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/681 2023-11-28T06:30:21.282 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/681 2023-11-28T06:30:21.282 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:21.292 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:21.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:21.337 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-11-28T06:30:22.196 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:22.216 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:22.216 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:22.700 INFO:teuthology.orchestra.run.smithi154.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-28T06:30:22.713 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/682 2023-11-28T06:30:22.713 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/682 2023-11-28T06:30:22.714 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:22.723 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:22.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:22.763 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-11-28T06:30:23.518 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:23.534 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:23.535 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:24.505 INFO:teuthology.orchestra.run.smithi154.stdout:generic/683 [not run] /tmp/tmp.0kYt7WHchItest: file alloc unit 4194304 larger than op length 65536 2023-11-28T06:30:24.520 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/683 2023-11-28T06:30:24.520 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/683 2023-11-28T06:30:24.520 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:24.531 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:24.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:24.578 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-11-28T06:30:25.379 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:25.394 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:25.394 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:29.841 INFO:teuthology.orchestra.run.smithi154.stdout:generic/684 [not run] /tmp/tmp.0kYt7WHchItest: file alloc unit 4194304 larger than op length 65536 2023-11-28T06:30:29.855 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/684 2023-11-28T06:30:29.855 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/684 2023-11-28T06:30:29.855 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:29.866 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:29.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:29.905 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-11-28T06:30:30.736 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:30.752 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:30.752 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:35.323 INFO:teuthology.orchestra.run.smithi154.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T06:30:35.335 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/685 2023-11-28T06:30:35.335 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/685 2023-11-28T06:30:35.335 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:35.346 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:35.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:35.384 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-11-28T06:30:36.681 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:36.697 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:36.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:41.096 INFO:teuthology.orchestra.run.smithi154.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-28T06:30:41.110 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/686 2023-11-28T06:30:41.110 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/686 2023-11-28T06:30:41.110 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:41.120 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:41.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:41.165 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-11-28T06:30:42.083 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:42.099 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:42.099 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:47.613 INFO:teuthology.orchestra.run.smithi154.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-28T06:30:47.627 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/687 2023-11-28T06:30:47.627 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/687 2023-11-28T06:30:47.627 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:47.638 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:47.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:47.683 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-11-28T06:30:48.511 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:48.527 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:49.482 INFO:teuthology.orchestra.run.smithi154.stdout:generic/688 [not run] /tmp/tmp.0kYt7WHchItest: file alloc unit 4194304 larger than op length 65536 2023-11-28T06:30:49.495 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/688 2023-11-28T06:30:49.496 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/688 2023-11-28T06:30:49.496 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:49.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:49.545 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-11-28T06:30:50.381 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:50.397 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:50.398 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:51.004 INFO:teuthology.orchestra.run.smithi154.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-11-28T06:30:51.023 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/689 2023-11-28T06:30:51.023 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/689 2023-11-28T06:30:51.024 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:51.032 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:51.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:51.067 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-11-28T06:30:51.886 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:51.901 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:51.902 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:52.442 INFO:teuthology.orchestra.run.smithi154.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:30:52.456 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/690 2023-11-28T06:30:52.456 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/690 2023-11-28T06:30:52.456 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:52.465 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:52.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:52.514 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-11-28T06:30:53.306 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:53.323 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:53.907 INFO:teuthology.orchestra.run.smithi154.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:30:53.920 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/691 2023-11-28T06:30:53.921 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/691 2023-11-28T06:30:53.921 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:53.931 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:53.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:53.963 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-11-28T06:30:54.769 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:54.788 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:55.321 INFO:teuthology.orchestra.run.smithi154.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:30:55.335 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/692 2023-11-28T06:30:55.335 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/692 2023-11-28T06:30:55.335 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:55.344 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:55.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:55.394 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-11-28T06:30:56.243 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:56.265 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:56.265 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:56.862 INFO:teuthology.orchestra.run.smithi154.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:30:56.874 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/693 2023-11-28T06:30:56.874 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/693 2023-11-28T06:30:56.875 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:56.884 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:56.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:56.925 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-11-28T06:30:57.784 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:30:57.801 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:30:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:59.307 INFO:teuthology.orchestra.run.smithi154.stdout:generic/694 2s 2023-11-28T06:30:59.336 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/694 2023-11-28T06:30:59.337 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:30:59.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:30:59.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:30:59.379 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-11-28T06:31:00.306 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:00.329 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:00.329 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:00.912 INFO:teuthology.orchestra.run.smithi154.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:00.926 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/695 2023-11-28T06:31:00.926 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/695 2023-11-28T06:31:00.927 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:00.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:00.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:00.978 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-11-28T06:31:01.770 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:01.786 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:01.786 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:02.319 INFO:teuthology.orchestra.run.smithi154.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:02.333 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/696 2023-11-28T06:31:02.333 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/696 2023-11-28T06:31:02.334 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:02.351 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:02.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:02.397 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-11-28T06:31:03.221 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:03.239 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:03.900 INFO:teuthology.orchestra.run.smithi154.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-28T06:31:03.914 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/697 2023-11-28T06:31:03.914 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/697 2023-11-28T06:31:03.915 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:03.925 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:03.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:03.964 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-11-28T06:31:04.765 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:04.784 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:04.784 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:05.319 INFO:teuthology.orchestra.run.smithi154.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:05.332 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/698 2023-11-28T06:31:05.333 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/698 2023-11-28T06:31:05.333 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:05.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:05.377 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-11-28T06:31:06.197 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:06.217 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:06.218 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:07.059 INFO:teuthology.orchestra.run.smithi154.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:07.072 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/699 2023-11-28T06:31:07.073 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/699 2023-11-28T06:31:07.073 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:07.084 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:07.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:07.128 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-11-28T06:31:07.908 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:07.925 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:07.926 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:08.490 INFO:teuthology.orchestra.run.smithi154.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:08.504 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/700 2023-11-28T06:31:08.504 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/700 2023-11-28T06:31:08.504 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:08.514 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:08.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:08.554 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-11-28T06:31:09.317 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:09.334 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:10.668 INFO:teuthology.orchestra.run.smithi154.stdout:generic/701 1s 2023-11-28T06:31:10.695 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/701 2023-11-28T06:31:10.695 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:10.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:10.755 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-11-28T06:31:11.894 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:11.916 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:11.916 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:12.468 INFO:teuthology.orchestra.run.smithi154.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:12.481 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/702 2023-11-28T06:31:12.482 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/702 2023-11-28T06:31:12.482 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:12.492 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:12.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:12.532 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-11-28T06:31:13.448 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:13.463 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:13.463 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:14.260 INFO:teuthology.orchestra.run.smithi154.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:14.276 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/703 2023-11-28T06:31:14.276 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/703 2023-11-28T06:31:14.276 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:14.285 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:14.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:14.324 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-11-28T06:31:15.205 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:15.232 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:15.232 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:15.998 INFO:teuthology.orchestra.run.smithi154.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-11-28T06:31:16.010 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/704 2023-11-28T06:31:16.011 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/704 2023-11-28T06:31:16.011 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:16.021 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:16.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:16.071 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-11-28T06:31:16.995 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:17.010 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:17.010 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:17.557 INFO:teuthology.orchestra.run.smithi154.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:17.577 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/705 2023-11-28T06:31:17.577 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/705 2023-11-28T06:31:17.577 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:17.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:17.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:17.626 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-11-28T06:31:18.466 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:18.483 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:21.712 INFO:teuthology.orchestra.run.smithi154.stdout:generic/706 3s 2023-11-28T06:31:21.735 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/706 2023-11-28T06:31:21.735 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:21.745 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:21.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:21.799 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-11-28T06:31:22.872 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:22.889 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:22.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:23.426 INFO:teuthology.orchestra.run.smithi154.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:31:23.439 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/707 2023-11-28T06:31:23.440 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/707 2023-11-28T06:31:23.440 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:23.450 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:23.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:23.494 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-11-28T06:31:24.329 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:24.345 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:26.136 INFO:teuthology.orchestra.run.smithi154.stdout:generic/708 2s 2023-11-28T06:31:26.160 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/708 2023-11-28T06:31:26.160 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:26.171 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:26.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:26.212 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-11-28T06:31:27.297 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:27.319 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:27.319 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:28.076 INFO:teuthology.orchestra.run.smithi154.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:28.090 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/709 2023-11-28T06:31:28.090 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/709 2023-11-28T06:31:28.092 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:28.103 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:28.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:28.143 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-11-28T06:31:29.255 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:29.275 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:29.275 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:29.874 INFO:teuthology.orchestra.run.smithi154.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:29.890 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/710 2023-11-28T06:31:29.890 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/710 2023-11-28T06:31:29.890 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:29.900 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:29.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:29.941 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-11-28T06:31:31.087 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:31.111 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:31.111 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:31.805 INFO:teuthology.orchestra.run.smithi154.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:31.820 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/711 2023-11-28T06:31:31.821 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/711 2023-11-28T06:31:31.821 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:31.831 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:31.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:31.899 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-11-28T06:31:33.024 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:33.040 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:33.040 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:33.732 INFO:teuthology.orchestra.run.smithi154.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:33.745 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/712 2023-11-28T06:31:33.746 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/712 2023-11-28T06:31:33.746 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:33.755 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:33.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:33.804 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-11-28T06:31:34.950 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:34.967 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:34.967 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:35.679 INFO:teuthology.orchestra.run.smithi154.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-11-28T06:31:35.694 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/713 2023-11-28T06:31:35.694 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/713 2023-11-28T06:31:35.694 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:35.704 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:35.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:35.757 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-11-28T06:31:37.071 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:37.089 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:37.089 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:37.831 INFO:teuthology.orchestra.run.smithi154.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:37.844 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/714 2023-11-28T06:31:37.845 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/714 2023-11-28T06:31:37.845 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:37.855 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:37.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:37.894 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-11-28T06:31:39.080 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:39.097 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:39.097 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:39.855 INFO:teuthology.orchestra.run.smithi154.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-11-28T06:31:39.867 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/715 2023-11-28T06:31:39.867 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/715 2023-11-28T06:31:39.867 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:39.876 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:39.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:39.930 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-11-28T06:31:41.155 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:41.179 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:41.179 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:41.873 INFO:teuthology.orchestra.run.smithi154.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:41.886 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/716 2023-11-28T06:31:41.886 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/716 2023-11-28T06:31:41.886 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:41.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:41.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:41.945 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-11-28T06:31:43.169 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:43.196 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:43.196 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:44.011 INFO:teuthology.orchestra.run.smithi154.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:44.024 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/717 2023-11-28T06:31:44.024 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/717 2023-11-28T06:31:44.025 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:44.035 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:44.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:44.103 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-11-28T06:31:45.265 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:45.281 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:45.281 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:45.954 INFO:teuthology.orchestra.run.smithi154.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:45.969 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/718 2023-11-28T06:31:45.970 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/718 2023-11-28T06:31:45.970 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:45.979 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:46.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:46.032 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-11-28T06:31:47.114 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:47.134 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:47.134 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:47.873 INFO:teuthology.orchestra.run.smithi154.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:47.887 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/719 2023-11-28T06:31:47.888 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/719 2023-11-28T06:31:47.888 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:47.896 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:47.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:47.953 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-11-28T06:31:48.957 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:48.984 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:48.984 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:49.685 INFO:teuthology.orchestra.run.smithi154.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:49.698 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/720 2023-11-28T06:31:49.699 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/720 2023-11-28T06:31:49.699 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:49.710 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:49.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:49.747 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-11-28T06:31:50.892 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:50.912 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:50.912 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:51.565 INFO:teuthology.orchestra.run.smithi154.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-11-28T06:31:51.581 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/721 2023-11-28T06:31:51.581 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/721 2023-11-28T06:31:51.582 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:51.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:51.631 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-11-28T06:31:52.426 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:52.440 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:52.440 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:53.128 INFO:teuthology.orchestra.run.smithi154.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-28T06:31:53.141 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/722 2023-11-28T06:31:53.141 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/722 2023-11-28T06:31:53.142 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:53.158 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:53.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:53.191 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-11-28T06:31:54.286 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:54.317 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:54.317 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:55.046 INFO:teuthology.orchestra.run.smithi154.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-11-28T06:31:55.060 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/723 2023-11-28T06:31:55.065 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/723 2023-11-28T06:31:55.065 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:55.071 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:55.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:55.130 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-11-28T06:31:56.224 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:56.240 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:56.240 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:56.841 INFO:teuthology.orchestra.run.smithi154.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-28T06:31:56.854 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/724 2023-11-28T06:31:56.855 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/724 2023-11-28T06:31:56.855 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:56.865 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:56.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:56.898 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-11-28T06:31:58.077 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:31:58.104 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:31:58.104 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:58.827 INFO:teuthology.orchestra.run.smithi154.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-28T06:31:58.840 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/725 2023-11-28T06:31:58.841 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/725 2023-11-28T06:31:58.841 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:31:58.852 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:31:58.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:31:58.892 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-11-28T06:32:00.005 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:00.020 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:00.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:01.663 INFO:teuthology.orchestra.run.smithi154.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-28T06:32:01.676 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/726 2023-11-28T06:32:01.677 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/726 2023-11-28T06:32:01.686 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:01.697 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:01.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:01.751 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-11-28T06:32:02.855 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:02.889 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:02.889 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:03.641 INFO:teuthology.orchestra.run.smithi154.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-11-28T06:32:03.653 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/727 2023-11-28T06:32:03.653 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/727 2023-11-28T06:32:03.653 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:03.664 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:03.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:03.742 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-11-28T06:32:04.882 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:04.898 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:04.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:09.857 INFO:teuthology.orchestra.run.smithi154.stdout:generic/728 5s 2023-11-28T06:32:09.889 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/728 2023-11-28T06:32:09.889 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:09.899 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:09.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:09.946 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-11-28T06:32:10.805 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:10.821 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:10.821 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:12.187 INFO:teuthology.orchestra.run.smithi154.stdout:generic/729 2s 2023-11-28T06:32:12.213 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/729 2023-11-28T06:32:12.213 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:12.223 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:12.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:12.265 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-11-28T06:32:13.406 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:13.424 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:14.089 INFO:teuthology.orchestra.run.smithi154.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-11-28T06:32:14.104 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/730 2023-11-28T06:32:14.105 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/730 2023-11-28T06:32:14.105 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:14.116 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:14.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:14.147 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-11-28T06:32:14.955 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:14.977 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:14.977 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:15.501 INFO:teuthology.orchestra.run.smithi154.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-11-28T06:32:15.515 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/731 2023-11-28T06:32:15.515 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/731 2023-11-28T06:32:15.515 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:15.526 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:15.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:15.560 DEBUG:teuthology.orchestra.run.smithi154:> (cd /tmp/tmp.1EbDOAX7rXxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2023-11-28T06:32:16.398 INFO:teuthology.orchestra.run.smithi154.stdout:FSTYP -- ceph-fuse 2023-11-28T06:32:16.414 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM -- Linux/x86_64 smithi154 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-28T06:32:16.414 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:16.971 INFO:teuthology.orchestra.run.smithi154.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2023-11-28T06:32:16.984 INFO:teuthology.orchestra.run.smithi154.stdout:Ran: generic/732 2023-11-28T06:32:16.984 INFO:teuthology.orchestra.run.smithi154.stdout:Not run: generic/732 2023-11-28T06:32:16.984 INFO:teuthology.orchestra.run.smithi154.stdout:Passed all 1 tests 2023-11-28T06:32:16.994 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:17.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T06:32:17.034 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-11-28T06:32:17.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo userdel --force --remove fsgqa 2023-11-28T06:32:18.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo userdel --force --remove 123456-fsgqa 2023-11-28T06:32:20.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo groupdel fsgqa 2023-11-28T06:32:20.438 INFO:teuthology.orchestra.run.smithi154.stderr:groupdel: group 'fsgqa' does not exist 2023-11-28T06:32:20.445 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-11-28T06:32:20.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:20.446 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.1EbDOAX7rXxfstests-dev/results) 2023-11-28T06:32:20.510 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-11-28T06:32:20.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T06:32:20.511 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.1EbDOAX7rXxfstests-dev 2023-11-28T06:32:20.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf /tmp/tmp.1EbDOAX7rXxfstests-dev 2023-11-28T06:32:21.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T06:32:21.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T06:32:21.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T06:32:21.771 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T06:32:21.771 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-28T06:32:21.771 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:21.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15520 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248868k,nr_inodes=812217,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T06:32:21.864 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T06:32:21.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:21.865 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T06:32:21.947 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-28T06:32:21.947 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:21.973 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056385,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1730 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248872k,nr_inodes=812218,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T06:32:21.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T06:32:21.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:21.973 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T06:32:22.036 INFO:teuthology.orchestra.run.smithi194.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-28T06:32:22.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T06:32:22.037 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-28T06:32:22.037 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:22.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15520 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248868k,nr_inodes=812217,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T06:32:22.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T06:32:22.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:22.095 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T06:32:22.158 INFO:teuthology.orchestra.run.smithi154.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-28T06:32:22.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T06:32:22.160 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-28T06:32:22.160 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:22.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056385,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1730 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248872k,nr_inodes=812218,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T06:32:22.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T06:32:22.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:22.176 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T06:32:22.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T06:32:22.232 INFO:teuthology.orchestra.run.smithi194.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-28T06:32:22.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T06:32:23.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.104+0000 7f99c1ec3640 1 Processor -- start 2023-11-28T06:32:23.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.104+0000 7f99c1ec3640 1 -- start start 2023-11-28T06:32:23.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.108+0000 7f99c1ec3640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99bc0b1780 0x7f99bc0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:23.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.108+0000 7f99c1ec3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99bc1597f0 0x7f99bc156b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:23.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.108+0000 7f99c1ec3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b2170 con 0x7f99bc0cc950 2023-11-28T06:32:23.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.108+0000 7f99c1ec3640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc15a7f0 con 0x7f99bc0b1780 2023-11-28T06:32:23.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.108+0000 7f99c1ec3640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc15a230 con 0x7f99bc1597f0 2023-11-28T06:32:23.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.109+0000 7f99b3fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99bc1597f0 0x7f99bc156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:23.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.109+0000 7f99b3fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99bc1597f0 0x7f99bc156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:58054/0 (socket says 172.21.15.154:58054) 2023-11-28T06:32:23.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.109+0000 7f99b3fff640 1 -- 172.21.15.154:0/3370324807 learned_addr learned my addr 172.21.15.154:0/3370324807 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:23.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.110+0000 7f99c0ec1640 1 --2- 172.21.15.154:0/3370324807 >> v2:172.21.15.154:3300/0 conn(0x7f99bc0b1780 0x7f99bc0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:23.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.111+0000 7f99b3fff640 1 -- 172.21.15.154:0/3370324807 >> v2:172.21.15.154:3300/0 conn(0x7f99bc0b1780 msgr2=0x7f99bc0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:23.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.111+0000 7f99b3fff640 1 --2- 172.21.15.154:0/3370324807 >> v2:172.21.15.154:3300/0 conn(0x7f99bc0b1780 0x7f99bc0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:23.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.111+0000 7f99b3fff640 1 -- 172.21.15.154:0/3370324807 >> v1:172.21.15.154:6789/0 conn(0x7f99bc0cc950 legacy=0x7f99bc071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:23.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.112+0000 7f99b3fff640 1 -- 172.21.15.154:0/3370324807 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc15a510 con 0x7f99bc1597f0 2023-11-28T06:32:23.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.115+0000 7f99b3fff640 1 --2- 172.21.15.154:0/3370324807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc1597f0 0x7f99bc156b60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06ec80 tx=0x7f99ac02ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a99eb6e53f9b182 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:23.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.116+0000 7f99b37fe640 1 -- 172.21.15.154:0/3370324807 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac02f850 con 0x7f99bc1597f0 2023-11-28T06:32:23.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.117+0000 7f99b37fe640 1 -- 172.21.15.154:0/3370324807 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac02f9b0 con 0x7f99bc1597f0 2023-11-28T06:32:23.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.117+0000 7f99b37fe640 1 -- 172.21.15.154:0/3370324807 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac02fd40 con 0x7f99bc1597f0 2023-11-28T06:32:23.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.119+0000 7f99c1ec3640 1 -- 172.21.15.154:0/3370324807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc1597f0 msgr2=0x7f99bc156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:23.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.119+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/3370324807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc1597f0 0x7f99bc156b60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06ec80 tx=0x7f99ac02ba30 comp rx=0 tx=0).stop 2023-11-28T06:32:23.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.121+0000 7f99c1ec3640 1 -- 172.21.15.154:0/3370324807 shutdown_connections 2023-11-28T06:32:23.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.121+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/3370324807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc1597f0 0x7f99bc156b60 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:23.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.121+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/3370324807 >> v2:172.21.15.154:3300/0 conn(0x7f99bc0b1780 0x7f99bc0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:23.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.121+0000 7f99c1ec3640 1 -- 172.21.15.154:0/3370324807 >> 172.21.15.154:0/3370324807 conn(0x7f99bc0b0c60 msgr2=0x7f99bc0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.122+0000 7f99c1ec3640 1 -- 172.21.15.154:0/3370324807 shutdown_connections 2023-11-28T06:32:23.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.122+0000 7f99c1ec3640 1 -- 172.21.15.154:0/3370324807 wait complete. 2023-11-28T06:32:23.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.128+0000 7f99c1ec3640 1 Processor -- start 2023-11-28T06:32:23.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.128+0000 7f99c1ec3640 1 -- start start 2023-11-28T06:32:23.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.133+0000 7f99c1ec3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 0x7f99bc147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:23.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.133+0000 7f99c0ec1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 0x7f99bc147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:23.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.134+0000 7f99c0ec1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 0x7f99bc147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:58058/0 (socket says 172.21.15.154:58058) 2023-11-28T06:32:23.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.134+0000 7f99c0ec1640 1 -- 172.21.15.154:0/1444670007 learned_addr learned my addr 172.21.15.154:0/1444670007 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:23.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.134+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99bc0cc950 0x7f99bc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:23.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.134+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99bc1597f0 0x7f99bc06c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:23.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.134+0000 7f99b3fff640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99bc0cc950 0x7f99bc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.135+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc149b00 con 0x7f99bc1597f0 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.135+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1448a0 con 0x7f99bc0b1780 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.135+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1487c0 con 0x7f99bc0cc950 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.136+0000 7f99c0ec1640 1 -- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99bc0cc950 msgr2=0x7f99bc0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.136+0000 7f99c0ec1640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99bc0cc950 0x7f99bc0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.136+0000 7f99c0ec1640 1 -- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99bc1597f0 msgr2=0x7f99bc06c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.136+0000 7f99c0ec1640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99bc1597f0 0x7f99bc06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.136+0000 7f99c0ec1640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0094d0 con 0x7f99bc0b1780 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.136+0000 7f99c0ec1640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 0x7f99bc147f70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f99b800e9b0 tx=0x7f99b800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:23.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.137+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b800c9a0 con 0x7f99bc0b1780 2023-11-28T06:32:23.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.137+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b800cb00 con 0x7f99bc0b1780 2023-11-28T06:32:23.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.137+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc148aa0 con 0x7f99bc0b1780 2023-11-28T06:32:23.147 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.146+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc149060 con 0x7f99bc0b1780 2023-11-28T06:32:23.150 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.149+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8013470 con 0x7f99bc0b1780 2023-11-28T06:32:23.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.155+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f99b8005990 con 0x7f99bc0b1780 2023-11-28T06:32:23.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.157+0000 7f99b17fa640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f99a806b210 0x7f99a806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:23.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.158+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b8089570 con 0x7f99bc0b1780 2023-11-28T06:32:23.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.158+0000 7f99b3fff640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f99a806b210 0x7f99a806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:23.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.160+0000 7f99b3fff640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f99a806b210 0x7f99a806d6d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f99ac036000 tx=0x7f99ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:23.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.168+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc069320 con 0x7f99bc0b1780 2023-11-28T06:32:23.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:23.178+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f99b80543c0 con 0x7f99bc0b1780 2023-11-28T06:32:24.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.383+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99bc0b35e0 con 0x7f99bc0b1780 2023-11-28T06:32:24.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.384+0000 7f99b17fa640 1 -- 172.21.15.154:0/1444670007 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f99b8017030 con 0x7f99bc0b1780 2023-11-28T06:32:24.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:24.388 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:30:42.026663+0000","modified":"2023-11-27T22:30:44.025219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1494168994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1494168994},{"type":"v1","addr":"172.21.15.154:6837","nonce":1494168994}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T06:32:24.388 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 12 2023-11-28T06:32:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.393+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f99a806b210 msgr2=0x7f99a806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.393+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f99a806b210 0x7f99a806d6d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f99ac036000 tx=0x7f99ac008030 comp rx=0 tx=0).stop 2023-11-28T06:32:24.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.393+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 msgr2=0x7f99bc147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.393+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 0x7f99bc147f70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f99b800e9b0 tx=0x7f99b800ee70 comp rx=0 tx=0).stop 2023-11-28T06:32:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 shutdown_connections 2023-11-28T06:32:24.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f99a806b210 0x7f99a806d6d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99bc1597f0 0x7f99bc06c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99bc0cc950 0x7f99bc0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 --2- 172.21.15.154:0/1444670007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99bc0b1780 0x7f99bc147f70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 >> 172.21.15.154:0/1444670007 conn(0x7f99bc0b0c60 msgr2=0x7f99bc0b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 shutdown_connections 2023-11-28T06:32:24.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.394+0000 7f99c1ec3640 1 -- 172.21.15.154:0/1444670007 wait complete. 2023-11-28T06:32:24.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T06:32:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.860+0000 7efcbb20e640 1 Processor -- start 2023-11-28T06:32:24.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.860+0000 7efcbb20e640 1 -- start start 2023-11-28T06:32:24.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.864+0000 7efcbb20e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac0e7a20 0x7efcac049b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:24.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.864+0000 7efcbb20e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efcac04a070 0x7efcac054870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:24.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.864+0000 7efcbb20e640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0e7e00 con 0x7efcac054db0 2023-11-28T06:32:24.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.864+0000 7efcbb20e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac03b570 con 0x7efcac04a070 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.864+0000 7efcbb20e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac03b850 con 0x7efcac0e7a20 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.865+0000 7efcbaa0d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7efcac054db0 0x7efcac03c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:38734/0 (socket says 172.21.15.154:38734) 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.865+0000 7efcbaa0d640 1 -- 172.21.15.154:0/2118199396 learned_addr learned my addr 172.21.15.154:0/2118199396 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.865+0000 7efcba20c640 1 --2- 172.21.15.154:0/2118199396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac0e7a20 0x7efcac049b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.865+0000 7efcb9a0b640 1 --2- 172.21.15.154:0/2118199396 >> v2:172.21.15.154:3300/0 conn(0x7efcac04a070 0x7efcac054870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.865+0000 7efcb920a640 1 -- 172.21.15.154:0/2118199396 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538546287 0 0) 0x7efcac0e7e00 con 0x7efcac054db0 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.865+0000 7efcb920a640 1 -- 172.21.15.154:0/2118199396 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca0003520 con 0x7efcac054db0 2023-11-28T06:32:24.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.866+0000 7efcba20c640 1 -- 172.21.15.154:0/2118199396 >> v2:172.21.15.154:3300/0 conn(0x7efcac04a070 msgr2=0x7efcac054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:24.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.866+0000 7efcba20c640 1 --2- 172.21.15.154:0/2118199396 >> v2:172.21.15.154:3300/0 conn(0x7efcac04a070 0x7efcac054870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.866+0000 7efcba20c640 1 -- 172.21.15.154:0/2118199396 >> v1:172.21.15.194:6789/0 conn(0x7efcac054db0 legacy=0x7efcac03c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:24.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.866+0000 7efcba20c640 1 -- 172.21.15.154:0/2118199396 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac03bb30 con 0x7efcac0e7a20 2023-11-28T06:32:24.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.869+0000 7efcba20c640 1 --2- 172.21.15.154:0/2118199396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac0e7a20 0x7efcac049b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efcb00097d0 tx=0x7efcb002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27dd1e4cac6c93cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:24.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.869+0000 7efcb920a640 1 -- 172.21.15.154:0/2118199396 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0031800 con 0x7efcac0e7a20 2023-11-28T06:32:24.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.869+0000 7efcb920a640 1 -- 172.21.15.154:0/2118199396 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0031960 con 0x7efcac0e7a20 2023-11-28T06:32:24.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.869+0000 7efcb920a640 1 -- 172.21.15.154:0/2118199396 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0031cf0 con 0x7efcac0e7a20 2023-11-28T06:32:24.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.871+0000 7efcbb20e640 1 -- 172.21.15.154:0/2118199396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac0e7a20 msgr2=0x7efcac049b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:24.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.872+0000 7efcbb20e640 1 --2- 172.21.15.154:0/2118199396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac0e7a20 0x7efcac049b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efcb00097d0 tx=0x7efcb002b8a0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.873+0000 7efcbb20e640 1 -- 172.21.15.154:0/2118199396 shutdown_connections 2023-11-28T06:32:24.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.873+0000 7efcbb20e640 1 --2- 172.21.15.154:0/2118199396 >> v2:172.21.15.154:3300/0 conn(0x7efcac04a070 0x7efcac054870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.873+0000 7efcbb20e640 1 --2- 172.21.15.154:0/2118199396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac0e7a20 0x7efcac049b30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.873+0000 7efcbb20e640 1 -- 172.21.15.154:0/2118199396 >> 172.21.15.154:0/2118199396 conn(0x7efcac056ca0 msgr2=0x7efcac0570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:24.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.876+0000 7efcbb20e640 1 -- 172.21.15.154:0/2118199396 shutdown_connections 2023-11-28T06:32:24.878 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.876+0000 7efcbb20e640 1 -- 172.21.15.154:0/2118199396 wait complete. 2023-11-28T06:32:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.881+0000 7efcbb20e640 1 Processor -- start 2023-11-28T06:32:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.882+0000 7efcbb20e640 1 -- start start 2023-11-28T06:32:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.885+0000 7efcbb20e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcac04a070 0x7efcac0d6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.885+0000 7efcbb20e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac054db0 0x7efcac0e4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:24.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.885+0000 7efcbb20e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 0x7efcac0e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:24.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.885+0000 7efcb9a0b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac054db0 0x7efcac0e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:24.887 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.886+0000 7efcbaa0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 0x7efcac0e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.886+0000 7efcbaa0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 0x7efcac0e5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:48998/0 (socket says 172.21.15.154:48998) 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.886+0000 7efcb9a0b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac054db0 0x7efcac0e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:42328/0 (socket says 172.21.15.154:42328) 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.886+0000 7efcbaa0d640 1 -- 172.21.15.154:0/1644274085 learned_addr learned my addr 172.21.15.154:0/1644274085 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.886+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac04be30 con 0x7efcac0e7a20 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.887+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac04b820 con 0x7efcac04a070 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.887+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0e3ab0 con 0x7efcac054db0 2023-11-28T06:32:24.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.887+0000 7efcba20c640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcac04a070 0x7efcac0d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:24.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.888+0000 7efcbaa0d640 1 -- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac054db0 msgr2=0x7efcac0e4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.888+0000 7efcbaa0d640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac054db0 0x7efcac0e4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.888+0000 7efcbaa0d640 1 -- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcac04a070 msgr2=0x7efcac0d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.888+0000 7efcbaa0d640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcac04a070 0x7efcac0d6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:24.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.888+0000 7efcbaa0d640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009400 con 0x7efcac0e7a20 2023-11-28T06:32:24.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.890+0000 7efcbaa0d640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 0x7efcac0e5f40 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7efcb4063b00 tx=0x7efcb40678b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:24.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.890+0000 7efcba20c640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcac04a070 0x7efcac0d6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.891+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb406bad0 con 0x7efcac0e7a20 2023-11-28T06:32:24.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.891+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb406bc30 con 0x7efcac0e7a20 2023-11-28T06:32:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.892+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac0e3d90 con 0x7efcac0e7a20 2023-11-28T06:32:24.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.892+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcac0e4070 con 0x7efcac0e7a20 2023-11-28T06:32:24.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.896+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac04bfa0 con 0x7efcac0e7a20 2023-11-28T06:32:24.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.900+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb40721c0 con 0x7efcac0e7a20 2023-11-28T06:32:24.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.900+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7efcb40723e0 con 0x7efcac0e7a20 2023-11-28T06:32:24.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.901+0000 7efcaaffd640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc9806b340 0x7efc9806d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:24.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.902+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb4103540 con 0x7efcac0e7a20 2023-11-28T06:32:24.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.906+0000 7efcba20c640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc9806b340 0x7efc9806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:24.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.908+0000 7efcba20c640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc9806b340 0x7efc9806d800 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7efcb0036000 tx=0x7efcb0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:24.926 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:24.925+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7efcb40ce2e0 con 0x7efcac0e7a20 2023-11-28T06:32:25.924 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.922+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcac0057b0 con 0x7efcac0e7a20 2023-11-28T06:32:25.933 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.931+0000 7efcaaffd640 1 -- 172.21.15.154:0/1644274085 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16594 (secure 0 0 0) 0x7efcb40d1900 con 0x7efcac0e7a20 2023-11-28T06:32:25.937 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:25.937 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:43.689582+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:30:40.260897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T22:30:40.999879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T06:32:25.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.940+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc9806b340 msgr2=0x7efc9806d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:25.943 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.940+0000 7efcbb20e640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc9806b340 0x7efc9806d800 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7efcb0036000 tx=0x7efcb0008030 comp rx=0 tx=0).stop 2023-11-28T06:32:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.941+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 msgr2=0x7efcac0e5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.941+0000 7efcbb20e640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 0x7efcac0e5f40 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7efcb4063b00 tx=0x7efcb40678b0 comp rx=0 tx=0).stop 2023-11-28T06:32:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.942+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 shutdown_connections 2023-11-28T06:32:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.942+0000 7efcbb20e640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7efc9806b340 0x7efc9806d800 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.942+0000 7efcbb20e640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efcac0e7a20 0x7efcac0e5f40 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.942+0000 7efcbb20e640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efcac054db0 0x7efcac0e4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.942+0000 7efcbb20e640 1 --2- 172.21.15.154:0/1644274085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcac04a070 0x7efcac0d6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:25.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.942+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 >> 172.21.15.154:0/1644274085 conn(0x7efcac056ca0 msgr2=0x7efcac0088a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:25.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.943+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 shutdown_connections 2023-11-28T06:32:25.946 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:25.943+0000 7efcbb20e640 1 -- 172.21.15.154:0/1644274085 wait complete. 2023-11-28T06:32:25.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T22:29:27.002801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T22:30:40.260897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T22:30:40.999879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T06:32:25.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T06:32:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.468+0000 7f92be265640 1 Processor -- start 2023-11-28T06:32:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.468+0000 7f92be265640 1 -- start start 2023-11-28T06:32:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.473+0000 7f92b7fff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f92b806e480 0x7f92b80b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:38744/0 (socket says 172.21.15.154:38744) 2023-11-28T06:32:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.473+0000 7f92b7fff640 1 -- 172.21.15.154:0/2771525896 learned_addr learned my addr 172.21.15.154:0/2771525896 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.473+0000 7f92be265640 1 --2- 172.21.15.154:0/2771525896 >> v2:172.21.15.154:3300/0 conn(0x7f92b80b4a40 0x7f92b80ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.474+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b815d560 con 0x7f92b80ceb40 2023-11-28T06:32:26.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.474+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b815d840 con 0x7f92b806e480 2023-11-28T06:32:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.474+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b815de90 con 0x7f92b80b4a40 2023-11-28T06:32:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453725150 0 0) 0x7f92b815d840 con 0x7f92b806e480 2023-11-28T06:32:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a4003520 con 0x7f92b806e480 2023-11-28T06:32:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925911435 0 0) 0x7f92a4003520 con 0x7f92b806e480 2023-11-28T06:32:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 >> v2:172.21.15.154:3300/0 conn(0x7f92b80b4a40 msgr2=0x7f92b80ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 --2- 172.21.15.154:0/2771525896 >> v2:172.21.15.154:3300/0 conn(0x7f92b80b4a40 0x7f92b80ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 >> v1:172.21.15.154:6789/0 conn(0x7f92b80ceb40 legacy=0x7f92b80b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.475+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b815db20 con 0x7f92b806e480 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2244599797 0 0) 0x7f92a80019f0 con 0x7f92b806e480 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 >> v1:172.21.15.194:6789/0 conn(0x7f92b806e480 legacy=0x7f92b80b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a4003970 0x7f92a4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.480 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a4005280 0x7f92a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815de90 con 0x7f92a4005280 2023-11-28T06:32:26.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a400c1b0 con 0x7f92a40047c0 2023-11-28T06:32:26.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.476+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a400c370 con 0x7f92a4003970 2023-11-28T06:32:26.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.477+0000 7f92b77fe640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:26.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.477+0000 7f92b7fff640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a4003970 0x7f92a4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.477+0000 7f92bc802640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a4005280 0x7f92a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.477+0000 7f92b77fe640 1 -- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a4003970 msgr2=0x7f92a4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.477+0000 7f92b77fe640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a4003970 0x7f92a4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.477+0000 7f92b77fe640 1 -- 172.21.15.154:0/2771525896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a4005280 msgr2=0x7f92a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.478+0000 7f92b77fe640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a4005280 0x7f92a400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.478+0000 7f92b77fe640 1 -- 172.21.15.154:0/2771525896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b815d560 con 0x7f92a40047c0 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.478+0000 7f92bc802640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a4005280 0x7f92a400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:26.483 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.479+0000 7f92bc802640 1 -- 172.21.15.154:0/2771525896 reap_dead start 2023-11-28T06:32:26.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.481+0000 7f92b77fe640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92a4004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009860 tx=0x7f92a40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e710c78c610fddc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:26.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.482+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0033650 con 0x7f92a40047c0 2023-11-28T06:32:26.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.482+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00337d0 con 0x7f92a40047c0 2023-11-28T06:32:26.484 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.482+0000 7f92b6ffd640 1 -- 172.21.15.154:0/2771525896 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0033bc0 con 0x7f92a40047c0 2023-11-28T06:32:26.487 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.484+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 msgr2=0x7f92a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:26.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.484+0000 7f92be265640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92a4004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009860 tx=0x7f92a40057f0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.486+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 shutdown_connections 2023-11-28T06:32:26.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.486+0000 7f92be265640 1 --2- 172.21.15.154:0/2771525896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92a4004c40 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.486+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 >> 172.21.15.154:0/2771525896 conn(0x7f92b806a4d0 msgr2=0x7f92b806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:26.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.494+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 shutdown_connections 2023-11-28T06:32:26.496 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.494+0000 7f92be265640 1 -- 172.21.15.154:0/2771525896 wait complete. 2023-11-28T06:32:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.500+0000 7f92be265640 1 Processor -- start 2023-11-28T06:32:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.501+0000 7f92be265640 1 -- start start 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.504+0000 7f92be265640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92b814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.505+0000 7f92b7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92b814bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.505+0000 7f92b7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92b814bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:58098/0 (socket says 172.21.15.154:58098) 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.505+0000 7f92be265640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92b80c8a20 0x7f92b814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.508+0000 7f92b77fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92b80c8a20 0x7f92b814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.509+0000 7f92b77fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92b80c8a20 0x7f92b814b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:42360/0 (socket says 172.21.15.154:42360) 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.509+0000 7f92b7fff640 1 -- 172.21.15.154:0/3933338773 learned_addr learned my addr 172.21.15.154:0/3933338773 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.509+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80c8ea0 0x7f92b814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.509+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b814c510 con 0x7f92b80c8ea0 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.509+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b814bd20 con 0x7f92a40047c0 2023-11-28T06:32:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.509+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80c59b0 con 0x7f92b80c8a20 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.510+0000 7f92b7fff640 1 -- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92b80c8a20 msgr2=0x7f92b814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.510+0000 7f92b7fff640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92b80c8a20 0x7f92b814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.510+0000 7f92b7fff640 1 -- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80c8ea0 msgr2=0x7f92b814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.510+0000 7f92b7fff640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80c8ea0 0x7f92b814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.510+0000 7f92b7fff640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8152a30 con 0x7f92a40047c0 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.511+0000 7f92b7fff640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92b814bfd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007ac0 tx=0x7f92a800e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.512+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800eea0 con 0x7f92a40047c0 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.512+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8035430 con 0x7f92a40047c0 2023-11-28T06:32:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.512+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80357e0 con 0x7f92a40047c0 2023-11-28T06:32:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.512+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b8152d10 con 0x7f92a40047c0 2023-11-28T06:32:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.512+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b80c4c80 con 0x7f92a40047c0 2023-11-28T06:32:26.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.519+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f92a8035940 con 0x7f92a40047c0 2023-11-28T06:32:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.520+0000 7f92b4ff9640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f929806b290 0x7f929806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.521+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92a80ac2f0 con 0x7f92a40047c0 2023-11-28T06:32:26.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.522+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c005250 con 0x7f92a40047c0 2023-11-28T06:32:26.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.522+0000 7f92b77fe640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f929806b290 0x7f929806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:26.526 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.524+0000 7f92b77fe640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f929806b290 0x7f929806d750 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f92a003a000 tx=0x7f92a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:26.531 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:26.529+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f92a8077000 con 0x7f92a40047c0 2023-11-28T06:32:27.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.510+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f929c005a80 con 0x7f92a40047c0 2023-11-28T06:32:27.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.511+0000 7f92b4ff9640 1 -- 172.21.15.154:0/3933338773 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92a807a620 con 0x7f92a40047c0 2023-11-28T06:32:27.515 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 1 2023-11-28T06:32:27.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f929806b290 msgr2=0x7f929806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f929806b290 0x7f929806d750 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f92a003a000 tx=0x7f92a0008030 comp rx=0 tx=0).stop 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 msgr2=0x7f92b814bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92b814bfd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f92a8007ac0 tx=0x7f92a800e530 comp rx=0 tx=0).stop 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 shutdown_connections 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f929806b290 0x7f929806d750 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92b80c8ea0 0x7f92b814b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92b80c8a20 0x7f92b814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 --2- 172.21.15.154:0/3933338773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40047c0 0x7f92b814bfd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:27.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.520+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 >> 172.21.15.154:0/3933338773 conn(0x7f92b806a4d0 msgr2=0x7f92b80cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:27.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.521+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 shutdown_connections 2023-11-28T06:32:27.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:27.521+0000 7f92be265640 1 -- 172.21.15.154:0/3933338773 wait complete. 2023-11-28T06:32:27.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T06:32:28.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.030+0000 7fcee3e4f640 1 Processor -- start 2023-11-28T06:32:28.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.031+0000 7fcee3e4f640 1 -- start start 2023-11-28T06:32:28.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.034+0000 7fcee3e4f640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcedc0b4b60 0x7fcedc160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:28.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.035+0000 7fcee3e4f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcedc071550 0x7fcedc0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:28.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.035+0000 7fcee3e4f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc0b3520 con 0x7fcedc06a4d0 2023-11-28T06:32:28.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.035+0000 7fcee3e4f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0b3220 con 0x7fcedc071550 2023-11-28T06:32:28.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.035+0000 7fcee3e4f640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc161810 con 0x7fcedc0b4b60 2023-11-28T06:32:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.036+0000 7fcee13ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcedc071550 0x7fcedc0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.036+0000 7fcee13ea640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcedc071550 0x7fcedc0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49044/0 (socket says 172.21.15.154:49044) 2023-11-28T06:32:28.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.036+0000 7fcee13ea640 1 -- 172.21.15.154:0/1976937939 learned_addr learned my addr 172.21.15.154:0/1976937939 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:28.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.038+0000 7fcee13ea640 1 -- 172.21.15.154:0/1976937939 >> v2:172.21.15.194:3300/0 conn(0x7fcedc0b4b60 msgr2=0x7fcedc160fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:28.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.038+0000 7fcee13ea640 1 --2- 172.21.15.154:0/1976937939 >> v2:172.21.15.194:3300/0 conn(0x7fcedc0b4b60 0x7fcedc160fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:28.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.038+0000 7fcee13ea640 1 -- 172.21.15.154:0/1976937939 >> v1:172.21.15.194:6789/0 conn(0x7fcedc06a4d0 legacy=0x7fcedc15d980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:28.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.038+0000 7fcee13ea640 1 -- 172.21.15.154:0/1976937939 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc161af0 con 0x7fcedc071550 2023-11-28T06:32:28.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.042+0000 7fcee13ea640 1 --2- 172.21.15.154:0/1976937939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc071550 0x7fcedc0b39b0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009ad0 tx=0x7fcecc02bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890754585c4a032f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:28.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.045+0000 7fcee0be9640 1 -- 172.21.15.154:0/1976937939 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc02c730 con 0x7fcedc071550 2023-11-28T06:32:28.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.045+0000 7fcee0be9640 1 -- 172.21.15.154:0/1976937939 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc02c890 con 0x7fcedc071550 2023-11-28T06:32:28.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.045+0000 7fcee0be9640 1 -- 172.21.15.154:0/1976937939 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc02cc20 con 0x7fcedc071550 2023-11-28T06:32:28.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.056+0000 7fcee3e4f640 1 -- 172.21.15.154:0/1976937939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc071550 msgr2=0x7fcedc0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:28.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.056+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/1976937939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc071550 0x7fcedc0b39b0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009ad0 tx=0x7fcecc02bb90 comp rx=0 tx=0).stop 2023-11-28T06:32:28.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.059+0000 7fcee3e4f640 1 -- 172.21.15.154:0/1976937939 shutdown_connections 2023-11-28T06:32:28.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.059+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/1976937939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc071550 0x7fcedc0b39b0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:28.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.059+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/1976937939 >> v2:172.21.15.194:3300/0 conn(0x7fcedc0b4b60 0x7fcedc160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:28.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.059+0000 7fcee3e4f640 1 -- 172.21.15.154:0/1976937939 >> 172.21.15.154:0/1976937939 conn(0x7fcedc066270 msgr2=0x7fcedc066650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:28.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.060+0000 7fcee3e4f640 1 -- 172.21.15.154:0/1976937939 shutdown_connections 2023-11-28T06:32:28.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.060+0000 7fcee3e4f640 1 -- 172.21.15.154:0/1976937939 wait complete. 2023-11-28T06:32:28.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.064+0000 7fcee3e4f640 1 Processor -- start 2023-11-28T06:32:28.068 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.066+0000 7fcee3e4f640 1 -- start start 2023-11-28T06:32:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee3e4f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc06a4d0 0x7fcedc1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee3e4f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 0x7fcedc1e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee3e4f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc0b4b60 0x7fcedc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee3e4f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1e91b0 con 0x7fcedc06a4d0 2023-11-28T06:32:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee3e4f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1e8370 con 0x7fcedc071550 2023-11-28T06:32:28.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee3e4f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1e85a0 con 0x7fcedc0b4b60 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee13ea640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 0x7fcedc1e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee13ea640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 0x7fcedc1e7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:58108/0 (socket says 172.21.15.154:58108) 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee13ea640 1 -- 172.21.15.154:0/3868963930 learned_addr learned my addr 172.21.15.154:0/3868963930 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.071+0000 7fcee1beb640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc06a4d0 0x7fcedc1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.072+0000 7fcee13ea640 1 -- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc0b4b60 msgr2=0x7fcedc15a9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.072+0000 7fcee13ea640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc0b4b60 0x7fcedc15a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.072+0000 7fcee13ea640 1 -- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc06a4d0 msgr2=0x7fcedc1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.072+0000 7fcee13ea640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc06a4d0 0x7fcedc1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:28.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.072+0000 7fcee13ea640 1 -- 172.21.15.154:0/3868963930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0094d0 con 0x7fcedc071550 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.073+0000 7fcee13ea640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 0x7fcedc1e7e30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0090b0 tx=0x7fcecc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.074+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc003810 con 0x7fcedc071550 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.074+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc003990 con 0x7fcedc071550 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.074+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc1e8880 con 0x7fcedc071550 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.074+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc003d40 con 0x7fcedc071550 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.074+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc1e8e40 con 0x7fcedc071550 2023-11-28T06:32:28.080 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.078+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc1e9360 con 0x7fcedc071550 2023-11-28T06:32:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.082+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcecc040450 con 0x7fcedc071550 2023-11-28T06:32:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.083+0000 7fced27fc640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcec006b210 0x7fcec006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:28.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.084+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcecc0ac0f0 con 0x7fcedc071550 2023-11-28T06:32:28.089 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.086+0000 7fcee1beb640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcec006b210 0x7fcec006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:28.090 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.088+0000 7fcee1beb640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcec006b210 0x7fcec006d6d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fced8009930 tx=0x7fced8009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:28.092 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:28.090+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcedc1e9360 con 0x7fcedc071550 2023-11-28T06:32:29.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.157+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcedc067420 con 0x7fcedc071550 2023-11-28T06:32:29.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.161+0000 7fced27fc640 1 -- 172.21.15.154:0/3868963930 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcedc1e9360 con 0x7fcedc071550 2023-11-28T06:32:29.169 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 32 2023-11-28T06:32:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.168+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcec006b210 msgr2=0x7fcec006d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.168+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcec006b210 0x7fcec006d6d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fced8009930 tx=0x7fced8009060 comp rx=0 tx=0).stop 2023-11-28T06:32:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 msgr2=0x7fcedc1e7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 0x7fcedc1e7e30 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0090b0 tx=0x7fcecc0046c0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 shutdown_connections 2023-11-28T06:32:29.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcedc071550 0x7fcedc1e7e30 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcec006b210 0x7fcec006d6d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcedc0b4b60 0x7fcedc15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 --2- 172.21.15.154:0/3868963930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcedc06a4d0 0x7fcedc1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 >> 172.21.15.154:0/3868963930 conn(0x7fcedc066270 msgr2=0x7fcedc15d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 shutdown_connections 2023-11-28T06:32:29.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.169+0000 7fcee3e4f640 1 -- 172.21.15.154:0/3868963930 wait complete. 2023-11-28T06:32:29.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T06:32:29.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.688+0000 7f2044ba8640 1 Processor -- start 2023-11-28T06:32:29.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.688+0000 7f2044ba8640 1 -- start start 2023-11-28T06:32:29.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.693+0000 7f2044ba8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.693+0000 7f2044ba8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20400b47c0 0x7f20400b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.693+0000 7f2044ba8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2040159750 con 0x7f204015a2f0 2023-11-28T06:32:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.693+0000 7f2044ba8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400cd020 con 0x7f20400b47c0 2023-11-28T06:32:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.693+0000 7f2044ba8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400cd300 con 0x7f20400b1880 2023-11-28T06:32:29.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.694+0000 7f203ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20400b47c0 0x7f20400b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.694+0000 7f203ed9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f20400b47c0 0x7f20400b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38180/0 (socket says 172.21.15.154:38180) 2023-11-28T06:32:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.694+0000 7f203ed9d640 1 -- 172.21.15.154:0/2145973989 learned_addr learned my addr 172.21.15.154:0/2145973989 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.695+0000 7f203ed9d640 1 -- 172.21.15.154:0/2145973989 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 msgr2=0x7f2040159210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:29.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.695+0000 7f203ed9d640 1 --2- 172.21.15.154:0/2145973989 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040159210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.695+0000 7f203ed9d640 1 -- 172.21.15.154:0/2145973989 >> v1:172.21.15.154:6789/0 conn(0x7f204015a2f0 legacy=0x7f20400b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:29.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.695+0000 7f203ed9d640 1 -- 172.21.15.154:0/2145973989 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400cd5e0 con 0x7f20400b47c0 2023-11-28T06:32:29.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.699+0000 7f203ed9d640 1 --2- 172.21.15.154:0/2145973989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b47c0 0x7f20400b2490 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f2038009e50 tx=0x7f203802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e54078f84296136 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.700+0000 7f203d59a640 1 -- 172.21.15.154:0/2145973989 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203802caa0 con 0x7f20400b47c0 2023-11-28T06:32:29.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.700+0000 7f203d59a640 1 -- 172.21.15.154:0/2145973989 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203802cc00 con 0x7f20400b47c0 2023-11-28T06:32:29.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.701+0000 7f203d59a640 1 -- 172.21.15.154:0/2145973989 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20380343f0 con 0x7f20400b47c0 2023-11-28T06:32:29.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.702+0000 7f2044ba8640 1 -- 172.21.15.154:0/2145973989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b47c0 msgr2=0x7f20400b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:29.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.702+0000 7f2044ba8640 1 --2- 172.21.15.154:0/2145973989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b47c0 0x7f20400b2490 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f2038009e50 tx=0x7f203802bf00 comp rx=0 tx=0).stop 2023-11-28T06:32:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.703+0000 7f2044ba8640 1 -- 172.21.15.154:0/2145973989 shutdown_connections 2023-11-28T06:32:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.703+0000 7f2044ba8640 1 --2- 172.21.15.154:0/2145973989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f20400b47c0 0x7f20400b2490 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.703+0000 7f2044ba8640 1 --2- 172.21.15.154:0/2145973989 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.703+0000 7f2044ba8640 1 -- 172.21.15.154:0/2145973989 >> 172.21.15.154:0/2145973989 conn(0x7f20400b0d60 msgr2=0x7f20400b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:29.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.704+0000 7f2044ba8640 1 -- 172.21.15.154:0/2145973989 shutdown_connections 2023-11-28T06:32:29.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.704+0000 7f2044ba8640 1 -- 172.21.15.154:0/2145973989 wait complete. 2023-11-28T06:32:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.709+0000 7f2044ba8640 1 Processor -- start 2023-11-28T06:32:29.711 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.710+0000 7f2044ba8640 1 -- start start 2023-11-28T06:32:29.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.713+0000 7f2044ba8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.713+0000 7f203e59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:29.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.713+0000 7f203e59c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:58076/0 (socket says 172.21.15.154:58076) 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.713+0000 7f203e59c640 1 -- 172.21.15.154:0/99698776 learned_addr learned my addr 172.21.15.154:0/99698776 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.714+0000 7f2044ba8640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20400b47c0 0x7f20400af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.714+0000 7f203dd9b640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20400b47c0 0x7f20400af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.714+0000 7f2044ba8640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f204015a2f0 0x7f2040153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.714+0000 7f2044ba8640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2040153cd0 con 0x7f204015a2f0 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.714+0000 7f2044ba8640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2040153fb0 con 0x7f20400b47c0 2023-11-28T06:32:29.717 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.714+0000 7f2044ba8640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2040154290 con 0x7f20400b1880 2023-11-28T06:32:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.715+0000 7f203dd9b640 1 -- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 msgr2=0x7f2040154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.715+0000 7f203dd9b640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.715+0000 7f203dd9b640 1 -- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f204015a2f0 msgr2=0x7f2040153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.716+0000 7f203ed9d640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f204015a2f0 0x7f2040153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.716+0000 7f203dd9b640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f204015a2f0 0x7f2040153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:29.719 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.716+0000 7f203dd9b640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009b30 con 0x7f20400b47c0 2023-11-28T06:32:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.716+0000 7f203ed9d640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f204015a2f0 0x7f2040153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:29.720 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.717+0000 7f203dd9b640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20400b47c0 0x7f20400af400 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f203000b3e0 tx=0x7f203000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.720+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030004020 con 0x7f20400b47c0 2023-11-28T06:32:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.720+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030004180 con 0x7f20400b47c0 2023-11-28T06:32:29.724 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.720+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030011630 con 0x7f20400b47c0 2023-11-28T06:32:29.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.724+0000 7f2044ba8640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2040154570 con 0x7f20400b47c0 2023-11-28T06:32:29.729 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.725+0000 7f2044ba8640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20400a8690 con 0x7f20400b47c0 2023-11-28T06:32:29.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.732+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f2030011790 con 0x7f20400b47c0 2023-11-28T06:32:29.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.733+0000 7f202effd640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f202006b2c0 0x7f202006d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:29.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.734+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2030089560 con 0x7f20400b47c0 2023-11-28T06:32:29.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.734+0000 7f203e59c640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f202006b2c0 0x7f202006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:29.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.735+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2040069400 con 0x7f20400b47c0 2023-11-28T06:32:29.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.738+0000 7f203e59c640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f202006b2c0 0x7f202006d780 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f20400ceed0 tx=0x7f2034009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:29.743 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:29.741+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f2030054300 con 0x7f20400b47c0 2023-11-28T06:32:30.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.726+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20400b0b40 con 0x7f20400b47c0 2023-11-28T06:32:30.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.728+0000 7f202effd640 1 -- 172.21.15.154:0/99698776 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2030015020 con 0x7f20400b47c0 2023-11-28T06:32:30.731 INFO:teuthology.orchestra.run.smithi154.stdout:pg_num: 64 2023-11-28T06:32:30.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.735+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f202006b2c0 msgr2=0x7f202006d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:30.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.735+0000 7f202cff9640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f202006b2c0 0x7f202006d780 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f20400ceed0 tx=0x7f2034009190 comp rx=0 tx=0).stop 2023-11-28T06:32:30.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.735+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20400b47c0 msgr2=0x7f20400af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:30.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.735+0000 7f202cff9640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20400b47c0 0x7f20400af400 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f203000b3e0 tx=0x7f203000b8a0 comp rx=0 tx=0).stop 2023-11-28T06:32:30.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.736+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 shutdown_connections 2023-11-28T06:32:30.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.736+0000 7f202cff9640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20400b47c0 0x7f20400af400 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:30.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.736+0000 7f202cff9640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f202006b2c0 0x7f202006d780 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:30.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.736+0000 7f202cff9640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f204015a2f0 0x7f2040153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:30.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.736+0000 7f202cff9640 1 --2- 172.21.15.154:0/99698776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20400b1880 0x7f2040154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:30.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.736+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 >> 172.21.15.154:0/99698776 conn(0x7f20400b0d60 msgr2=0x7f204006e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:30.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.737+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 shutdown_connections 2023-11-28T06:32:30.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:30.737+0000 7f202cff9640 1 -- 172.21.15.154:0/99698776 wait complete. 2023-11-28T06:32:30.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T06:32:31.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.223+0000 7fac09843640 1 Processor -- start 2023-11-28T06:32:31.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.223+0000 7fac09843640 1 -- start start 2023-11-28T06:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.227+0000 7fac09843640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac04157cc0 0x7fac040b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.227+0000 7fac09843640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac040b34b0 0x7fac04071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.227+0000 7fac09843640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac040ceed0 con 0x7fac040718c0 2023-11-28T06:32:31.229 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.227+0000 7fac09843640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac04071d00 con 0x7fac04157cc0 2023-11-28T06:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.227+0000 7fac09843640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0406e590 con 0x7fac040b34b0 2023-11-28T06:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.228+0000 7fac037fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fac040718c0 0x7fac040cf360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36384/0 (socket says 172.21.15.154:36384) 2023-11-28T06:32:31.230 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.228+0000 7fac037fe640 1 -- 172.21.15.154:0/3546684428 learned_addr learned my addr 172.21.15.154:0/3546684428 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.229+0000 7fac027fc640 1 --2- 172.21.15.154:0/3546684428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac040b34b0 0x7fac04071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:31.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.229+0000 7fac02ffd640 1 --2- 172.21.15.154:0/3546684428 >> v2:172.21.15.154:3300/0 conn(0x7fac04157cc0 0x7fac040b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:31.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.230+0000 7fac027fc640 1 -- 172.21.15.154:0/3546684428 >> v2:172.21.15.154:3300/0 conn(0x7fac04157cc0 msgr2=0x7fac040b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.230+0000 7fac027fc640 1 --2- 172.21.15.154:0/3546684428 >> v2:172.21.15.154:3300/0 conn(0x7fac04157cc0 0x7fac040b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.230+0000 7fac027fc640 1 -- 172.21.15.154:0/3546684428 >> v1:172.21.15.154:6789/0 conn(0x7fac040718c0 legacy=0x7fac040cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.230+0000 7fac027fc640 1 -- 172.21.15.154:0/3546684428 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0406e2b0 con 0x7fac040b34b0 2023-11-28T06:32:31.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.233+0000 7fac027fc640 1 --2- 172.21.15.154:0/3546684428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac040b34b0 0x7fac04071380 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097a0 tx=0x7fabf802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53ed2d50a0fbe44 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.235+0000 7fac01ffb640 1 -- 172.21.15.154:0/3546684428 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8030710 con 0x7fac040b34b0 2023-11-28T06:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.235+0000 7fac01ffb640 1 -- 172.21.15.154:0/3546684428 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf802e050 con 0x7fac040b34b0 2023-11-28T06:32:31.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.235+0000 7fac01ffb640 1 -- 172.21.15.154:0/3546684428 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8030a90 con 0x7fac040b34b0 2023-11-28T06:32:31.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.237+0000 7fac09843640 1 -- 172.21.15.154:0/3546684428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac040b34b0 msgr2=0x7fac04071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:31.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.237+0000 7fac09843640 1 --2- 172.21.15.154:0/3546684428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac040b34b0 0x7fac04071380 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097a0 tx=0x7fabf802b710 comp rx=0 tx=0).stop 2023-11-28T06:32:31.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.240+0000 7fac09843640 1 -- 172.21.15.154:0/3546684428 shutdown_connections 2023-11-28T06:32:31.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.240+0000 7fac09843640 1 --2- 172.21.15.154:0/3546684428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac040b34b0 0x7fac04071380 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:31.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.240+0000 7fac09843640 1 --2- 172.21.15.154:0/3546684428 >> v2:172.21.15.154:3300/0 conn(0x7fac04157cc0 0x7fac040b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:31.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.240+0000 7fac09843640 1 -- 172.21.15.154:0/3546684428 >> 172.21.15.154:0/3546684428 conn(0x7fac0406b5e0 msgr2=0x7fac0406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:31.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.242+0000 7fac09843640 1 -- 172.21.15.154:0/3546684428 shutdown_connections 2023-11-28T06:32:31.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.244+0000 7fac09843640 1 -- 172.21.15.154:0/3546684428 wait complete. 2023-11-28T06:32:31.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.250+0000 7fac09843640 1 Processor -- start 2023-11-28T06:32:31.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.251+0000 7fac09843640 1 -- start start 2023-11-28T06:32:31.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.254+0000 7fac09843640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 0x7fac04156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:31.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.255+0000 7fac09843640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac040b34b0 0x7fac04139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:31.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.255+0000 7fac02ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 0x7fac04156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:31.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.255+0000 7fac02ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 0x7fac04156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:59634/0 (socket says 172.21.15.154:59634) 2023-11-28T06:32:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.256+0000 7fac02ffd640 1 -- 172.21.15.154:0/3551529659 learned_addr learned my addr 172.21.15.154:0/3551529659 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.256+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac04157cc0 0x7fac0415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:31.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.256+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0415ba50 con 0x7fac040b34b0 2023-11-28T06:32:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.256+0000 7fac037fe640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac04157cc0 0x7fac0415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.257+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0415bd30 con 0x7fac040718c0 2023-11-28T06:32:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.257+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0415c010 con 0x7fac04157cc0 2023-11-28T06:32:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.257+0000 7fac027fc640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac040b34b0 0x7fac04139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.259+0000 7fac02ffd640 1 -- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac04157cc0 msgr2=0x7fac0415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.259+0000 7fac02ffd640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac04157cc0 0x7fac0415caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.259+0000 7fac02ffd640 1 -- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac040b34b0 msgr2=0x7fac04139610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.259+0000 7fac02ffd640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac040b34b0 0x7fac04139610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.259+0000 7fac02ffd640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8009400 con 0x7fac040718c0 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.261+0000 7fac02ffd640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 0x7fac04156a10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e9b0 tx=0x7fabf400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.261+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400c9a0 con 0x7fac040718c0 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.261+0000 7fac027fc640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac040b34b0 0x7fac04139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.262+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0415c2f0 con 0x7fac040718c0 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.262+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0414a420 con 0x7fac040718c0 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.262+0000 7fac037fe640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac04157cc0 0x7fac0415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.262+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400cb00 con 0x7fac040718c0 2023-11-28T06:32:31.269 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.263+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4013470 con 0x7fac040718c0 2023-11-28T06:32:31.272 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.269+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fabf40135d0 con 0x7fac040718c0 2023-11-28T06:32:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.271+0000 7fabebfff640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fabf006b1c0 0x7fabf006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.271+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabf4089d10 con 0x7fac040718c0 2023-11-28T06:32:31.273 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.272+0000 7fac027fc640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fabf006b1c0 0x7fabf006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:31.275 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.274+0000 7fac027fc640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fabf006b1c0 0x7fabf006d680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fabf8034000 tx=0x7fabf8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:31.279 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.277+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe4005250 con 0x7fac040718c0 2023-11-28T06:32:31.286 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:31.284+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fabf40549a0 con 0x7fac040718c0 2023-11-28T06:32:32.502 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.500+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabe4005a80 con 0x7fac040718c0 2023-11-28T06:32:32.503 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.501+0000 7fabebfff640 1 -- 172.21.15.154:0/3551529659 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fabf4021070 con 0x7fac040718c0 2023-11-28T06:32:32.504 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:32.504 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:30:42.026663+0000","modified":"2023-11-27T22:30:44.025219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1494168994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1494168994},{"type":"v1","addr":"172.21.15.154:6837","nonce":1494168994}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T06:32:32.504 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 12 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.509+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fabf006b1c0 msgr2=0x7fabf006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.509+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fabf006b1c0 0x7fabf006d680 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fabf8034000 tx=0x7fabf8008030 comp rx=0 tx=0).stop 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.509+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 msgr2=0x7fac04156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.509+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 0x7fac04156a10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e9b0 tx=0x7fabf400ee70 comp rx=0 tx=0).stop 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.510+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 shutdown_connections 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.510+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fabf006b1c0 0x7fabf006d680 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:32.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.510+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac04157cc0 0x7fac0415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.510+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac040b34b0 0x7fac04139610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.510+0000 7fac09843640 1 --2- 172.21.15.154:0/3551529659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac040718c0 0x7fac04156a10 secure :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e9b0 tx=0x7fabf400ee70 comp rx=0 tx=0).stop 2023-11-28T06:32:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.510+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 >> 172.21.15.154:0/3551529659 conn(0x7fac0406b5e0 msgr2=0x7fac0406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:32.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.513+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 shutdown_connections 2023-11-28T06:32:32.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:32.513+0000 7fac09843640 1 -- 172.21.15.154:0/3551529659 wait complete. 2023-11-28T06:32:32.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T06:32:33.020 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.018+0000 7f684759e640 1 Processor -- start 2023-11-28T06:32:33.022 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.019+0000 7f684759e640 1 -- start start 2023-11-28T06:32:33.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.023+0000 7f684759e640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6848156dd0 0x7f68480b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:33.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.023+0000 7f684759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 0x7f68480716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:33.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f683dd9b640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f68481597f0 0x7f68480cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36390/0 (socket says 172.21.15.154:36390) 2023-11-28T06:32:33.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f684759e640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480b2170 con 0x7f68481597f0 2023-11-28T06:32:33.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f684759e640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684815a7f0 con 0x7f6848156dd0 2023-11-28T06:32:33.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f684759e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6848071c10 con 0x7f6848071260 2023-11-28T06:32:33.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f6846d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 0x7f68480716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:33.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f6846d9d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 0x7f68480716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:58102/0 (socket says 172.21.15.154:58102) 2023-11-28T06:32:33.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.024+0000 7f6846d9d640 1 -- 172.21.15.154:0/3820566400 learned_addr learned my addr 172.21.15.154:0/3820566400 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:33.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.025+0000 7f6846d9d640 1 -- 172.21.15.154:0/3820566400 >> v2:172.21.15.154:3300/0 conn(0x7f6848156dd0 msgr2=0x7f68480b3f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:33.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.025+0000 7f6846d9d640 1 --2- 172.21.15.154:0/3820566400 >> v2:172.21.15.154:3300/0 conn(0x7f6848156dd0 0x7f68480b3f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:33.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.025+0000 7f6846d9d640 1 -- 172.21.15.154:0/3820566400 >> v1:172.21.15.154:6789/0 conn(0x7f68481597f0 legacy=0x7f68480cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:33.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.026+0000 7f6846d9d640 1 -- 172.21.15.154:0/3820566400 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68481571b0 con 0x7f6848071260 2023-11-28T06:32:33.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.028+0000 7f6846d9d640 1 --2- 172.21.15.154:0/3820566400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 0x7f68480716d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6840009e50 tx=0x7f684002bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182edbac77f51fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.028+0000 7f6845d9b640 1 -- 172.21.15.154:0/3820566400 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684002caa0 con 0x7f6848071260 2023-11-28T06:32:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.028+0000 7f6845d9b640 1 -- 172.21.15.154:0/3820566400 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684002cc00 con 0x7f6848071260 2023-11-28T06:32:33.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.028+0000 7f6845d9b640 1 -- 172.21.15.154:0/3820566400 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400343f0 con 0x7f6848071260 2023-11-28T06:32:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.031+0000 7f684759e640 1 -- 172.21.15.154:0/3820566400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 msgr2=0x7f68480716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.031+0000 7f684759e640 1 --2- 172.21.15.154:0/3820566400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 0x7f68480716d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6840009e50 tx=0x7f684002bf00 comp rx=0 tx=0).stop 2023-11-28T06:32:33.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.031+0000 7f684759e640 1 -- 172.21.15.154:0/3820566400 shutdown_connections 2023-11-28T06:32:33.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.032+0000 7f684759e640 1 --2- 172.21.15.154:0/3820566400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6848071260 0x7f68480716d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:33.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.032+0000 7f684759e640 1 --2- 172.21.15.154:0/3820566400 >> v2:172.21.15.154:3300/0 conn(0x7f6848156dd0 0x7f68480b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:33.034 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.032+0000 7f684759e640 1 -- 172.21.15.154:0/3820566400 >> 172.21.15.154:0/3820566400 conn(0x7f68480b0c60 msgr2=0x7f68480b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:33.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.044+0000 7f684759e640 1 -- 172.21.15.154:0/3820566400 shutdown_connections 2023-11-28T06:32:33.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.045+0000 7f684759e640 1 -- 172.21.15.154:0/3820566400 wait complete. 2023-11-28T06:32:33.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.051+0000 7f684759e640 1 Processor -- start 2023-11-28T06:32:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.055+0000 7f684759e640 1 -- start start 2023-11-28T06:32:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.058+0000 7f684759e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 0x7f6848144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 0x7f6848144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684759e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 0x7f6848141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:33.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 0x7f6848144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38222/0 (socket says 172.21.15.154:38222) 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68481597f0 0x7f684814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684759e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684814d6b0 con 0x7f6848071260 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684759e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848141f90 con 0x7f6848156dd0 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684759e640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684814d8e0 con 0x7f68481597f0 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f683dd9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 0x7f6848141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f683dd9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 0x7f6848141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:59638/0 (socket says 172.21.15.154:59638) 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.059+0000 7f684659c640 1 -- 172.21.15.154:0/896181579 learned_addr learned my addr 172.21.15.154:0/896181579 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:33.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.060+0000 7f6846d9d640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68481597f0 0x7f684814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f683dd9b640 1 -- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68481597f0 msgr2=0x7f684814e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f683dd9b640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68481597f0 0x7f684814e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f683dd9b640 1 -- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 msgr2=0x7f6848144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f683dd9b640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 0x7f6848144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:33.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f683dd9b640 1 -- 172.21.15.154:0/896181579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009b30 con 0x7f6848156dd0 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f684659c640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 0x7f6848144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.061+0000 7f683dd9b640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 0x7f6848141a50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f683800b3e0 tx=0x7f683800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.062+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011830 con 0x7f6848156dd0 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.062+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838011990 con 0x7f6848156dd0 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.062+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838011d40 con 0x7f6848156dd0 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.062+0000 7f684759e640 1 -- 172.21.15.154:0/896181579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684814dbc0 con 0x7f6848156dd0 2023-11-28T06:32:33.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.062+0000 7f684759e640 1 -- 172.21.15.154:0/896181579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684814e180 con 0x7f6848156dd0 2023-11-28T06:32:33.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.066+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f68380193b0 con 0x7f6848156dd0 2023-11-28T06:32:33.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.067+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6848069320 con 0x7f6848156dd0 2023-11-28T06:32:33.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.068+0000 7f683f7fe640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f682806b210 0x7f682806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:33.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.069+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6838089630 con 0x7f6848156dd0 2023-11-28T06:32:33.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.070+0000 7f684659c640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f682806b210 0x7f682806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:33.074 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.072+0000 7f684659c640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f682806b210 0x7f682806d6d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f684814e520 tx=0x7f6830009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:33.075 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:33.073+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f68380543f0 con 0x7f6848156dd0 2023-11-28T06:32:34.085 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.083+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68480b35e0 con 0x7f6848156dd0 2023-11-28T06:32:34.087 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.085+0000 7f683f7fe640 1 -- 172.21.15.154:0/896181579 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f6838057a10 con 0x7f6848156dd0 2023-11-28T06:32:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:34.088 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:43.689582+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:30:40.260897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T22:30:40.999879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.093+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f682806b210 msgr2=0x7f682806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.093+0000 7f683cd99640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f682806b210 0x7f682806d6d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f684814e520 tx=0x7f6830009190 comp rx=0 tx=0).stop 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.093+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 msgr2=0x7f6848141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 0x7f6848141a50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f683800b3e0 tx=0x7f683800b8a0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 shutdown_connections 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6848156dd0 0x7f6848141a50 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f682806b210 0x7f682806d6d0 secure :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f684814e520 tx=0x7f6830009190 comp rx=0 tx=0).stop 2023-11-28T06:32:34.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68481597f0 0x7f684814e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 --2- 172.21.15.154:0/896181579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6848071260 0x7f6848144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.094+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 >> 172.21.15.154:0/896181579 conn(0x7f68480b0c60 msgr2=0x7f684815aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.098+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 shutdown_connections 2023-11-28T06:32:34.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.098+0000 7f683cd99640 1 -- 172.21.15.154:0/896181579 wait complete. 2023-11-28T06:32:34.150 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T06:32:34.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T06:32:34.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.616+0000 7f7e44bf4640 1 Processor -- start 2023-11-28T06:32:34.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.616+0000 7f7e44bf4640 1 -- start start 2023-11-28T06:32:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.619+0000 7f7e44bf4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e3810b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.619+0000 7f7e44bf4640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e38052cc0 con 0x7f7e38100fe0 2023-11-28T06:32:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.619+0000 7f7e44bf4640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e38034190 con 0x7f7e380338f0 2023-11-28T06:32:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.619+0000 7f7e44bf4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e38038320 con 0x7f7e38054400 2023-11-28T06:32:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.620+0000 7f7e3ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e3810b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:34.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.621+0000 7f7e3ffff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e3810b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:58126/0 (socket says 172.21.15.154:58126) 2023-11-28T06:32:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.621+0000 7f7e3ffff640 1 -- 172.21.15.154:0/1609688382 learned_addr learned my addr 172.21.15.154:0/1609688382 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.621+0000 7f7e3ffff640 1 -- 172.21.15.154:0/1609688382 >> v1:172.21.15.194:6789/0 conn(0x7f7e380338f0 legacy=0x7f7e38053cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.621+0000 7f7e3ffff640 1 -- 172.21.15.154:0/1609688382 >> v1:172.21.15.154:6789/0 conn(0x7f7e38100fe0 legacy=0x7f7e38037c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.621+0000 7f7e3ffff640 1 -- 172.21.15.154:0/1609688382 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38054870 con 0x7f7e38054400 2023-11-28T06:32:34.626 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.624+0000 7f7e3ffff640 1 --2- 172.21.15.154:0/1609688382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e3810b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e400798d0 tx=0x7f7e40097390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a83fa4fd3636ac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:34.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.625+0000 7f7e3e7fc640 1 -- 172.21.15.154:0/1609688382 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4009d540 con 0x7f7e38054400 2023-11-28T06:32:34.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.625+0000 7f7e3e7fc640 1 -- 172.21.15.154:0/1609688382 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4009a030 con 0x7f7e38054400 2023-11-28T06:32:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.625+0000 7f7e3e7fc640 1 -- 172.21.15.154:0/1609688382 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4009da40 con 0x7f7e38054400 2023-11-28T06:32:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.627+0000 7f7e44bf4640 1 -- 172.21.15.154:0/1609688382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 msgr2=0x7f7e3810b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:34.630 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.627+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/1609688382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e3810b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e400798d0 tx=0x7f7e40097390 comp rx=0 tx=0).stop 2023-11-28T06:32:34.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.636+0000 7f7e44bf4640 1 -- 172.21.15.154:0/1609688382 shutdown_connections 2023-11-28T06:32:34.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.636+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/1609688382 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e3810b9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.636+0000 7f7e44bf4640 1 -- 172.21.15.154:0/1609688382 >> 172.21.15.154:0/1609688382 conn(0x7f7e38009f80 msgr2=0x7f7e3800a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:34.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.637+0000 7f7e44bf4640 1 -- 172.21.15.154:0/1609688382 shutdown_connections 2023-11-28T06:32:34.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.637+0000 7f7e44bf4640 1 -- 172.21.15.154:0/1609688382 wait complete. 2023-11-28T06:32:34.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.644+0000 7f7e44bf4640 1 Processor -- start 2023-11-28T06:32:34.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.646+0000 7f7e44bf4640 1 -- start start 2023-11-28T06:32:34.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.649+0000 7f7e44bf4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e380338f0 0x7f7e3802c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:34.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.649+0000 7f7e44bf4640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e380fdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:34.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.649+0000 7f7e44bf4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e38100fe0 0x7f7e3819ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:34.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.649+0000 7f7e44bf4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380fe220 con 0x7f7e38100fe0 2023-11-28T06:32:34.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.649+0000 7f7e44bf4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380fbdd0 con 0x7f7e380338f0 2023-11-28T06:32:34.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.649+0000 7f7e44bf4640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380fc0b0 con 0x7f7e38054400 2023-11-28T06:32:34.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.650+0000 7f7e3f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e380338f0 0x7f7e3802c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.650+0000 7f7e3effd640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e380fdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.650+0000 7f7e3f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e380338f0 0x7f7e3802c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:59654/0 (socket says 172.21.15.154:59654) 2023-11-28T06:32:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.650+0000 7f7e3f7fe640 1 -- 172.21.15.154:0/484202741 learned_addr learned my addr 172.21.15.154:0/484202741 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.650+0000 7f7e3ffff640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e38100fe0 0x7f7e3819ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:34.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.651+0000 7f7e3ffff640 1 -- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 msgr2=0x7f7e380fdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:34.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.653+0000 7f7e3ffff640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e380fdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.653+0000 7f7e3ffff640 1 -- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e380338f0 msgr2=0x7f7e3802c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:34.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.653+0000 7f7e3ffff640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e380338f0 0x7f7e3802c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:34.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.653+0000 7f7e3ffff640 1 -- 172.21.15.154:0/484202741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4004f730 con 0x7f7e38100fe0 2023-11-28T06:32:34.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.654+0000 7f7e3effd640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e380fdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.654+0000 7f7e3ffff640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e38100fe0 0x7f7e3819ddd0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f7e40068f20 tx=0x7f7e400686a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.655+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400ab660 con 0x7f7e38100fe0 2023-11-28T06:32:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.655+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e400ab7c0 con 0x7f7e38100fe0 2023-11-28T06:32:34.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.655+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400ab660 con 0x7f7e38100fe0 2023-11-28T06:32:34.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.657+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380fc390 con 0x7f7e38100fe0 2023-11-28T06:32:34.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.657+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e380fc950 con 0x7f7e38100fe0 2023-11-28T06:32:34.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.660+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e380fcb70 con 0x7f7e38100fe0 2023-11-28T06:32:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.667+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f7e400a7070 con 0x7f7e38100fe0 2023-11-28T06:32:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.678+0000 7f7e2bfff640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7e2406b280 0x7f7e2406d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.678+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e401156e0 con 0x7f7e38100fe0 2023-11-28T06:32:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.682+0000 7f7e3f7fe640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7e2406b280 0x7f7e2406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.686+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f7e400e0370 con 0x7f7e38100fe0 2023-11-28T06:32:34.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:34.686+0000 7f7e3f7fe640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7e2406b280 0x7f7e2406d740 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009a80 tx=0x7f7e34009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:35.886 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:35.886 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:30:42.026663+0000","modified":"2023-11-27T22:30:44.025219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1494168994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1494168994},{"type":"v1","addr":"172.21.15.154:6837","nonce":1494168994}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T06:32:35.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.881+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e380fcb70 con 0x7f7e38100fe0 2023-11-28T06:32:35.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.883+0000 7f7e2bfff640 1 -- 172.21.15.154:0/484202741 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f7e400e3990 con 0x7f7e38100fe0 2023-11-28T06:32:35.887 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 12 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.892+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7e2406b280 msgr2=0x7f7e2406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.892+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7e2406b280 0x7f7e2406d740 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009a80 tx=0x7f7e34009190 comp rx=0 tx=0).stop 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.892+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e38100fe0 msgr2=0x7f7e3819ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.892+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e38100fe0 0x7f7e3819ddd0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f7e40068f20 tx=0x7f7e400686a0 comp rx=0 tx=0).stop 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 shutdown_connections 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f7e2406b280 0x7f7e2406d740 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e38100fe0 0x7f7e3819ddd0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:35.896 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e38054400 0x7f7e380fdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 --2- 172.21.15.154:0/484202741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e380338f0 0x7f7e3802c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 >> 172.21.15.154:0/484202741 conn(0x7f7e38009f80 msgr2=0x7f7e3804ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.893+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 shutdown_connections 2023-11-28T06:32:35.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:35.895+0000 7f7e44bf4640 1 -- 172.21.15.154:0/484202741 wait complete. 2023-11-28T06:32:35.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T06:32:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.397+0000 7fcd78ed9640 1 Processor -- start 2023-11-28T06:32:36.400 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.397+0000 7fcd78ed9640 1 -- start start 2023-11-28T06:32:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.400+0000 7fcd78ed9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c038050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.400+0000 7fcd78ed9640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcd6c033ec0 0x7fcd6c04fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.400+0000 7fcd78ed9640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c0541b0 con 0x7fcd6c053c40 2023-11-28T06:32:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.400+0000 7fcd78ed9640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c005f00 con 0x7fcd6c033ec0 2023-11-28T06:32:36.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.400+0000 7fcd78ed9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c0061e0 con 0x7fcd6c00c070 2023-11-28T06:32:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.401+0000 7fcd737fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c038050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.401+0000 7fcd737fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c038050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:58140/0 (socket says 172.21.15.154:58140) 2023-11-28T06:32:36.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.401+0000 7fcd737fe640 1 -- 172.21.15.154:0/2227216924 learned_addr learned my addr 172.21.15.154:0/2227216924 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.402+0000 7fcd737fe640 1 -- 172.21.15.154:0/2227216924 >> v2:172.21.15.154:3300/0 conn(0x7fcd6c033ec0 msgr2=0x7fcd6c04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.402+0000 7fcd737fe640 1 --2- 172.21.15.154:0/2227216924 >> v2:172.21.15.154:3300/0 conn(0x7fcd6c033ec0 0x7fcd6c04fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.402+0000 7fcd737fe640 1 -- 172.21.15.154:0/2227216924 >> v1:172.21.15.154:6789/0 conn(0x7fcd6c053c40 legacy=0x7fcd6c0def80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:36.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.402+0000 7fcd737fe640 1 -- 172.21.15.154:0/2227216924 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0064c0 con 0x7fcd6c00c070 2023-11-28T06:32:36.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.405+0000 7fcd737fe640 1 --2- 172.21.15.154:0/2227216924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c038050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd740730e0 tx=0x7fcd740a8250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b6acd88740d96ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.406+0000 7fcd727fc640 1 -- 172.21.15.154:0/2227216924 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740b0640 con 0x7fcd6c00c070 2023-11-28T06:32:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.406+0000 7fcd727fc640 1 -- 172.21.15.154:0/2227216924 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd740b0820 con 0x7fcd6c00c070 2023-11-28T06:32:36.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.406+0000 7fcd727fc640 1 -- 172.21.15.154:0/2227216924 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740b0c50 con 0x7fcd6c00c070 2023-11-28T06:32:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.408+0000 7fcd78ed9640 1 -- 172.21.15.154:0/2227216924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 msgr2=0x7fcd6c038050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:36.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.408+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/2227216924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c038050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd740730e0 tx=0x7fcd740a8250 comp rx=0 tx=0).stop 2023-11-28T06:32:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.410+0000 7fcd78ed9640 1 -- 172.21.15.154:0/2227216924 shutdown_connections 2023-11-28T06:32:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.410+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/2227216924 >> v2:172.21.15.154:3300/0 conn(0x7fcd6c033ec0 0x7fcd6c04fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.410+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/2227216924 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c038050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:36.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.410+0000 7fcd78ed9640 1 -- 172.21.15.154:0/2227216924 >> 172.21.15.154:0/2227216924 conn(0x7fcd6c009f80 msgr2=0x7fcd6c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.410+0000 7fcd78ed9640 1 -- 172.21.15.154:0/2227216924 shutdown_connections 2023-11-28T06:32:36.413 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.411+0000 7fcd78ed9640 1 -- 172.21.15.154:0/2227216924 wait complete. 2023-11-28T06:32:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.415+0000 7fcd78ed9640 1 Processor -- start 2023-11-28T06:32:36.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.416+0000 7fcd78ed9640 1 -- start start 2023-11-28T06:32:36.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.419+0000 7fcd78ed9640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c16d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.419+0000 7fcd78ed9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 0x7fcd6c04c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:36.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.420+0000 7fcd72ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 0x7fcd6c04c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:36.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.421+0000 7fcd72ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 0x7fcd6c04c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38244/0 (socket says 172.21.15.154:38244) 2023-11-28T06:32:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.421+0000 7fcd78ed9640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c053c40 0x7fcd6c04a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.421+0000 7fcd78ed9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c04b4e0 con 0x7fcd6c033ec0 2023-11-28T06:32:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.421+0000 7fcd78ed9640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c04b200 con 0x7fcd6c053c40 2023-11-28T06:32:36.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.421+0000 7fcd78ed9640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c04bc90 con 0x7fcd6c00c070 2023-11-28T06:32:36.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.422+0000 7fcd72ffd640 1 -- 172.21.15.154:0/4034641435 learned_addr learned my addr 172.21.15.154:0/4034641435 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:36.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.423+0000 7fcd73fff640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c053c40 0x7fcd6c04a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.424+0000 7fcd72ffd640 1 -- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 msgr2=0x7fcd6c16d1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T06:32:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.424+0000 7fcd72ffd640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c16d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.424+0000 7fcd72ffd640 1 -- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c053c40 msgr2=0x7fcd6c04a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.424+0000 7fcd72ffd640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c053c40 0x7fcd6c04a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:36.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.424+0000 7fcd72ffd640 1 -- 172.21.15.154:0/4034641435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c04bf70 con 0x7fcd6c033ec0 2023-11-28T06:32:36.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.426+0000 7fcd72ffd640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 0x7fcd6c04c770 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000b3f0 tx=0x7fcd6000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:36.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.427+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60011830 con 0x7fcd6c033ec0 2023-11-28T06:32:36.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.427+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd60011990 con 0x7fcd6c033ec0 2023-11-28T06:32:36.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.428+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c04c250 con 0x7fcd6c033ec0 2023-11-28T06:32:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.433+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60011d40 con 0x7fcd6c033ec0 2023-11-28T06:32:36.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.434+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c16d6e0 con 0x7fcd6c033ec0 2023-11-28T06:32:36.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.436+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fcd6001a400 con 0x7fcd6c033ec0 2023-11-28T06:32:36.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.437+0000 7fcd5ffff640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcd5806b210 0x7fcd5806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:36.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.438+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd6008ae30 con 0x7fcd6c033ec0 2023-11-28T06:32:36.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.438+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c050300 con 0x7fcd6c033ec0 2023-11-28T06:32:36.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.440+0000 7fcd737fe640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcd5806b210 0x7fcd5806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:36.444 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.442+0000 7fcd737fe640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcd5806b210 0x7fcd5806d6d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c006320 tx=0x7fcd7406d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:36.465 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:36.463+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fcd6008e060 con 0x7fcd6c033ec0 2023-11-28T06:32:37.668 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.662+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd6c005360 con 0x7fcd6c033ec0 2023-11-28T06:32:37.669 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.667+0000 7fcd5ffff640 1 -- 172.21.15.154:0/4034641435 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fcd60015030 con 0x7fcd6c033ec0 2023-11-28T06:32:37.676 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:37.677 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T22:30:42.026663+0000","modified":"2023-11-27T22:30:44.025219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6837/1494168994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":1494168994},{"type":"v1","addr":"172.21.15.154:6837","nonce":1494168994}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T06:32:37.677 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 12 2023-11-28T06:32:37.678 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.676+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcd5806b210 msgr2=0x7fcd5806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.676+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcd5806b210 0x7fcd5806d6d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c006320 tx=0x7fcd7406d040 comp rx=0 tx=0).stop 2023-11-28T06:32:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 msgr2=0x7fcd6c04c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:37.679 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 0x7fcd6c04c770 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000b3f0 tx=0x7fcd6000b8b0 comp rx=0 tx=0).stop 2023-11-28T06:32:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 shutdown_connections 2023-11-28T06:32:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c053c40 0x7fcd6c04a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:37.680 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fcd5806b210 0x7fcd5806d6d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd6c033ec0 0x7fcd6c04c770 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 --2- 172.21.15.154:0/4034641435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c00c070 0x7fcd6c16d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.677+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 >> 172.21.15.154:0/4034641435 conn(0x7fcd6c009f80 msgr2=0x7fcd6c0343b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.678+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 shutdown_connections 2023-11-28T06:32:37.681 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:37.678+0000 7fcd78ed9640 1 -- 172.21.15.154:0/4034641435 wait complete. 2023-11-28T06:32:37.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T06:32:38.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.172+0000 7f6b7d65f640 1 Processor -- start 2023-11-28T06:32:38.178 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.173+0000 7f6b7d65f640 1 -- start start 2023-11-28T06:32:38.179 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.177+0000 7f6b7d65f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.177+0000 7f6b7d65f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b78070380 con 0x7f6b780b3550 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.177+0000 7f6b7d65f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b78070660 con 0x7f6b7806d6e0 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.177+0000 7f6b7d65f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b78070940 con 0x7f6b780b3000 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.178+0000 7f6b767fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.178+0000 7f6b777fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6b780b3550 0x7f6b78162c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:36412/0 (socket says 172.21.15.154:36412) 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.178+0000 7f6b777fe640 1 -- 172.21.15.154:0/4166605611 learned_addr learned my addr 172.21.15.154:0/4166605611 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:38.180 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.178+0000 7f6b767fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:58162/0 (socket says 172.21.15.154:58162) 2023-11-28T06:32:38.181 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.179+0000 7f6b75ffb640 1 -- 172.21.15.154:0/4166605611 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884046352 0 0) 0x7f6b78070380 con 0x7f6b780b3550 2023-11-28T06:32:38.182 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.180+0000 7f6b75ffb640 1 -- 172.21.15.154:0/4166605611 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b64003520 con 0x7f6b780b3550 2023-11-28T06:32:38.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.181+0000 7f6b767fc640 1 -- 172.21.15.154:0/4166605611 >> v1:172.21.15.194:6789/0 conn(0x7f6b7806d6e0 legacy=0x7f6b7806dac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T06:32:38.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.181+0000 7f6b767fc640 1 -- 172.21.15.154:0/4166605611 >> v1:172.21.15.154:6789/0 conn(0x7f6b780b3550 legacy=0x7f6b78162c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:38.184 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.181+0000 7f6b767fc640 1 -- 172.21.15.154:0/4166605611 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78070c20 con 0x7f6b780b3000 2023-11-28T06:32:38.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.184+0000 7f6b767fc640 1 --2- 172.21.15.154:0/4166605611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78071420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009dc0 tx=0x7f6b6802bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2c9cfaf93c3d4b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:38.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.184+0000 7f6b75ffb640 1 -- 172.21.15.154:0/4166605611 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6802cba0 con 0x7f6b780b3000 2023-11-28T06:32:38.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.184+0000 7f6b75ffb640 1 -- 172.21.15.154:0/4166605611 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6802cd00 con 0x7f6b780b3000 2023-11-28T06:32:38.187 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.184+0000 7f6b75ffb640 1 -- 172.21.15.154:0/4166605611 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68034660 con 0x7f6b780b3000 2023-11-28T06:32:38.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.186+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4166605611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 msgr2=0x7f6b78071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:38.188 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.186+0000 7f6b7d65f640 1 --2- 172.21.15.154:0/4166605611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78071420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009dc0 tx=0x7f6b6802bdf0 comp rx=0 tx=0).stop 2023-11-28T06:32:38.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.187+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4166605611 shutdown_connections 2023-11-28T06:32:38.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.187+0000 7f6b7d65f640 1 --2- 172.21.15.154:0/4166605611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78071420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:38.189 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.187+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4166605611 >> 172.21.15.154:0/4166605611 conn(0x7f6b780b0b10 msgr2=0x7f6b780b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:38.195 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.190+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4166605611 shutdown_connections 2023-11-28T06:32:38.197 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.195+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4166605611 wait complete. 2023-11-28T06:32:38.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.201+0000 7f6b7d65f640 1 Processor -- start 2023-11-28T06:32:38.203 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.201+0000 7f6b7d65f640 1 -- start start 2023-11-28T06:32:38.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b7d65f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 0x7f6b7813e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:38.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b7d65f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:38.206 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b7d65f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b780b3550 0x7f6b78140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:38.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b7d65f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b78142060 con 0x7f6b780b3550 2023-11-28T06:32:38.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b7d65f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7813eaf0 con 0x7f6b7806d6e0 2023-11-28T06:32:38.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b7d65f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b78141450 con 0x7f6b780b3000 2023-11-28T06:32:38.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b76ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 0x7f6b7813e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:38.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.204+0000 7f6b76ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 0x7f6b7813e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:59678/0 (socket says 172.21.15.154:59678) 2023-11-28T06:32:38.207 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.205+0000 7f6b76ffd640 1 -- 172.21.15.154:0/4064053359 learned_addr learned my addr 172.21.15.154:0/4064053359 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.205+0000 7f6b76ffd640 1 -- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 msgr2=0x7f6b78140900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.205+0000 7f6b76ffd640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78140900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.205+0000 7f6b777fe640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b780b3550 0x7f6b78140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.206+0000 7f6b76ffd640 1 -- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b780b3550 msgr2=0x7f6b78140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.206+0000 7f6b76ffd640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b780b3550 0x7f6b78140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.206+0000 7f6b76ffd640 1 -- 172.21.15.154:0/4064053359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68009a70 con 0x7f6b7806d6e0 2023-11-28T06:32:38.208 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.206+0000 7f6b777fe640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b780b3550 0x7f6b78140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:38.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.207+0000 7f6b76ffd640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 0x7f6b7813e5b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000b450 tx=0x7f6b7000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:38.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.207+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011890 con 0x7f6b7806d6e0 2023-11-28T06:32:38.209 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.207+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70011a10 con 0x7f6b7806d6e0 2023-11-28T06:32:38.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.207+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70011dc0 con 0x7f6b7806d6e0 2023-11-28T06:32:38.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.208+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4064053359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b78141730 con 0x7f6b7806d6e0 2023-11-28T06:32:38.210 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.208+0000 7f6b7d65f640 1 -- 172.21.15.154:0/4064053359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b78141cf0 con 0x7f6b7806d6e0 2023-11-28T06:32:38.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.214+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6b7001a400 con 0x7f6b7806d6e0 2023-11-28T06:32:38.217 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.215+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b78069320 con 0x7f6b7806d6e0 2023-11-28T06:32:38.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.216+0000 7f6b6f7fe640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b5806b210 0x7f6b5806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:38.219 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.217+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b70089ce0 con 0x7f6b7806d6e0 2023-11-28T06:32:38.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.222+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6b70054b80 con 0x7f6b7806d6e0 2023-11-28T06:32:38.227 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.225+0000 7f6b767fc640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b5806b210 0x7f6b5806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:38.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:38.229+0000 7f6b767fc640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b5806b210 0x7f6b5806d6d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6b68036000 tx=0x7f6b68030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:39.212 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.210+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b780719d0 con 0x7f6b7806d6e0 2023-11-28T06:32:39.214 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.213+0000 7f6b6f7fe640 1 -- 172.21.15.154:0/4064053359 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16594 (secure 0 0 0) 0x7f6b70015020 con 0x7f6b7806d6e0 2023-11-28T06:32:39.216 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:39.216 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":34,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-27T22:30:43.689582+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T22:30:40.260897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T22:30:40.999879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T06:32:39.222 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.220+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b5806b210 msgr2=0x7f6b5806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:39.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.220+0000 7f6b6d7fa640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b5806b210 0x7f6b5806d6d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6b68036000 tx=0x7f6b68030000 comp rx=0 tx=0).stop 2023-11-28T06:32:39.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.220+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 msgr2=0x7f6b7813e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:39.223 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.220+0000 7f6b6d7fa640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 0x7f6b7813e5b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000b450 tx=0x7f6b7000b910 comp rx=0 tx=0).stop 2023-11-28T06:32:39.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 shutdown_connections 2023-11-28T06:32:39.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6b5806b210 0x7f6b5806d6d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b780b3550 0x7f6b78140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b780b3000 0x7f6b78140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 --2- 172.21.15.154:0/4064053359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b7806d6e0 0x7f6b7813e5b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.224 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 >> 172.21.15.154:0/4064053359 conn(0x7f6b780b0b10 msgr2=0x7f6b780b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:39.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 shutdown_connections 2023-11-28T06:32:39.225 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.221+0000 7f6b6d7fa640 1 -- 172.21.15.154:0/4064053359 wait complete. 2023-11-28T06:32:39.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T06:32:39.727 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.726+0000 7f5543e96640 1 Processor -- start 2023-11-28T06:32:39.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.726+0000 7f5543e96640 1 -- start start 2023-11-28T06:32:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5543e96640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 0x7f553c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5543e96640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f553c15de30 0x7f553c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5543e96640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c06b4e0 0x7f553c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5543e96640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c15da10 con 0x7f553c15de30 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5543e96640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c06be70 con 0x7f553c15ce50 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5543e96640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c15e2c0 con 0x7f553c06b4e0 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.730+0000 7f5541c32640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 0x7f553c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5541c32640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 0x7f553c0b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:39904/0 (socket says 172.21.15.154:39904) 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5541c32640 1 -- 172.21.15.154:0/2002976527 learned_addr learned my addr 172.21.15.154:0/2002976527 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5542433640 1 --2- 172.21.15.154:0/2002976527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c06b4e0 0x7f553c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5541431640 1 --2- 172.21.15.154:0/2002976527 >> v2:172.21.15.154:3300/0 conn(0x7f553c15de30 0x7f553c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5542433640 1 -- 172.21.15.154:0/2002976527 >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 msgr2=0x7f553c0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5542433640 1 --2- 172.21.15.154:0/2002976527 >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 0x7f553c0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5542433640 1 -- 172.21.15.154:0/2002976527 >> v2:172.21.15.154:3300/0 conn(0x7f553c15de30 msgr2=0x7f553c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5542433640 1 --2- 172.21.15.154:0/2002976527 >> v2:172.21.15.154:3300/0 conn(0x7f553c15de30 0x7f553c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.731+0000 7f5542433640 1 -- 172.21.15.154:0/2002976527 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0b4990 con 0x7f553c06b4e0 2023-11-28T06:32:39.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.732+0000 7f5541c32640 1 --2- 172.21.15.154:0/2002976527 >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 0x7f553c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.734+0000 7f5542433640 1 --2- 172.21.15.154:0/2002976527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c06b4e0 0x7f553c06b930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f553c071e00 tx=0x7f553402bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15f40318365ac88 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.734+0000 7f5540c30640 1 -- 172.21.15.154:0/2002976527 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553402cb50 con 0x7f553c06b4e0 2023-11-28T06:32:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.734+0000 7f5540c30640 1 -- 172.21.15.154:0/2002976527 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553402ccb0 con 0x7f553c06b4e0 2023-11-28T06:32:39.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.735+0000 7f5540c30640 1 -- 172.21.15.154:0/2002976527 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534034660 con 0x7f553c06b4e0 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.736+0000 7f5543e96640 1 -- 172.21.15.154:0/2002976527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c06b4e0 msgr2=0x7f553c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.736+0000 7f5543e96640 1 --2- 172.21.15.154:0/2002976527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c06b4e0 0x7f553c06b930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f553c071e00 tx=0x7f553402bda0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.736+0000 7f5543e96640 1 -- 172.21.15.154:0/2002976527 shutdown_connections 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.736+0000 7f5543e96640 1 --2- 172.21.15.154:0/2002976527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c06b4e0 0x7f553c06b930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.736+0000 7f5543e96640 1 --2- 172.21.15.154:0/2002976527 >> v2:172.21.15.154:3300/0 conn(0x7f553c15de30 0x7f553c0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.736+0000 7f5543e96640 1 --2- 172.21.15.154:0/2002976527 >> v2:172.21.15.194:3300/0 conn(0x7f553c15ce50 0x7f553c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.737+0000 7f5543e96640 1 -- 172.21.15.154:0/2002976527 >> 172.21.15.154:0/2002976527 conn(0x7f553c0b1bc0 msgr2=0x7f553c070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:39.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.737+0000 7f5543e96640 1 -- 172.21.15.154:0/2002976527 shutdown_connections 2023-11-28T06:32:39.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.738+0000 7f5543e96640 1 -- 172.21.15.154:0/2002976527 wait complete. 2023-11-28T06:32:39.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.743+0000 7f5543e96640 1 Processor -- start 2023-11-28T06:32:39.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.744+0000 7f5543e96640 1 -- start start 2023-11-28T06:32:39.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.747+0000 7f5543e96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 0x7f553c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.747+0000 7f5543e96640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c15ce50 0x7f553c1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.747+0000 7f5541c32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 0x7f553c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5541c32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 0x7f553c150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34412/0 (socket says 172.21.15.154:34412) 2023-11-28T06:32:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5541431640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c15ce50 0x7f553c1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5541431640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c15ce50 0x7f553c1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:39908/0 (socket says 172.21.15.154:39908) 2023-11-28T06:32:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5541c32640 1 -- 172.21.15.154:0/1548905078 learned_addr learned my addr 172.21.15.154:0/1548905078 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5543e96640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15de30 0x7f553c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.751 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5542433640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15de30 0x7f553c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5543e96640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c1514b0 con 0x7f553c06b4e0 2023-11-28T06:32:39.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5543e96640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c157e50 con 0x7f553c15ce50 2023-11-28T06:32:39.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.748+0000 7f5543e96640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c155f60 con 0x7f553c15de30 2023-11-28T06:32:39.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.750+0000 7f5541c32640 1 -- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15de30 msgr2=0x7f553c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:39.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.750+0000 7f5541c32640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15de30 0x7f553c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.750+0000 7f5541c32640 1 -- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c15ce50 msgr2=0x7f553c1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:39.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.750+0000 7f5541c32640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c15ce50 0x7f553c1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:39.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.750+0000 7f5541c32640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c00b770 con 0x7f553c06b4e0 2023-11-28T06:32:39.755 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.751+0000 7f5541c32640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 0x7f553c150f70 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f552c006ca0 tx=0x7f552c00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:39.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.755+0000 7f5542433640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15de30 0x7f553c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T06:32:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.757+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c004230 con 0x7f553c06b4e0 2023-11-28T06:32:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.757+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c004390 con 0x7f553c06b4e0 2023-11-28T06:32:39.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.757+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c003810 con 0x7f553c06b4e0 2023-11-28T06:32:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.760+0000 7f5543e96640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5534009a70 con 0x7f553c06b4e0 2023-11-28T06:32:39.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.760+0000 7f5543e96640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c155c80 con 0x7f553c06b4e0 2023-11-28T06:32:39.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.766+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f552c003970 con 0x7f553c06b4e0 2023-11-28T06:32:39.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.768+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c152f20 con 0x7f553c06b4e0 2023-11-28T06:32:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.768+0000 7f55327fc640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552006b290 0x7f552006d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:39.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.769+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f552c014070 con 0x7f553c06b4e0 2023-11-28T06:32:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.773+0000 7f5541431640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552006b290 0x7f552006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:39.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.775+0000 7f5541431640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552006b290 0x7f552006d750 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f553c1570f0 tx=0x7f5538009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:39.798 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:39.794+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f553c152f20 con 0x7f553c06b4e0 2023-11-28T06:32:41.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.006+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f553c152f20 con 0x7f553c06b4e0 2023-11-28T06:32:41.010 INFO:tasks.ceph.mon.a.smithi154.stderr:2023-11-28T06:32:41.008+0000 7f28b9984640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T06:32:41.017 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.015+0000 7f55327fc640 1 -- 172.21.15.154:0/1548905078 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f553c152f20 con 0x7f553c06b4e0 2023-11-28T06:32:41.017 INFO:teuthology.orchestra.run.smithi154.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T06:32:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.027+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552006b290 msgr2=0x7f552006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.027+0000 7f551ffff640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552006b290 0x7f552006d750 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f553c1570f0 tx=0x7f5538009190 comp rx=0 tx=0).stop 2023-11-28T06:32:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.028+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 msgr2=0x7f553c150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.028+0000 7f551ffff640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 0x7f553c150f70 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f552c006ca0 tx=0x7f552c00d720 comp rx=0 tx=0).stop 2023-11-28T06:32:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 shutdown_connections 2023-11-28T06:32:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553c15ce50 0x7f553c1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f552006b290 0x7f552006d750 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f553c15de30 0x7f553c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 --2- 172.21.15.154:0/1548905078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f553c06b4e0 0x7f553c150f70 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 >> 172.21.15.154:0/1548905078 conn(0x7f553c0b1bc0 msgr2=0x7f553c15c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.030+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 shutdown_connections 2023-11-28T06:32:41.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.031+0000 7f551ffff640 1 -- 172.21.15.154:0/1548905078 wait complete. 2023-11-28T06:32:41.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T06:32:41.287 INFO:tasks.ceph.mds.c.smithi154.stdout:starting mds.c at 2023-11-28T06:32:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.397+0000 7f6eb6383640 1 Processor -- start 2023-11-28T06:32:41.399 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.397+0000 7f6eb6383640 1 -- start start 2023-11-28T06:32:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.399+0000 7f6eb6383640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6eb015d1d0 0x7f6eb006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:41.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.399+0000 7f6eb6383640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb0161ce0 con 0x7f6eb00aeb80 2023-11-28T06:32:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.399+0000 7f6eb6383640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb00adae0 con 0x7f6eb00ad640 2023-11-28T06:32:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.399+0000 7f6eb6383640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb00addc0 con 0x7f6eb015d1d0 2023-11-28T06:32:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaffff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6eb015d1d0 0x7f6eb006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaf7fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f6eb00ad640 0x7f6eb0160ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53482/0 (socket says 172.21.15.154:53482) 2023-11-28T06:32:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaf7fe640 1 -- 172.21.15.154:0/3182239558 learned_addr learned my addr 172.21.15.154:0/3182239558 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:41.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaffff640 1 -- 172.21.15.154:0/3182239558 >> v1:172.21.15.194:6789/0 conn(0x7f6eb00ad640 legacy=0x7f6eb0160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaffff640 1 -- 172.21.15.154:0/3182239558 >> v1:172.21.15.154:6789/0 conn(0x7f6eb00aeb80 legacy=0x7f6eb01615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaeffd640 1 -- 172.21.15.154:0/3182239558 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499283263 0 0) 0x7f6eb00adae0 con 0x7f6eb00ad640 2023-11-28T06:32:41.403 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.400+0000 7f6eaffff640 1 -- 172.21.15.154:0/3182239558 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00ae0a0 con 0x7f6eb015d1d0 2023-11-28T06:32:41.404 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.402+0000 7f6eaffff640 1 --2- 172.21.15.154:0/3182239558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb015d1d0 0x7f6eb006b4e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00097a0 tx=0x7f6ea002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e011ae5dd159f780 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.403+0000 7f6eaeffd640 1 -- 172.21.15.154:0/3182239558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0030610 con 0x7f6eb015d1d0 2023-11-28T06:32:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.403+0000 7f6eaeffd640 1 -- 172.21.15.154:0/3182239558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea0030770 con 0x7f6eb015d1d0 2023-11-28T06:32:41.405 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.403+0000 7f6eaeffd640 1 -- 172.21.15.154:0/3182239558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0030b00 con 0x7f6eb015d1d0 2023-11-28T06:32:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 -- 172.21.15.154:0/3182239558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb015d1d0 msgr2=0x7f6eb006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 --2- 172.21.15.154:0/3182239558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb015d1d0 0x7f6eb006b4e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00097a0 tx=0x7f6ea002b960 comp rx=0 tx=0).stop 2023-11-28T06:32:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 -- 172.21.15.154:0/3182239558 shutdown_connections 2023-11-28T06:32:41.406 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 --2- 172.21.15.154:0/3182239558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb015d1d0 0x7f6eb006b4e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 -- 172.21.15.154:0/3182239558 >> 172.21.15.154:0/3182239558 conn(0x7f6eb0070e70 msgr2=0x7f6eb0071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 -- 172.21.15.154:0/3182239558 shutdown_connections 2023-11-28T06:32:41.407 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.404+0000 7f6eb6383640 1 -- 172.21.15.154:0/3182239558 wait complete. 2023-11-28T06:32:41.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.408+0000 7f6eb6383640 1 Processor -- start 2023-11-28T06:32:41.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.408+0000 7f6eb6383640 1 -- start start 2023-11-28T06:32:41.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eb6383640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb00ad640 0x7f6eb014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:41.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eb6383640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb00aeb80 0x7f6eb01f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:41.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eb6383640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6eb015d1d0 0x7f6eb01f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:41.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eb6383640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb00cce20 con 0x7f6eb00ad640 2023-11-28T06:32:41.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eb6383640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01f4630 con 0x7f6eb00aeb80 2023-11-28T06:32:41.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eb6383640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb01f3ea0 con 0x7f6eb015d1d0 2023-11-28T06:32:41.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eaffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb00ad640 0x7f6eb014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:41.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.410+0000 7f6eaffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb00ad640 0x7f6eb014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34432/0 (socket says 172.21.15.154:34432) 2023-11-28T06:32:41.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaffff640 1 -- 172.21.15.154:0/504943997 learned_addr learned my addr 172.21.15.154:0/504943997 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:41.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaf7fe640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb00aeb80 0x7f6eb01f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:41.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eb4920640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6eb015d1d0 0x7f6eb01f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:41.414 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaf7fe640 1 -- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6eb015d1d0 msgr2=0x7f6eb01f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaf7fe640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6eb015d1d0 0x7f6eb01f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaf7fe640 1 -- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb00ad640 msgr2=0x7f6eb014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaf7fe640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb00ad640 0x7f6eb014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eaf7fe640 1 -- 172.21.15.154:0/504943997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0009400 con 0x7f6eb00aeb80 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.411+0000 7f6eb4920640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6eb015d1d0 0x7f6eb01f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.412+0000 7f6eaf7fe640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb00aeb80 0x7f6eb01f40f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c3e0 tx=0x7f6ea400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.412+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40074e0 con 0x7f6eb00aeb80 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.412+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4007640 con 0x7f6eb00aeb80 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.412+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb00ced50 con 0x7f6eb00aeb80 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.412+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4004a20 con 0x7f6eb00aeb80 2023-11-28T06:32:41.415 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.412+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb00cc7d0 con 0x7f6eb00aeb80 2023-11-28T06:32:41.416 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.414+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0069400 con 0x7f6eb00aeb80 2023-11-28T06:32:41.417 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.415+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f6ea4004b80 con 0x7f6eb00aeb80 2023-11-28T06:32:41.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.416+0000 7f6eacff9640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6e9c06b1c0 0x7f6e9c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:41.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.416+0000 7f6eaffff640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6e9c06b1c0 0x7f6e9c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:41.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.416+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6ea40897d0 con 0x7f6eb00aeb80 2023-11-28T06:32:41.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.418+0000 7f6eaffff640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6e9c06b1c0 0x7f6e9c06d680 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6ea002b9a0 tx=0x7f6ea003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:41.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:41.420+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6ea40544b0 con 0x7f6eb00aeb80 2023-11-28T06:32:42.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:42.052+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6eb00ccf60 con 0x7f6eb00aeb80 2023-11-28T06:32:43.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.025+0000 7f6eacff9640 1 -- 172.21.15.154:0/504943997 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ea4057ad0 con 0x7f6eb00aeb80 2023-11-28T06:32:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6e9c06b1c0 msgr2=0x7f6e9c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6e9c06b1c0 0x7f6e9c06d680 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6ea002b9a0 tx=0x7f6ea003b040 comp rx=0 tx=0).stop 2023-11-28T06:32:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb00aeb80 msgr2=0x7f6eb01f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb00aeb80 0x7f6eb01f40f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c3e0 tx=0x7f6ea400c8a0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.031 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 shutdown_connections 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb00aeb80 0x7f6eb01f40f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f6e9c06b1c0 0x7f6e9c06d680 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6eb015d1d0 0x7f6eb01f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 --2- 172.21.15.154:0/504943997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6eb00ad640 0x7f6eb014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 >> 172.21.15.154:0/504943997 conn(0x7f6eb0070e70 msgr2=0x7f6eb0153530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 shutdown_connections 2023-11-28T06:32:43.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.030+0000 7f6eb6383640 1 -- 172.21.15.154:0/504943997 wait complete. 2023-11-28T06:32:43.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T06:32:43.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.358+0000 7fb59629d640 1 Processor -- start 2023-11-28T06:32:43.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.359+0000 7fb59629d640 1 -- start start 2023-11-28T06:32:43.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.362+0000 7fb59629d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb59015b130 0x7fb5900d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:43.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.362+0000 7fb59629d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5900cf320 0x7fb5900cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:43.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.362+0000 7fb59629d640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5900b3f10 con 0x7fb59015f760 2023-11-28T06:32:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.362+0000 7fb59629d640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59015fd20 con 0x7fb5900cf320 2023-11-28T06:32:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.362+0000 7fb59629d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900d0730 con 0x7fb59015b130 2023-11-28T06:32:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb59483a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5900cf320 0x7fb5900cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb5877fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb59015f760 0x7fb5900cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49968/0 (socket says 172.21.15.154:49968) 2023-11-28T06:32:43.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb5877fe640 1 -- 172.21.15.154:0/2684678365 learned_addr learned my addr 172.21.15.154:0/2684678365 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb58ffff640 1 --2- 172.21.15.154:0/2684678365 >> v2:172.21.15.194:3300/0 conn(0x7fb59015b130 0x7fb5900d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb58ffff640 1 -- 172.21.15.154:0/2684678365 >> v2:172.21.15.154:3300/0 conn(0x7fb5900cf320 msgr2=0x7fb5900cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb58ffff640 1 --2- 172.21.15.154:0/2684678365 >> v2:172.21.15.154:3300/0 conn(0x7fb5900cf320 0x7fb5900cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.363+0000 7fb58ffff640 1 -- 172.21.15.154:0/2684678365 >> v1:172.21.15.154:6789/0 conn(0x7fb59015f760 legacy=0x7fb5900cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:43.365 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.364+0000 7fb58ffff640 1 -- 172.21.15.154:0/2684678365 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5900d0a50 con 0x7fb59015b130 2023-11-28T06:32:43.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.366+0000 7fb58ffff640 1 --2- 172.21.15.154:0/2684678365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59015b130 0x7fb5900d01f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb59006ede0 tx=0x7fb58002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee3c229ba33688b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.367+0000 7fb58f7fe640 1 -- 172.21.15.154:0/2684678365 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58002e070 con 0x7fb59015b130 2023-11-28T06:32:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.367+0000 7fb58f7fe640 1 -- 172.21.15.154:0/2684678365 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800315a0 con 0x7fb59015b130 2023-11-28T06:32:43.368 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.367+0000 7fb58f7fe640 1 -- 172.21.15.154:0/2684678365 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580031930 con 0x7fb59015b130 2023-11-28T06:32:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 -- 172.21.15.154:0/2684678365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59015b130 msgr2=0x7fb5900d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 --2- 172.21.15.154:0/2684678365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59015b130 0x7fb5900d01f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb59006ede0 tx=0x7fb58002b840 comp rx=0 tx=0).stop 2023-11-28T06:32:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 -- 172.21.15.154:0/2684678365 shutdown_connections 2023-11-28T06:32:43.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 --2- 172.21.15.154:0/2684678365 >> v2:172.21.15.154:3300/0 conn(0x7fb5900cf320 0x7fb5900cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 --2- 172.21.15.154:0/2684678365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59015b130 0x7fb5900d01f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 -- 172.21.15.154:0/2684678365 >> 172.21.15.154:0/2684678365 conn(0x7fb5900b2c10 msgr2=0x7fb5900b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 -- 172.21.15.154:0/2684678365 shutdown_connections 2023-11-28T06:32:43.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.369+0000 7fb59629d640 1 -- 172.21.15.154:0/2684678365 wait complete. 2023-11-28T06:32:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.374+0000 7fb59629d640 1 Processor -- start 2023-11-28T06:32:43.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.374+0000 7fb59629d640 1 -- start start 2023-11-28T06:32:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb59629d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 0x7fb590150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb59629d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 0x7fb59015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb59629d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb59015f760 0x7fb5901f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb59629d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590150b70 con 0x7fb59015b130 2023-11-28T06:32:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb59629d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901f4490 con 0x7fb5900cf320 2023-11-28T06:32:43.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb59629d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901f4770 con 0x7fb59015f760 2023-11-28T06:32:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 0x7fb59015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.378+0000 7fb58ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 0x7fb590150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:43.380 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 0x7fb590150630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:39952/0 (socket says 172.21.15.154:39952) 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 0x7fb59015d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34444/0 (socket says 172.21.15.154:34444) 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 -- 172.21.15.154:0/4194977732 learned_addr learned my addr 172.21.15.154:0/4194977732 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb59483a640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb59015f760 0x7fb5901f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 -- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb59015f760 msgr2=0x7fb5901f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb59015f760 0x7fb5901f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 -- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 msgr2=0x7fb59015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 0x7fb59015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb58ffff640 1 -- 172.21.15.154:0/4194977732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009400 con 0x7fb5900cf320 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb5877fe640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 0x7fb59015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:43.381 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.379+0000 7fb59483a640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb59015f760 0x7fb5901f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:43.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.380+0000 7fb58ffff640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 0x7fb590150630 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb580009890 tx=0x7fb5800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:43.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.380+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580032840 con 0x7fb5900cf320 2023-11-28T06:32:43.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.380+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580031f00 con 0x7fb5900cf320 2023-11-28T06:32:43.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.380+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580032be0 con 0x7fb5900cf320 2023-11-28T06:32:43.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.380+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5901f4a50 con 0x7fb5900cf320 2023-11-28T06:32:43.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.381+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5900c49a0 con 0x7fb5900cf320 2023-11-28T06:32:43.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.383+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590067fc0 con 0x7fb5900cf320 2023-11-28T06:32:43.384 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.383+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb580032d40 con 0x7fb5900cf320 2023-11-28T06:32:43.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.384+0000 7fb58d7fa640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb57006b1c0 0x7fb57006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:43.385 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.385+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb5800ab7d0 con 0x7fb5900cf320 2023-11-28T06:32:43.386 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.385+0000 7fb5877fe640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb57006b1c0 0x7fb57006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:43.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.386+0000 7fb5877fe640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb57006b1c0 0x7fb57006d680 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb590150400 tx=0x7fb578009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:43.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.389+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb5800765e0 con 0x7fb5900cf320 2023-11-28T06:32:43.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:43.913+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb590067420 con 0x7fb5900cf320 2023-11-28T06:32:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.028+0000 7fb58d7fa640 1 -- 172.21.15.154:0/4194977732 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb580079c00 con 0x7fb5900cf320 2023-11-28T06:32:44.029 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_metadata' removed 2023-11-28T06:32:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.045+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb57006b1c0 msgr2=0x7fb57006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.045+0000 7fb59629d640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb57006b1c0 0x7fb57006d680 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb590150400 tx=0x7fb578009040 comp rx=0 tx=0).stop 2023-11-28T06:32:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.045+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 msgr2=0x7fb590150630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:44.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.045+0000 7fb59629d640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 0x7fb590150630 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb580009890 tx=0x7fb5800046c0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.049+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 shutdown_connections 2023-11-28T06:32:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.049+0000 7fb59629d640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb57006b1c0 0x7fb57006d680 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.049+0000 7fb59629d640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb59015f760 0x7fb5901f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.049+0000 7fb59629d640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb59015b130 0x7fb59015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.049+0000 7fb59629d640 1 --2- 172.21.15.154:0/4194977732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5900cf320 0x7fb590150630 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.050+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 >> 172.21.15.154:0/4194977732 conn(0x7fb5900b2c10 msgr2=0x7fb5900733b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.050+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 shutdown_connections 2023-11-28T06:32:44.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.053+0000 7fb59629d640 1 -- 172.21.15.154:0/4194977732 wait complete. 2023-11-28T06:32:44.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T06:32:44.587 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.586+0000 7f32e1d6f640 1 Processor -- start 2023-11-28T06:32:44.589 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.586+0000 7f32e1d6f640 1 -- start start 2023-11-28T06:32:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.590+0000 7f32e1d6f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f32d4050160 0x7f32d4054230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.590+0000 7f32e1d6f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d40df350 0x7f32d4038280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.590+0000 7f32e1d6f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d4006860 con 0x7f32d400aa60 2023-11-28T06:32:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.590+0000 7f32e1d6f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d4007730 con 0x7f32d4050160 2023-11-28T06:32:44.592 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.590+0000 7f32e1d6f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4006ab0 con 0x7f32d40df350 2023-11-28T06:32:44.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.591+0000 7f32e0d6d640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f32d400aa60 0x7f32d404fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:49978/0 (socket says 172.21.15.154:49978) 2023-11-28T06:32:44.593 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.592+0000 7f32e0d6d640 1 -- 172.21.15.154:0/1557277932 learned_addr learned my addr 172.21.15.154:0/1557277932 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:44.594 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.592+0000 7f32e156e640 1 --2- 172.21.15.154:0/1557277932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d40df350 0x7f32d4038280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:44.595 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.592+0000 7f32dbfff640 1 --2- 172.21.15.154:0/1557277932 >> v2:172.21.15.154:3300/0 conn(0x7f32d4050160 0x7f32d4054230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:44.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.593+0000 7f32e156e640 1 -- 172.21.15.154:0/1557277932 >> v2:172.21.15.154:3300/0 conn(0x7f32d4050160 msgr2=0x7f32d4054230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:44.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.593+0000 7f32e156e640 1 --2- 172.21.15.154:0/1557277932 >> v2:172.21.15.154:3300/0 conn(0x7f32d4050160 0x7f32d4054230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.593+0000 7f32e156e640 1 -- 172.21.15.154:0/1557277932 >> v1:172.21.15.154:6789/0 conn(0x7f32d400aa60 legacy=0x7f32d404fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:44.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.594+0000 7f32e156e640 1 -- 172.21.15.154:0/1557277932 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4006d90 con 0x7f32d40df350 2023-11-28T06:32:44.596 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.594+0000 7f32dbfff640 1 --2- 172.21.15.154:0/1557277932 >> v2:172.21.15.154:3300/0 conn(0x7f32d4050160 0x7f32d4054230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:44.599 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.598+0000 7f32e156e640 1 --2- 172.21.15.154:0/1557277932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d40df350 0x7f32d4038280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f32d00097a0 tx=0x7f32d002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=725cd8d511cd6a1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:44.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.600+0000 7f32db7fe640 1 -- 172.21.15.154:0/1557277932 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0030610 con 0x7f32d40df350 2023-11-28T06:32:44.601 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.600+0000 7f32db7fe640 1 -- 172.21.15.154:0/1557277932 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d0030770 con 0x7f32d40df350 2023-11-28T06:32:44.602 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.600+0000 7f32db7fe640 1 -- 172.21.15.154:0/1557277932 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d0030b40 con 0x7f32d40df350 2023-11-28T06:32:44.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.603+0000 7f32e1d6f640 1 -- 172.21.15.154:0/1557277932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d40df350 msgr2=0x7f32d4038280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:44.604 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.603+0000 7f32e1d6f640 1 --2- 172.21.15.154:0/1557277932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d40df350 0x7f32d4038280 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f32d00097a0 tx=0x7f32d002b960 comp rx=0 tx=0).stop 2023-11-28T06:32:44.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.604+0000 7f32e1d6f640 1 -- 172.21.15.154:0/1557277932 shutdown_connections 2023-11-28T06:32:44.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.604+0000 7f32e1d6f640 1 --2- 172.21.15.154:0/1557277932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d40df350 0x7f32d4038280 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.604+0000 7f32e1d6f640 1 --2- 172.21.15.154:0/1557277932 >> v2:172.21.15.154:3300/0 conn(0x7f32d4050160 0x7f32d4054230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.605 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.605+0000 7f32e1d6f640 1 -- 172.21.15.154:0/1557277932 >> 172.21.15.154:0/1557277932 conn(0x7f32d4009f70 msgr2=0x7f32d400a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:44.615 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.613+0000 7f32e1d6f640 1 -- 172.21.15.154:0/1557277932 shutdown_connections 2023-11-28T06:32:44.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.615+0000 7f32e1d6f640 1 -- 172.21.15.154:0/1557277932 wait complete. 2023-11-28T06:32:44.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.621+0000 7f32e1d6f640 1 Processor -- start 2023-11-28T06:32:44.624 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.623+0000 7f32e1d6f640 1 -- start start 2023-11-28T06:32:44.629 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.629+0000 7f32e1d6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32d400aa60 0x7f32d404bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32e1d6f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 0x7f32d40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32e1d6f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32d40df350 0x7f32d4039450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:44.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 0x7f32d40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:44.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32dbfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 0x7f32d40d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:60810/0 (socket says 172.21.15.154:60810) 2023-11-28T06:32:44.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32dbfff640 1 -- 172.21.15.154:0/830869030 learned_addr learned my addr 172.21.15.154:0/830869030 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32e156e640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32d40df350 0x7f32d4039450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32e1d6f640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4047b70 con 0x7f32d400aa60 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32e1d6f640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d404c090 con 0x7f32d40df350 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.632+0000 7f32e1d6f640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40383b0 con 0x7f32d4050160 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.633+0000 7f32e0d6d640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32d400aa60 0x7f32d404bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.637+0000 7f32dbfff640 1 -- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32d40df350 msgr2=0x7f32d4039450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.637+0000 7f32dbfff640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32d40df350 0x7f32d4039450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.642 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.637+0000 7f32dbfff640 1 -- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32d400aa60 msgr2=0x7f32d404bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:44.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.637+0000 7f32dbfff640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32d400aa60 0x7f32d404bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:44.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.637+0000 7f32dbfff640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d0009400 con 0x7f32d4050160 2023-11-28T06:32:44.643 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.641+0000 7f32dbfff640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 0x7f32d40d0fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c820 tx=0x7f32c800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:44.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.646+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c80079d0 con 0x7f32d4050160 2023-11-28T06:32:44.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.646+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c8007b30 con 0x7f32d4050160 2023-11-28T06:32:44.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.648+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c8007ea0 con 0x7f32d4050160 2023-11-28T06:32:44.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.648+0000 7f32e1d6f640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d4038690 con 0x7f32d4050160 2023-11-28T06:32:44.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.649+0000 7f32e1d6f640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d4038c50 con 0x7f32d4050160 2023-11-28T06:32:44.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.656+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f32c80113f0 con 0x7f32d4050160 2023-11-28T06:32:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.658+0000 7f32d97fa640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f32c006b290 0x7f32c006d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.658+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b4005250 con 0x7f32d4050160 2023-11-28T06:32:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.659+0000 7f32e0d6d640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f32c006b290 0x7f32c006d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.659+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f32c8089910 con 0x7f32d4050160 2023-11-28T06:32:44.667 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.664+0000 7f32e0d6d640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f32c006b290 0x7f32c006d750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000b60 tx=0x7f32dc06d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:44.675 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:44.670+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f32c801f080 con 0x7f32d4050160 2023-11-28T06:32:45.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:45.423+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32b4005500 con 0x7f32d4050160 2023-11-28T06:32:46.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.068+0000 7f32d97fa640 1 -- 172.21.15.154:0/830869030 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f32c80548c0 con 0x7f32d4050160 2023-11-28T06:32:46.070 INFO:teuthology.orchestra.run.smithi154.stderr:pool 'cephfs_data' removed 2023-11-28T06:32:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.075+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f32c006b290 msgr2=0x7f32c006d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.075+0000 7f32c6ffd640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f32c006b290 0x7f32c006d750 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000b60 tx=0x7f32dc06d040 comp rx=0 tx=0).stop 2023-11-28T06:32:46.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.075+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 msgr2=0x7f32d40d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.075+0000 7f32c6ffd640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 0x7f32d40d0fb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c820 tx=0x7f32c800cc20 comp rx=0 tx=0).stop 2023-11-28T06:32:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.076+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 shutdown_connections 2023-11-28T06:32:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.076+0000 7f32c6ffd640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32d40df350 0x7f32d4039450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.077 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.076+0000 7f32c6ffd640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f32c006b290 0x7f32c006d750 secure :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f32dc000b60 tx=0x7f32dc06d040 comp rx=0 tx=0).stop 2023-11-28T06:32:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.076+0000 7f32c6ffd640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f32d4050160 0x7f32d40d0fb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.076+0000 7f32c6ffd640 1 --2- 172.21.15.154:0/830869030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32d400aa60 0x7f32d404bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.078 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.076+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 >> 172.21.15.154:0/830869030 conn(0x7f32d4009f70 msgr2=0x7f32d40de640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:46.091 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.090+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 shutdown_connections 2023-11-28T06:32:46.093 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.092+0000 7f32c6ffd640 1 -- 172.21.15.154:0/830869030 wait complete. 2023-11-28T06:32:46.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T06:32:46.677 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.676+0000 7f3e0ac1d640 1 Processor -- start 2023-11-28T06:32:46.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.678+0000 7f3e0ac1d640 1 -- start start 2023-11-28T06:32:46.684 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.682+0000 7f3e0ac1d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e040b40b0 0x7f3e040b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:46.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e0ac1d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3e040b2490 0x7f3e040b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:46.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e0ac1d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e040cd020 con 0x7f3e04159210 2023-11-28T06:32:46.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e03fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e040b40b0 0x7f3e040b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:46.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e03fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3e040b40b0 0x7f3e040b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34456/0 (socket says 172.21.15.154:34456) 2023-11-28T06:32:46.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e03fff640 1 -- 172.21.15.154:0/2172740594 learned_addr learned my addr 172.21.15.154:0/2172740594 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:46.685 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e040b4a70 con 0x7f3e040b40b0 2023-11-28T06:32:46.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e040cd300 con 0x7f3e040b2490 2023-11-28T06:32:46.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.683+0000 7f3e089b9640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3e04159210 0x7f3e0415a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53492/0 (socket says 172.21.15.154:53492) 2023-11-28T06:32:46.686 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.684+0000 7f3e091ba640 1 --2- 172.21.15.154:0/2172740594 >> v2:172.21.15.194:3300/0 conn(0x7f3e040b2490 0x7f3e040b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:46.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.686+0000 7f3e03fff640 1 -- 172.21.15.154:0/2172740594 >> v2:172.21.15.194:3300/0 conn(0x7f3e040b2490 msgr2=0x7f3e040b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:46.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.686+0000 7f3e03fff640 1 --2- 172.21.15.154:0/2172740594 >> v2:172.21.15.194:3300/0 conn(0x7f3e040b2490 0x7f3e040b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.686+0000 7f3e03fff640 1 -- 172.21.15.154:0/2172740594 >> v1:172.21.15.194:6789/0 conn(0x7f3e04159210 legacy=0x7f3e0415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:46.690 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.687+0000 7f3e03fff640 1 -- 172.21.15.154:0/2172740594 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e040cd5e0 con 0x7f3e040b40b0 2023-11-28T06:32:46.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.691+0000 7f3e03fff640 1 --2- 172.21.15.154:0/2172740594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e040b4530 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f3e040aeb20 tx=0x7f3df402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4086cdfaa26002b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:46.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.692+0000 7f3e037fe640 1 -- 172.21.15.154:0/2172740594 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4031870 con 0x7f3e040b40b0 2023-11-28T06:32:46.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.692+0000 7f3e037fe640 1 -- 172.21.15.154:0/2172740594 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df40319d0 con 0x7f3e040b40b0 2023-11-28T06:32:46.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.692+0000 7f3e037fe640 1 -- 172.21.15.154:0/2172740594 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4031d60 con 0x7f3e040b40b0 2023-11-28T06:32:46.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.694+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 msgr2=0x7f3e040b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:46.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.694+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/2172740594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e040b4530 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f3e040aeb20 tx=0x7f3df402b910 comp rx=0 tx=0).stop 2023-11-28T06:32:46.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.699+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 shutdown_connections 2023-11-28T06:32:46.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.699+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/2172740594 >> v2:172.21.15.194:3300/0 conn(0x7f3e040b2490 0x7f3e040b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.699+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/2172740594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e040b4530 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.699+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 >> 172.21.15.154:0/2172740594 conn(0x7f3e040b0d60 msgr2=0x7f3e040b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:46.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.714+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 shutdown_connections 2023-11-28T06:32:46.715 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.714+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/2172740594 wait complete. 2023-11-28T06:32:46.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.719+0000 7f3e0ac1d640 1 Processor -- start 2023-11-28T06:32:46.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.737+0000 7f3e0ac1d640 1 -- start start 2023-11-28T06:32:46.742 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.742+0000 7f3e0ac1d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e040b2490 0x7f3e04157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:46.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.745+0000 7f3e0ac1d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e0415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:46.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.746+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e0415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:46.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.746+0000 7f3e03fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e0415ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34464/0 (socket says 172.21.15.154:34464) 2023-11-28T06:32:46.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.746+0000 7f3e03fff640 1 -- 172.21.15.154:0/41971834 learned_addr learned my addr 172.21.15.154:0/41971834 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:46.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.746+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e04159210 0x7f3e0415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:46.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.747+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0415aa80 con 0x7f3e040b40b0 2023-11-28T06:32:46.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.747+0000 7f3e091ba640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e04159210 0x7f3e0415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:46.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.747+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0415c160 con 0x7f3e04159210 2023-11-28T06:32:46.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.747+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0415b8c0 con 0x7f3e040b2490 2023-11-28T06:32:46.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.747+0000 7f3e089b9640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e040b2490 0x7f3e04157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:46.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.752+0000 7f3e03fff640 1 -- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e040b2490 msgr2=0x7f3e04157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:46.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.752+0000 7f3e03fff640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e040b2490 0x7f3e04157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.752+0000 7f3e03fff640 1 -- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e04159210 msgr2=0x7f3e0415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:46.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.752+0000 7f3e03fff640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e04159210 0x7f3e0415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:46.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.752+0000 7f3e03fff640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40094d0 con 0x7f3e040b40b0 2023-11-28T06:32:46.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.754+0000 7f3e03fff640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e0415ad50 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009960 tx=0x7f3df40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:46.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.755+0000 7f3e091ba640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e04159210 0x7f3e0415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.756+0000 7f3e089b9640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e040b2490 0x7f3e04157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T06:32:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.756+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df40443f0 con 0x7f3e040b40b0 2023-11-28T06:32:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.756+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df4044550 con 0x7f3e040b40b0 2023-11-28T06:32:46.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.757+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0415bba0 con 0x7f3e040b40b0 2023-11-28T06:32:46.765 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.764+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e040aaef0 con 0x7f3e040b40b0 2023-11-28T06:32:46.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.765+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4044900 con 0x7f3e040b40b0 2023-11-28T06:32:46.769 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.768+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f3df4044ae0 con 0x7f3e040b40b0 2023-11-28T06:32:46.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.770+0000 7f3e017fa640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3df006b310 0x7f3df006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:46.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.771+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3df402d040 con 0x7f3e040b40b0 2023-11-28T06:32:46.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.772+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4005250 con 0x7f3e040b40b0 2023-11-28T06:32:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.773+0000 7f3e089b9640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3df006b310 0x7f3df006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:46.778 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.775+0000 7f3e089b9640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3df006b310 0x7f3df006d7d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc007fd0 tx=0x7f3dfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:46.800 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:46.799+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f3df4077040 con 0x7f3e040b40b0 2023-11-28T06:32:47.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.896+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3de4005a80 con 0x7f3e040b40b0 2023-11-28T06:32:47.918 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.911+0000 7f3e017fa640 1 -- 172.21.15.154:0/41971834 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3df4035070 con 0x7f3e040b40b0 2023-11-28T06:32:47.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.920+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3df006b310 msgr2=0x7f3df006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:47.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.920+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3df006b310 0x7f3df006d7d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc007fd0 tx=0x7f3dfc009040 comp rx=0 tx=0).stop 2023-11-28T06:32:47.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.921+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 msgr2=0x7f3e0415ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:47.922 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.921+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e0415ad50 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009960 tx=0x7f3df40046c0 comp rx=0 tx=0).stop 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.921+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 shutdown_connections 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.921+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e04159210 0x7f3e0415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.921+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f3df006b310 0x7f3df006d7d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.922+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e040b40b0 0x7f3e0415ad50 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.922+0000 7f3e0ac1d640 1 --2- 172.21.15.154:0/41971834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3e040b2490 0x7f3e04157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.922+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 >> 172.21.15.154:0/41971834 conn(0x7f3e040b0d60 msgr2=0x7f3e0406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.922+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 shutdown_connections 2023-11-28T06:32:47.923 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:47.922+0000 7f3e0ac1d640 1 -- 172.21.15.154:0/41971834 wait complete. 2023-11-28T06:32:47.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-28T06:32:48.469 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.468+0000 7fde3ca02640 1 Processor -- start 2023-11-28T06:32:48.472 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.468+0000 7fde3ca02640 1 -- start start 2023-11-28T06:32:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.472+0000 7fde3ca02640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 0x7fde38162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.472+0000 7fde3ca02640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde380b48c0 0x7fde3806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.472+0000 7fde3ca02640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3806eab0 con 0x7fde380b4d20 2023-11-28T06:32:48.474 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.472+0000 7fde3ca02640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde380b34c0 con 0x7fde3815b9b0 2023-11-28T06:32:48.475 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.472+0000 7fde3ca02640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde38162080 con 0x7fde380b48c0 2023-11-28T06:32:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.473+0000 7fde36d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 0x7fde38162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.473+0000 7fde36d9d640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 0x7fde38162510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55256/0 (socket says 172.21.15.154:55256) 2023-11-28T06:32:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.473+0000 7fde3659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde380b48c0 0x7fde3806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:48.476 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.473+0000 7fde36d9d640 1 -- 172.21.15.154:0/3411471605 learned_addr learned my addr 172.21.15.154:0/3411471605 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.474+0000 7fde3659c640 1 -- 172.21.15.154:0/3411471605 >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 msgr2=0x7fde38162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.475+0000 7fde3659c640 1 --2- 172.21.15.154:0/3411471605 >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 0x7fde38162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.475+0000 7fde3659c640 1 -- 172.21.15.154:0/3411471605 >> v1:172.21.15.154:6789/0 conn(0x7fde380b4d20 legacy=0x7fde380addc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T06:32:48.481 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.475+0000 7fde3659c640 1 -- 172.21.15.154:0/3411471605 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380b2c60 con 0x7fde380b48c0 2023-11-28T06:32:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.478+0000 7fde36d9d640 1 --2- 172.21.15.154:0/3411471605 >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 0x7fde38162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:48.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.479+0000 7fde3659c640 1 --2- 172.21.15.154:0/3411471605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde380b48c0 0x7fde3806a4d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde30009d90 tx=0x7fde3002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955973c3f21b2765 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.485+0000 7fde35d9b640 1 -- 172.21.15.154:0/3411471605 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3002cbf0 con 0x7fde380b48c0 2023-11-28T06:32:48.488 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.485+0000 7fde35d9b640 1 -- 172.21.15.154:0/3411471605 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3002cd50 con 0x7fde380b48c0 2023-11-28T06:32:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.488+0000 7fde3ca02640 1 -- 172.21.15.154:0/3411471605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde380b48c0 msgr2=0x7fde3806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:48.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.488+0000 7fde3ca02640 1 --2- 172.21.15.154:0/3411471605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde380b48c0 0x7fde3806a4d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde30009d90 tx=0x7fde3002be40 comp rx=0 tx=0).stop 2023-11-28T06:32:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.522+0000 7fde3ca02640 1 -- 172.21.15.154:0/3411471605 shutdown_connections 2023-11-28T06:32:48.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.522+0000 7fde3ca02640 1 --2- 172.21.15.154:0/3411471605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde380b48c0 0x7fde3806a4d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.522+0000 7fde3ca02640 1 --2- 172.21.15.154:0/3411471605 >> v2:172.21.15.154:3300/0 conn(0x7fde3815b9b0 0x7fde38162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:48.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.522+0000 7fde3ca02640 1 -- 172.21.15.154:0/3411471605 >> 172.21.15.154:0/3411471605 conn(0x7fde3806b5e0 msgr2=0x7fde3806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:48.532 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.531+0000 7fde3ca02640 1 -- 172.21.15.154:0/3411471605 shutdown_connections 2023-11-28T06:32:48.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.533+0000 7fde3ca02640 1 -- 172.21.15.154:0/3411471605 wait complete. 2023-11-28T06:32:48.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.540+0000 7fde3ca02640 1 Processor -- start 2023-11-28T06:32:48.541 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.540+0000 7fde3ca02640 1 -- start start 2023-11-28T06:32:48.544 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.543+0000 7fde3ca02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde380b48c0 0x7fde381539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.543+0000 7fde3ca02640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde380b4d20 0x7fde38153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.543+0000 7fde3ca02640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 0x7fde3815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.543+0000 7fde3ca02640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde38153850 con 0x7fde380b48c0 2023-11-28T06:32:48.545 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.543+0000 7fde3ca02640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde380af020 con 0x7fde380b4d20 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.543+0000 7fde3ca02640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde381540c0 con 0x7fde3815b9b0 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.544+0000 7fde3759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 0x7fde3815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.544+0000 7fde3759e640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 0x7fde3815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:44920/0 (socket says 172.21.15.154:44920) 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.544+0000 7fde3759e640 1 -- 172.21.15.154:0/2122607547 learned_addr learned my addr 172.21.15.154:0/2122607547 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.545+0000 7fde3759e640 1 -- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde380b4d20 msgr2=0x7fde38153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.545+0000 7fde3759e640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde380b4d20 0x7fde38153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.545+0000 7fde3759e640 1 -- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde380b48c0 msgr2=0x7fde381539e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T06:32:48.546 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.545+0000 7fde3759e640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde380b48c0 0x7fde381539e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:48.547 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.545+0000 7fde3759e640 1 -- 172.21.15.154:0/2122607547 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0094d0 con 0x7fde3815b9b0 2023-11-28T06:32:48.550 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.549+0000 7fde3759e640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 0x7fde3815a350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde2800b390 tx=0x7fde2800b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.550+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28011830 con 0x7fde3815b9b0 2023-11-28T06:32:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.550+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde28011990 con 0x7fde3815b9b0 2023-11-28T06:32:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.550+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28011d60 con 0x7fde3815b9b0 2023-11-28T06:32:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.550+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30009a70 con 0x7fde3815b9b0 2023-11-28T06:32:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.550+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde380ae010 con 0x7fde3815b9b0 2023-11-28T06:32:48.555 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.554+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde14005250 con 0x7fde3815b9b0 2023-11-28T06:32:48.561 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.560+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fde2801a400 con 0x7fde3815b9b0 2023-11-28T06:32:48.563 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.562+0000 7fde277fe640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde1c06b290 0x7fde1c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:48.565 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.564+0000 7fde36d9d640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde1c06b290 0x7fde1c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:48.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.565+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fde28089e20 con 0x7fde3815b9b0 2023-11-28T06:32:48.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.566+0000 7fde36d9d640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde1c06b290 0x7fde1c06d750 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fde38163e90 tx=0x7fde2c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:48.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:48.566+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fde2808a200 con 0x7fde3815b9b0 2023-11-28T06:32:50.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:50.240+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fde14005500 con 0x7fde3815b9b0 2023-11-28T06:32:51.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.109+0000 7fde277fe640 1 -- 172.21.15.154:0/2122607547 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v14582) v1 ==== 144+0+0 (secure 0 0 0) 0x7fde280150d0 con 0x7fde3815b9b0 2023-11-28T06:32:51.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.117+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde1c06b290 msgr2=0x7fde1c06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:51.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.117+0000 7fde3ca02640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde1c06b290 0x7fde1c06d750 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fde38163e90 tx=0x7fde2c009240 comp rx=0 tx=0).stop 2023-11-28T06:32:51.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.117+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 msgr2=0x7fde3815a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:51.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.118+0000 7fde3ca02640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 0x7fde3815a350 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde2800b390 tx=0x7fde2800b850 comp rx=0 tx=0).stop 2023-11-28T06:32:51.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.120+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 shutdown_connections 2023-11-28T06:32:51.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.120+0000 7fde3ca02640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde380b4d20 0x7fde38153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:51.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.120+0000 7fde3ca02640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fde1c06b290 0x7fde1c06d750 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:51.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.120+0000 7fde3ca02640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fde3815b9b0 0x7fde3815a350 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:51.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.120+0000 7fde3ca02640 1 --2- 172.21.15.154:0/2122607547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde380b48c0 0x7fde381539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:51.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.120+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 >> 172.21.15.154:0/2122607547 conn(0x7fde3806b5e0 msgr2=0x7fde38159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:51.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.123+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 shutdown_connections 2023-11-28T06:32:51.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:51.124+0000 7fde3ca02640 1 -- 172.21.15.154:0/2122607547 wait complete. 2023-11-28T06:32:51.385 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-11-28T06:32:51.385 INFO:tasks.cephfs_test_runner: 2023-11-28T06:32:51.385 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T06:32:51.385 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner:Ran 1 test in 28958.448s 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner: 2023-11-28T06:32:51.386 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-11-28T06:32:51.387 INFO:tasks.cephfs_test_runner: 2023-11-28T06:32:51.388 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-28T06:32:51.484 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a15cef3b710c4a7f8c764a016c4d21e4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-28T06:32:51.486 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T06:32:51.498 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-28T06:32:51.547 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-28T06:32:51.547 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-28T06:32:51.547 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:51.644 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15520 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248868k,nr_inodes=812217,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T06:32:51.644 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-11-28T06:32:51.644 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:51.705 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056382,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15520 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248868k,nr_inodes=812217,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497744k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-28T06:32:51.705 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-28T06:32:51.706 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:51.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056385,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1730 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248872k,nr_inodes=812218,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T06:32:51.725 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2023-11-28T06:32:51.725 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T06:32:51.784 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056385,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1730 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248872k,nr_inodes=812218,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497748k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-28T06:32:51.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:51.784 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-11-28T06:32:51.914 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T06:32:51.915 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T06:32:51.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:51.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T06:32:52.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:52.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T06:32:52.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:52.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-11-28T06:32:52.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:52.308 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2023-11-28T06:32:52.369 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T06:32:52.369 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T06:32:52.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:52.370 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T06:32:52.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:52.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T06:32:52.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T06:32:52.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2023-11-28T06:32:52.568 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T06:32:52.578 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T06:32:52.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T06:32:53.025 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.024+0000 7fa1a089b640 1 Processor -- start 2023-11-28T06:32:53.026 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.024+0000 7fa1a089b640 1 -- start start 2023-11-28T06:32:53.027 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa1a089b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c150940 0x7fa19c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa1a089b640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0b49f0 con 0x7fa19c150560 2023-11-28T06:32:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa1a089b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0b3560 con 0x7fa19c15dec0 2023-11-28T06:32:53.028 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa1a089b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0b3de0 con 0x7fa19c150940 2023-11-28T06:32:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa19ad9d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa19c15dec0 0x7fa19c0ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:43826/0 (socket says 172.21.15.154:43826) 2023-11-28T06:32:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa19a59c640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa19c150560 0x7fa19c0b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57738/0 (socket says 172.21.15.154:57738) 2023-11-28T06:32:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa19ad9d640 1 -- 172.21.15.154:0/3241992405 learned_addr learned my addr 172.21.15.154:0/3241992405 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:53.029 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.027+0000 7fa193fff640 1 --2- 172.21.15.154:0/3241992405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c150940 0x7fa19c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:53.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.028+0000 7fa193fff640 1 -- 172.21.15.154:0/3241992405 >> v1:172.21.15.194:6789/0 conn(0x7fa19c15dec0 legacy=0x7fa19c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.028+0000 7fa193fff640 1 -- 172.21.15.154:0/3241992405 >> v1:172.21.15.154:6789/0 conn(0x7fa19c150560 legacy=0x7fa19c0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.030 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.028+0000 7fa193fff640 1 -- 172.21.15.154:0/3241992405 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0b40c0 con 0x7fa19c150940 2023-11-28T06:32:53.032 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.031+0000 7fa193fff640 1 --2- 172.21.15.154:0/3241992405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c150940 0x7fa19c15d200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1840097d0 tx=0x7fa18402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5e5a3ab9735c6b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:53.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.032+0000 7fa199d9b640 1 -- 172.21.15.154:0/3241992405 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184030610 con 0x7fa19c150940 2023-11-28T06:32:53.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.032+0000 7fa199d9b640 1 -- 172.21.15.154:0/3241992405 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184030770 con 0x7fa19c150940 2023-11-28T06:32:53.033 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.032+0000 7fa199d9b640 1 -- 172.21.15.154:0/3241992405 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184030b00 con 0x7fa19c150940 2023-11-28T06:32:53.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 -- 172.21.15.154:0/3241992405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c150940 msgr2=0x7fa19c15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3241992405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c150940 0x7fa19c15d200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1840097d0 tx=0x7fa18402b960 comp rx=0 tx=0).stop 2023-11-28T06:32:53.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 -- 172.21.15.154:0/3241992405 shutdown_connections 2023-11-28T06:32:53.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3241992405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c150940 0x7fa19c15d200 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 -- 172.21.15.154:0/3241992405 >> 172.21.15.154:0/3241992405 conn(0x7fa19c06a4d0 msgr2=0x7fa19c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:53.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 -- 172.21.15.154:0/3241992405 shutdown_connections 2023-11-28T06:32:53.036 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.034+0000 7fa1a089b640 1 -- 172.21.15.154:0/3241992405 wait complete. 2023-11-28T06:32:53.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.040+0000 7fa1a089b640 1 Processor -- start 2023-11-28T06:32:53.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.040+0000 7fa1a089b640 1 -- start start 2023-11-28T06:32:53.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.043+0000 7fa1a089b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 0x7fa19c16abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:53.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.043+0000 7fa1a089b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15dec0 0x7fa19c132ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:53.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa1a089b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c140460 0x7fa19c133010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:53.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa1a089b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c16b430 con 0x7fa19c140460 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa19a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 0x7fa19c16abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa193fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15dec0 0x7fa19c132ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa19a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 0x7fa19c16abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:41416/0 (socket says 172.21.15.154:41416) 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa19a59c640 1 -- 172.21.15.154:0/3579021570 learned_addr learned my addr 172.21.15.154:0/3579021570 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa19ad9d640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c140460 0x7fa19c133010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c158530 con 0x7fa19c150560 2023-11-28T06:32:53.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.044+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c157c00 con 0x7fa19c15dec0 2023-11-28T06:32:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.045+0000 7fa19a59c640 1 -- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15dec0 msgr2=0x7fa19c132ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.045+0000 7fa19a59c640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15dec0 0x7fa19c132ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.045+0000 7fa19a59c640 1 -- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c140460 msgr2=0x7fa19c133010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.045+0000 7fa19a59c640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c140460 0x7fa19c133010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.045+0000 7fa19a59c640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184009400 con 0x7fa19c150560 2023-11-28T06:32:53.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.045+0000 7fa193fff640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15dec0 0x7fa19c132ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.046+0000 7fa19a59c640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 0x7fa19c16abe0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00c3e0 tx=0x7fa18c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.046+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0074e0 con 0x7fa19c150560 2023-11-28T06:32:53.049 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.047+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c007640 con 0x7fa19c150560 2023-11-28T06:32:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.047+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c157ee0 con 0x7fa19c150560 2023-11-28T06:32:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.047+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c0049e0 con 0x7fa19c150560 2023-11-28T06:32:53.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.047+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c16b120 con 0x7fa19c150560 2023-11-28T06:32:53.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.050+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c1586a0 con 0x7fa19c150560 2023-11-28T06:32:53.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.052+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa18c004b40 con 0x7fa19c150560 2023-11-28T06:32:53.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.053+0000 7fa192ffd640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa17c06b1c0 0x7fa17c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:53.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.053+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa18c088f00 con 0x7fa19c150560 2023-11-28T06:32:53.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.053+0000 7fa193fff640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa17c06b1c0 0x7fa17c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:53.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.054+0000 7fa193fff640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa17c06b1c0 0x7fa17c06d680 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa184036000 tx=0x7fa184008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:53.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.057+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa18c054070 con 0x7fa19c150560 2023-11-28T06:32:53.716 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.715+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa19c157d70 con 0x7fa17c06b1c0 2023-11-28T06:32:53.728 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.727+0000 7fa192ffd640 1 -- 172.21.15.154:0/3579021570 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49453 (secure 0 0 0) 0x7fa19c157d70 con 0x7fa17c06b1c0 2023-11-28T06:32:53.729 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:53.729 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-28T06:32:53.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa17c06b1c0 msgr2=0x7fa17c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.733 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa17c06b1c0 0x7fa17c06d680 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa184036000 tx=0x7fa184008030 comp rx=0 tx=0).stop 2023-11-28T06:32:53.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 msgr2=0x7fa19c16abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:53.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 0x7fa19c16abe0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00c3e0 tx=0x7fa18c00c8a0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 shutdown_connections 2023-11-28T06:32:53.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa17c06b1c0 0x7fa17c06d680 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa19c140460 0x7fa19c133010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.734 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa19c15dec0 0x7fa19c132ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 --2- 172.21.15.154:0/3579021570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa19c150560 0x7fa19c16abe0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:53.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 >> 172.21.15.154:0/3579021570 conn(0x7fa19c06a4d0 msgr2=0x7fa19c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:53.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 shutdown_connections 2023-11-28T06:32:53.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:53.732+0000 7fa1a089b640 1 -- 172.21.15.154:0/3579021570 wait complete. 2023-11-28T06:32:53.766 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":14528,"stamp":"2023-11-28T06:32:52.077876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":18962608,"kb_used_data":6478928,"kb_used_omap":7985,"kb_used_meta":12346958,"kb_avail":736012112,"statfs":{"total":773094113280,"available":753676402688,"internally_reserved":0,"allocated":6634422272,"data_stored":6619088761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8177315,"internal_metadata":12643285341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":694,"apply_latency_ms":694,"commit_latency_ns":694000000,"apply_latency_ns":694000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31389174013,"num_objects":-26328,"num_object_clones":0,"num_object_copies":-52656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26328,"num_whiteouts":0,"num_read":-2163906,"num_read_kb":-147487704,"num_write":-6623628,"num_write_kb":-170073247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.051800"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T06:32:44.517193+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-28T06:32:44.517193+0000","last_peered":"2023-11-28T06:32:44.517193+0000","last_clean":"2023-11-28T06:32:44.517193+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-28T06:32:44.517193+0000","last_undegraded":"2023-11-28T06:32:44.517193+0000","last_fullsized":"2023-11-28T06:32:44.517193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580652,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1609136,"kb_used_data":1000,"kb_used_omap":582,"kb_used_meta":1607545,"kb_avail":92762704,"statfs":{"total":96636764160,"available":94989008896,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596775,"internal_metadata":1646126297},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.611,"15min":1.3600000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.36399999999999999},"max":{"1min":13.365,"5min":13.487,"15min":13.487},"last":1.786},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.538,"15min":1.3420000000000001},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.46999999999999997},"max":{"1min":7.4039999999999999,"5min":13.518000000000001,"15min":13.518000000000001},"last":1.827}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.0459999999999998,"15min":1.8029999999999999},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":31.065999999999999,"5min":31.065999999999999,"15min":31.065999999999999},"last":0.504},{"interface":"front","average":{"1min":3.1589999999999998,"5min":2.3730000000000002,"15min":1.8240000000000001},"min":{"1min":0.63700000000000001,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":27.765000000000001,"5min":27.765000000000001,"15min":27.765000000000001},"last":0.94599999999999995}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":1.794,"15min":1.458},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":15.462999999999999,"5min":15.462999999999999,"15min":15.462999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":2.7879999999999998,"5min":1.9590000000000001,"15min":1.6519999999999999},"min":{"1min":0.48599999999999999,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":23.225999999999999,"5min":23.225999999999999,"15min":23.225999999999999},"last":1.363}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7070000000000001,"15min":1.7010000000000001},"min":{"1min":0.497,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":6.3869999999999996,"5min":10.574,"15min":11.516},"last":0.495},{"interface":"front","average":{"1min":1.929,"5min":2.4420000000000002,"15min":2.0070000000000001},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":13.446,"5min":13.446,"15min":18.081},"last":0.72199999999999998}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.499,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":10.872,"5min":10.872,"15min":10.872},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.51600000000000001,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.26300000000000001},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.9569999999999999},"last":0.33600000000000002}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":8.8109999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.669,"5min":0.66400000000000003,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.30399999999999999,"15min":0.26300000000000001},"max":{"1min":21.373000000000001,"5min":21.373000000000001,"15min":21.373000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.52500000000000002,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":6.2009999999999996},"last":0.437},{"interface":"front","average":{"1min":0.875,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":6.7359999999999998,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":0.375}]}]},{"osd":6,"up_from":13,"seq":55834580652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1601644,"kb_used_data":420,"kb_used_omap":212,"kb_used_meta":1601003,"kb_avail":92770196,"statfs":{"total":96636764160,"available":94996680704,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217819,"internal_metadata":1639427365},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.5900000000000001,"15min":1.296},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":5.4939999999999998,"5min":24.896999999999998,"15min":24.896999999999998},"last":0.622},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.0870000000000002,"15min":1.5760000000000001},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.39200000000000002},"max":{"1min":11.02,"5min":37.939,"15min":37.939},"last":0.73099999999999998}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.8100000000000001,"15min":1.645},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":10.977,"5min":10.977,"15min":11.359999999999999},"last":3.121},{"interface":"front","average":{"1min":4.3490000000000002,"5min":2.1859999999999999,"15min":1.796},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":37.594999999999999,"5min":37.594999999999999,"15min":37.594999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":1.742,"15min":1.599},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":15.630000000000001,"5min":15.630000000000001,"15min":15.630000000000001},"last":9.6799999999999997},{"interface":"front","average":{"1min":2.75,"5min":1.9299999999999999,"15min":1.6100000000000001},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.42699999999999999},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":3.4199999999999999}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":1.9970000000000001,"15min":1.6699999999999999},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"max":{"1min":12.163,"5min":15.5,"15min":15.5},"last":22.184000000000001},{"interface":"front","average":{"1min":2.488,"5min":2.8959999999999999,"15min":1.8839999999999999},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":13.254,"5min":50.070999999999998,"15min":50.070999999999998},"last":1.399}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.68999999999999995,"15min":0.46100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.246},"max":{"1min":1.135,"5min":25.050999999999998,"15min":25.050999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.58599999999999997,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":12.782,"5min":12.782,"15min":12.782},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.998,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.75900000000000001,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.49399999999999999,"5min":24.937999999999999,"15min":24.937999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.627,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.49199999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834580652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1766828,"kb_used_data":420,"kb_used_omap":725,"kb_used_meta":1765674,"kb_avail":92605012,"statfs":{"total":96636764160,"available":94827532288,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":742844,"internal_metadata":1808050756},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.385,"15min":1.175},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.38},"max":{"1min":10.455,"5min":10.455,"15min":10.455},"last":2.544},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.264,"15min":1.2190000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":10.053000000000001,"5min":10.053000000000001,"15min":10.053000000000001},"last":1.103}]},{"osd":1,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":2.1549999999999998,"5min":1.5409999999999999,"15min":1.4930000000000001},"min":{"1min":0.46899999999999997,"5min":0.41899999999999998,"15min":0.36799999999999999},"max":{"1min":10.116,"5min":10.116,"15min":12.682},"last":0.55500000000000005},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.504,"15min":1.413},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.2389999999999999,"5min":9.9830000000000005,"15min":24.847999999999999},"last":2.7679999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":3.883,"5min":2.1299999999999999,"15min":1.7190000000000001},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":27.013999999999999,"5min":27.013999999999999,"15min":27.013999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6339999999999999,"15min":1.347},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":10.146000000000001,"5min":10.146000000000001,"15min":12.281000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2759999999999998,"5min":1.827,"15min":1.819},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":7.6630000000000003,"5min":10.638,"15min":16.055},"last":0.80700000000000005},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.9950000000000001,"15min":1.76},"min":{"1min":0.56000000000000005,"5min":0.45500000000000002,"15min":0.41799999999999998},"max":{"1min":14.384,"5min":14.384,"15min":14.384},"last":6.7190000000000003}]},{"osd":4,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.40500000000000003,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.249,"15min":0.24199999999999999},"max":{"1min":5.2110000000000003,"5min":5.2110000000000003,"15min":5.2110000000000003},"last":0.496},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.38500000000000001,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":0.44},{"interface":"front","average":{"1min":1.141,"5min":0.56499999999999995,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26500000000000001},"max":{"1min":14.951000000000001,"5min":14.951000000000001,"15min":14.951000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.47499999999999998,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.316,"15min":0.316},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.48299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834580650,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1589932,"kb_used_data":420,"kb_used_omap":1298,"kb_used_meta":1588205,"kb_avail":92781908,"statfs":{"total":96636764160,"available":95008673792,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1330133,"internal_metadata":1626321963},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.3779999999999999,"15min":1.214},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":3.1080000000000001,"5min":10.359999999999999,"15min":10.542},"last":3.9849999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.5600000000000001,"15min":1.2310000000000001},"min":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.40899999999999997},"max":{"1min":11.694000000000001,"5min":12.416,"15min":12.416},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":2.1960000000000002,"15min":1.7889999999999999},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":28.722999999999999,"5min":28.722999999999999,"15min":28.722999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":3.0539999999999998,"5min":2.016,"15min":1.671},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.40100000000000002},"max":{"1min":27.699000000000002,"5min":27.699000000000002,"15min":27.699000000000002},"last":3.8439999999999999}]},{"osd":2,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.5649999999999999,"15min":1.4350000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42499999999999999},"max":{"1min":13.481999999999999,"5min":13.481999999999999,"15min":13.481999999999999},"last":8.7910000000000004},{"interface":"front","average":{"1min":2.2589999999999999,"5min":1.6619999999999999,"15min":1.4770000000000001},"min":{"1min":0.51500000000000001,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":7.992,"5min":9.9149999999999991,"15min":11.736000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.8440000000000001,"15min":1.71},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.40100000000000002},"max":{"1min":11.721,"5min":12.382,"15min":12.382},"last":8.9860000000000007},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.2280000000000002,"15min":1.9259999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.39300000000000002},"max":{"1min":12.007999999999999,"5min":12.007999999999999,"15min":13.673999999999999},"last":9.3480000000000008}]},{"osd":5,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.1359999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.374},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.621,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":11.664,"5min":12.446999999999999,"15min":12.446999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.51400000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":11.507999999999999,"5min":11.507999999999999,"15min":11.507999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.53900000000000003,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70499999999999996,"15min":0.52900000000000003},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":11.629,"5min":12.336,"15min":12.336},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.56299999999999994,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":11.471,"5min":11.471,"15min":11.471},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834580478,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2358196,"kb_used_data":507188,"kb_used_omap":1855,"kb_used_meta":1753408,"kb_avail":92013644,"statfs":{"total":96636764160,"available":94221971456,"internally_reserved":0,"allocated":519360512,"data_stored":518072644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1899643,"internal_metadata":1795490693},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":3.544,"15min":3.3690000000000002},"min":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54100000000000004},"max":{"1min":29.311,"5min":29.311,"15min":29.311},"last":4.1230000000000002},{"interface":"front","average":{"1min":3.6379999999999999,"5min":3.5030000000000001,"15min":3.3599999999999999},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.56299999999999994},"max":{"1min":20.762,"5min":21.399999999999999,"15min":21.399999999999999},"last":3.8570000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.7090000000000001,"5min":4.0350000000000001,"15min":3.4969999999999999},"min":{"1min":0.625,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":11.140000000000001,"5min":20.879999999999999,"15min":20.879999999999999},"last":5.4729999999999999},{"interface":"front","average":{"1min":4.9059999999999997,"5min":5.3449999999999998,"15min":4.2279999999999998},"min":{"1min":0.70699999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":29.452999999999999,"5min":48.625999999999998,"15min":48.625999999999998},"last":4.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.859,"5min":4.306,"15min":3.7650000000000001},"min":{"1min":0.93899999999999995,"5min":0.75,"15min":0.66600000000000004},"max":{"1min":25.378,"5min":33.497999999999998,"15min":33.497999999999998},"last":2.766},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.5259999999999998,"15min":3.4700000000000002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65100000000000002},"max":{"1min":11.054,"5min":21.193000000000001,"15min":21.193000000000001},"last":2.661}]},{"osd":4,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.7949999999999999,"15min":2.7570000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55900000000000005},"max":{"1min":9.6820000000000004,"5min":21.931999999999999,"15min":21.931999999999999},"last":1.385},{"interface":"front","average":{"1min":2.544,"5min":3.2669999999999999,"15min":2.839},"min":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.60599999999999998},"max":{"1min":10.705,"5min":21.013999999999999,"15min":21.013999999999999},"last":1.724}]},{"osd":5,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":3.5209999999999999,"15min":3.0129999999999999},"min":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.69499999999999995},"max":{"1min":10.881,"5min":21.344000000000001,"15min":21.344000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":2.2389999999999999,"5min":2.9769999999999999,"15min":2.8319999999999999},"min":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":9.4179999999999993,"5min":21.631,"15min":21.631},"last":2.4289999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":3.077,"15min":2.9769999999999999},"min":{"1min":0.84599999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":9.5670000000000002,"5min":21.792000000000002,"15min":21.792000000000002},"last":2.5539999999999998},{"interface":"front","average":{"1min":2.452,"5min":2.9940000000000002,"15min":2.9790000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.72199999999999998},"max":{"1min":9.7729999999999997,"5min":21.838999999999999,"15min":21.838999999999999},"last":1.488}]},{"osd":7,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":3.1309999999999998,"15min":3.0899999999999999},"min":{"1min":0.91600000000000004,"5min":0.89300000000000002,"15min":0.79700000000000004},"max":{"1min":9.8710000000000004,"5min":25.337,"15min":25.337},"last":1.5629999999999999},{"interface":"front","average":{"1min":2.8199999999999998,"5min":3.6779999999999999,"15min":3.246},"min":{"1min":0.94299999999999995,"5min":0.89200000000000002,"15min":0.80700000000000005},"max":{"1min":11.234,"5min":21.274000000000001,"15min":21.274000000000001},"last":1.8}]}]},{"osd":2,"up_from":13,"seq":55834580577,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1737560,"kb_used_data":654288,"kb_used_omap":591,"kb_used_meta":1082672,"kb_avail":92634280,"statfs":{"total":96636764160,"available":94857502720,"internally_reserved":0,"allocated":669990912,"data_stored":668425939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":605891,"internal_metadata":1108656445},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":97,"apply_latency_ms":97,"commit_latency_ns":97000000,"apply_latency_ns":97000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":2.8530000000000002,"15min":2.8610000000000002},"min":{"1min":0.66200000000000003,"5min":0.58099999999999996,"15min":0.56200000000000006},"max":{"1min":7.4779999999999998,"5min":15.250999999999999,"15min":21.669},"last":5.5759999999999996},{"interface":"front","average":{"1min":4.1440000000000001,"5min":3.3460000000000001,"15min":3.1259999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":27.016999999999999,"5min":27.016999999999999,"15min":27.016999999999999},"last":4.2670000000000003}]},{"osd":1,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3449999999999998,"5min":3.786,"15min":3.3029999999999999},"min":{"1min":0.76900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":15.436999999999999,"5min":15.436999999999999,"15min":18.707000000000001},"last":5.6840000000000002},{"interface":"front","average":{"1min":4.6319999999999997,"5min":3.98,"15min":3.4489999999999998},"min":{"1min":0.80400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"max":{"1min":22.309999999999999,"5min":22.309999999999999,"15min":22.309999999999999},"last":13.265000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":3.2469999999999999,"15min":3.0299999999999998},"min":{"1min":1.149,"5min":0.71599999999999997,"15min":0.65800000000000003},"max":{"1min":13.811999999999999,"5min":16.957000000000001,"15min":17.643000000000001},"last":2.1859999999999999},{"interface":"front","average":{"1min":5.327,"5min":4.1390000000000002,"15min":3.556},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82699999999999996},"max":{"1min":17.016999999999999,"5min":17.016999999999999,"15min":17.016999999999999},"last":19.274999999999999}]},{"osd":4,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.5880000000000001,"15min":2.3719999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.59099999999999997},"max":{"1min":6.8479999999999999,"5min":11.452999999999999,"15min":13.121},"last":2.8519999999999999},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.734,"15min":2.4510000000000001},"min":{"1min":0.66100000000000003,"5min":0.64000000000000001,"15min":0.58199999999999996},"max":{"1min":12.598000000000001,"5min":13.615,"15min":15.178000000000001},"last":3.0720000000000001}]},{"osd":5,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3730000000000002,"5min":2.3490000000000002,"15min":2.0619999999999998},"min":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.60399999999999998},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":2.0110000000000001},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.7320000000000002,"15min":2.5219999999999998},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":7.2169999999999996,"5min":11.573,"15min":13.02},"last":2.952}]},{"osd":6,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":2.9249999999999998,"15min":2.6429999999999998},"min":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.68600000000000005},"max":{"1min":12.707000000000001,"5min":13.789999999999999,"15min":14.960000000000001},"last":3.1749999999999998},{"interface":"front","average":{"1min":3.468,"5min":2.3940000000000001,"15min":2.2029999999999998},"min":{"1min":0.86099999999999999,"5min":0.745,"15min":0.71099999999999997},"max":{"1min":10.02,"5min":11.057,"15min":11.135},"last":2.1000000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.871,"5min":3.0019999999999998,"15min":2.7480000000000002},"min":{"1min":0.873,"5min":0.83699999999999997,"15min":0.78000000000000003},"max":{"1min":12.794,"5min":13.715999999999999,"15min":15.257999999999999},"last":3.2650000000000001},{"interface":"front","average":{"1min":3.569,"5min":2.46,"15min":2.3570000000000002},"min":{"1min":0.98299999999999998,"5min":0.81699999999999995,"15min":0.78300000000000003},"max":{"1min":10.102,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.9079999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580531,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6155088,"kb_used_data":4723732,"kb_used_omap":1951,"kb_used_meta":1409248,"kb_avail":88216752,"statfs":{"total":96636764160,"available":90333954048,"internally_reserved":0,"allocated":4837101568,"data_stored":4826927780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1997886,"internal_metadata":1443070914},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":192,"apply_latency_ms":192,"commit_latency_ns":192000000,"apply_latency_ns":192000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":5.7130000000000001,"5min":3.6629999999999998,"15min":2.9430000000000001},"min":{"1min":0.67000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":27.271999999999998,"5min":27.271999999999998,"15min":27.271999999999998},"last":2.3069999999999999},{"interface":"front","average":{"1min":5.0270000000000001,"5min":3.2719999999999998,"15min":3.0569999999999999},"min":{"1min":0.77300000000000002,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":33.43,"5min":33.43,"15min":33.43},"last":2.577}]},{"osd":2,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.9930000000000003,"5min":3.9260000000000002,"15min":3.2650000000000001},"min":{"1min":0.89100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":18.050999999999998,"5min":18.050999999999998,"15min":18.050999999999998},"last":2.8420000000000001},{"interface":"front","average":{"1min":5.2759999999999998,"5min":4.2300000000000004,"15min":3.355},"min":{"1min":1.2749999999999999,"5min":0.73799999999999999,"15min":0.65300000000000002},"max":{"1min":26.978999999999999,"5min":26.978999999999999,"15min":26.978999999999999},"last":3.3660000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.5490000000000004,"5min":4.2370000000000001,"15min":3.5739999999999998},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.69299999999999995},"max":{"1min":11.843,"5min":11.843,"15min":16.558},"last":13.57},{"interface":"front","average":{"1min":6.7859999999999996,"5min":4.726,"15min":3.9449999999999998},"min":{"1min":0.88100000000000001,"5min":0.73199999999999998,"15min":0.65100000000000002},"max":{"1min":33.329999999999998,"5min":33.329999999999998,"15min":33.329999999999998},"last":8.9710000000000001}]},{"osd":4,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.673,"15min":2.2989999999999999},"min":{"1min":0.71599999999999997,"5min":0.67400000000000004,"15min":0.58099999999999996},"max":{"1min":13.111000000000001,"5min":13.278,"15min":13.278},"last":1.425},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.8660000000000001,"15min":2.4660000000000002},"min":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":6.1710000000000003,"5min":10.628,"15min":12.055999999999999},"last":1.607}]},{"osd":5,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":2.7639999999999998,"15min":2.6200000000000001},"min":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.622},"max":{"1min":13.535,"5min":13.535,"15min":13.535},"last":2.0110000000000001},{"interface":"front","average":{"1min":3.7989999999999999,"5min":2.9340000000000002,"15min":2.4729999999999999},"min":{"1min":0.877,"5min":0.78100000000000003,"15min":0.71799999999999997},"max":{"1min":18.117000000000001,"5min":18.117000000000001,"15min":18.117000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.4220000000000002,"5min":2.843,"15min":2.7450000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":9.9719999999999995,"5min":9.9719999999999995,"15min":12.875},"last":2.133},{"interface":"front","average":{"1min":4.1749999999999998,"5min":3.1099999999999999,"15min":2.645},"min":{"1min":1.0640000000000001,"5min":0.875,"15min":0.80500000000000005},"max":{"1min":27.998999999999999,"5min":27.998999999999999,"15min":27.998999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":3.056,"15min":2.6739999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76100000000000001},"max":{"1min":6.0789999999999997,"5min":10.736000000000001,"15min":12.144},"last":3.21},{"interface":"front","average":{"1min":3.3679999999999999,"5min":2.8999999999999999,"15min":2.8679999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":10.055999999999999,"5min":10.055999999999999,"15min":12.952},"last":2.2160000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580617,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2144224,"kb_used_data":591460,"kb_used_omap":767,"kb_used_meta":1539200,"kb_avail":92227616,"statfs":{"total":96636764160,"available":94441078784,"internally_reserved":0,"allocated":605655040,"data_stored":604390502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786324,"internal_metadata":1576140908},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5230000000000001,"5min":3.1309999999999998,"15min":3.0510000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.4019999999999992,"5min":59.180999999999997,"15min":59.180999999999997},"last":2.9870000000000001},{"interface":"front","average":{"1min":3.657,"5min":2.8799999999999999,"15min":2.9550000000000001},"min":{"1min":0.873,"5min":0.64500000000000002,"15min":0.54900000000000004},"max":{"1min":12.970000000000001,"5min":12.970000000000001,"15min":14.712999999999999},"last":5.7110000000000003}]},{"osd":2,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":3.6480000000000001,"15min":3.1459999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.55000000000000004},"max":{"1min":5.9009999999999998,"5min":80.992000000000004,"15min":80.992000000000004},"last":3.0840000000000001},{"interface":"front","average":{"1min":3.6339999999999999,"5min":3.5779999999999998,"15min":3.1389999999999998},"min":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.59299999999999997},"max":{"1min":12.484,"5min":14.989000000000001,"15min":14.989000000000001},"last":4.093}]},{"osd":3,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.9399999999999999,"5min":3.613,"15min":3.3540000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.5350000000000001,"5min":16.291,"15min":16.291},"last":8.5350000000000001},{"interface":"front","average":{"1min":3.7050000000000001,"5min":5.0620000000000003,"15min":3.9990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":12.747999999999999,"5min":80.918000000000006,"15min":80.918000000000006},"last":7.8239999999999998}]},{"osd":4,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.982,"15min":1.8380000000000001},"min":{"1min":0.67200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":12.039999999999999,"5min":14.657,"15min":14.657},"last":3.4260000000000002},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.8849999999999998,"15min":2.4710000000000001},"min":{"1min":0.82699999999999996,"5min":0.65600000000000003,"15min":0.61599999999999999},"max":{"1min":5.5949999999999998,"5min":80.745000000000005,"15min":80.745000000000005},"last":2.7469999999999999}]},{"osd":5,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5150000000000001,"5min":2.5099999999999998,"15min":2.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.626},"max":{"1min":6.3369999999999997,"5min":15.202999999999999,"15min":15.202999999999999},"last":4.0010000000000003},{"interface":"front","average":{"1min":2.415,"5min":2.1930000000000001,"15min":2.0419999999999998},"min":{"1min":0.93600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":11.775,"5min":14.800000000000001,"15min":14.800000000000001},"last":3.6800000000000002}]},{"osd":6,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.2829999999999999,"15min":2.149},"min":{"1min":1.0129999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":11.959,"5min":14.917,"15min":14.917},"last":3.528},{"interface":"front","average":{"1min":2.177,"5min":3.0350000000000001,"15min":2.6930000000000001},"min":{"1min":1.0069999999999999,"5min":0.82199999999999995,"15min":0.72399999999999998},"max":{"1min":5.8090000000000002,"5min":80.840000000000003,"15min":80.840000000000003},"last":2.8650000000000002}]},{"osd":7,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.657,"15min":2.4700000000000002},"min":{"1min":1.0740000000000001,"5min":0.90600000000000003,"15min":0.72099999999999997},"max":{"1min":6.444,"5min":15.118,"15min":15.118},"last":4.5300000000000002},{"interface":"front","average":{"1min":2.5670000000000002,"5min":2.395,"15min":2.262},"min":{"1min":1.0549999999999999,"5min":0.88,"15min":0.88},"max":{"1min":11.880000000000001,"5min":15.396000000000001,"15min":15.396000000000001},"last":3.5880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T06:32:53.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T06:32:54.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.099+0000 7f6971bb6640 1 Processor -- start 2023-11-28T06:32:54.100 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.099+0000 7f6971bb6640 1 -- start start 2023-11-28T06:32:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.101+0000 7f6971bb6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f696c06abe0 0x7f696c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:54.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.101+0000 7f6971bb6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f6971bb6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c06e960 con 0x7f696c1432a0 2023-11-28T06:32:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f6971bb6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c15dec0 con 0x7f696c06abe0 2023-11-28T06:32:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f6971bb6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15e1a0 con 0x7f696c143680 2023-11-28T06:32:54.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f696bfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f696affd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f696c06abe0 0x7f696c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f696b7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f696c1432a0 0x7f696c06a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:57742/0 (socket says 172.21.15.154:57742) 2023-11-28T06:32:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f696b7fe640 1 -- 172.21.15.154:0/3518288257 learned_addr learned my addr 172.21.15.154:0/3518288257 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:54.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f696bfff640 1 -- 172.21.15.154:0/3518288257 >> v2:172.21.15.154:3300/0 conn(0x7f696c06abe0 msgr2=0x7f696c15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:54.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.102+0000 7f696bfff640 1 --2- 172.21.15.154:0/3518288257 >> v2:172.21.15.154:3300/0 conn(0x7f696c06abe0 0x7f696c15d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.103+0000 7f696bfff640 1 -- 172.21.15.154:0/3518288257 >> v1:172.21.15.154:6789/0 conn(0x7f696c1432a0 legacy=0x7f696c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:54.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.103+0000 7f696bfff640 1 -- 172.21.15.154:0/3518288257 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c15e480 con 0x7f696c143680 2023-11-28T06:32:54.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.105+0000 7f696bfff640 1 --2- 172.21.15.154:0/3518288257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c1409d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6964009d90 tx=0x7f696402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4dd7d8d1f493f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:54.106 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.106+0000 7f696a7fc640 1 -- 172.21.15.154:0/3518288257 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696402cc50 con 0x7f696c143680 2023-11-28T06:32:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.106+0000 7f696a7fc640 1 -- 172.21.15.154:0/3518288257 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696402cdb0 con 0x7f696c143680 2023-11-28T06:32:54.107 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.106+0000 7f696a7fc640 1 -- 172.21.15.154:0/3518288257 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964034660 con 0x7f696c143680 2023-11-28T06:32:54.108 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.107+0000 7f6971bb6640 1 -- 172.21.15.154:0/3518288257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 msgr2=0x7f696c1409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.107+0000 7f6971bb6640 1 --2- 172.21.15.154:0/3518288257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c1409d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6964009d90 tx=0x7f696402bea0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.107+0000 7f6971bb6640 1 -- 172.21.15.154:0/3518288257 shutdown_connections 2023-11-28T06:32:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.107+0000 7f6971bb6640 1 --2- 172.21.15.154:0/3518288257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c1409d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.107+0000 7f6971bb6640 1 --2- 172.21.15.154:0/3518288257 >> v2:172.21.15.154:3300/0 conn(0x7f696c06abe0 0x7f696c15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.107+0000 7f6971bb6640 1 -- 172.21.15.154:0/3518288257 >> 172.21.15.154:0/3518288257 conn(0x7f696c0b1de0 msgr2=0x7f696c0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:54.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.108+0000 7f6971bb6640 1 -- 172.21.15.154:0/3518288257 shutdown_connections 2023-11-28T06:32:54.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.108+0000 7f6971bb6640 1 -- 172.21.15.154:0/3518288257 wait complete. 2023-11-28T06:32:54.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.113+0000 7f6971bb6640 1 Processor -- start 2023-11-28T06:32:54.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.113+0000 7f6971bb6640 1 -- start start 2023-11-28T06:32:54.118 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f6971bb6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f696c06abe0 0x7f696c1f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f6971bb6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 0x7f696c133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f6971bb6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f6971bb6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c13da90 con 0x7f696c1432a0 2023-11-28T06:32:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f6971bb6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c141f60 con 0x7f696c06abe0 2023-11-28T06:32:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f6971bb6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1f36d0 con 0x7f696c143680 2023-11-28T06:32:54.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f696affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 0x7f696c133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f696b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f696c06abe0 0x7f696c1f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f696affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 0x7f696c133690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55296/0 (socket says 172.21.15.154:55296) 2023-11-28T06:32:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.117+0000 7f696affd640 1 -- 172.21.15.154:0/4162302205 learned_addr learned my addr 172.21.15.154:0/4162302205 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:54.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696bfff640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696b7fe640 1 -- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 msgr2=0x7f696c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696b7fe640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696b7fe640 1 -- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 msgr2=0x7f696c133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696b7fe640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 0x7f696c133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.121 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696b7fe640 1 -- 172.21.15.154:0/4162302205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964009a70 con 0x7f696c06abe0 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.118+0000 7f696affd640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 0x7f696c133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.119+0000 7f696b7fe640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f696c06abe0 0x7f696c1f3190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c440 tx=0x7f695c001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.119+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c005ce0 con 0x7f696c06abe0 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.119+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c005e40 con 0x7f696c06abe0 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.119+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0072d0 con 0x7f696c06abe0 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.119+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c141350 con 0x7f696c06abe0 2023-11-28T06:32:54.122 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.120+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c141910 con 0x7f696c06abe0 2023-11-28T06:32:54.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.123+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c067420 con 0x7f696c06abe0 2023-11-28T06:32:54.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.124+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f695c007430 con 0x7f696c06abe0 2023-11-28T06:32:54.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.125+0000 7f6953fff640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f695806b1c0 0x7f695806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.126+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f695c088c00 con 0x7f696c06abe0 2023-11-28T06:32:54.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.126+0000 7f696affd640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f695806b1c0 0x7f695806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:54.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.127+0000 7f696affd640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f695806b1c0 0x7f695806d680 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f696c13e0e0 tx=0x7f6960009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:54.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.131+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f695c08f080 con 0x7f696c06abe0 2023-11-28T06:32:54.726 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.725+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f696c0723a0 con 0x7f695806b1c0 2023-11-28T06:32:54.732 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.731+0000 7f6953fff640 1 -- 172.21.15.154:0/4162302205 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49454 (secure 0 0 0) 0x7f696c0723a0 con 0x7f695806b1c0 2023-11-28T06:32:54.733 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:54.734 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-28T06:32:54.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.735+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f695806b1c0 msgr2=0x7f695806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:54.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.735+0000 7f6971bb6640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f695806b1c0 0x7f695806d680 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f696c13e0e0 tx=0x7f6960009190 comp rx=0 tx=0).stop 2023-11-28T06:32:54.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.735+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f696c06abe0 msgr2=0x7f696c1f3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:54.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f696c06abe0 0x7f696c1f3190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c440 tx=0x7f695c001e70 comp rx=0 tx=0).stop 2023-11-28T06:32:54.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 shutdown_connections 2023-11-28T06:32:54.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f695806b1c0 0x7f695806d680 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f696c143680 0x7f696c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.738 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f696c1432a0 0x7f696c133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 --2- 172.21.15.154:0/4162302205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f696c06abe0 0x7f696c1f3190 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:54.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 >> 172.21.15.154:0/4162302205 conn(0x7f696c0b1de0 msgr2=0x7f696c0b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:54.739 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 shutdown_connections 2023-11-28T06:32:54.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:54.736+0000 7f6971bb6640 1 -- 172.21.15.154:0/4162302205 wait complete. 2023-11-28T06:32:54.764 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":14529,"stamp":"2023-11-28T06:32:54.078640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":18962608,"kb_used_data":6478928,"kb_used_omap":7985,"kb_used_meta":12346958,"kb_avail":736012112,"statfs":{"total":773094113280,"available":753676402688,"internally_reserved":0,"allocated":6634422272,"data_stored":6619088761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8177315,"internal_metadata":12643285341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":694,"apply_latency_ms":694,"commit_latency_ns":694000000,"apply_latency_ns":694000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31389174013,"num_objects":-26328,"num_object_clones":0,"num_object_copies":-52656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26328,"num_whiteouts":0,"num_read":-2163906,"num_read_kb":-147487704,"num_write":-6623628,"num_write_kb":-170073247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007804"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T06:32:44.517193+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-28T06:32:44.517193+0000","last_peered":"2023-11-28T06:32:44.517193+0000","last_clean":"2023-11-28T06:32:44.517193+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-28T06:32:44.517193+0000","last_undegraded":"2023-11-28T06:32:44.517193+0000","last_fullsized":"2023-11-28T06:32:44.517193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580652,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1609136,"kb_used_data":1000,"kb_used_omap":582,"kb_used_meta":1607545,"kb_avail":92762704,"statfs":{"total":96636764160,"available":94989008896,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596775,"internal_metadata":1646126297},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.611,"15min":1.3600000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.36399999999999999},"max":{"1min":13.365,"5min":13.487,"15min":13.487},"last":1.786},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.538,"15min":1.3420000000000001},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.46999999999999997},"max":{"1min":7.4039999999999999,"5min":13.518000000000001,"15min":13.518000000000001},"last":1.827}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.0459999999999998,"15min":1.8029999999999999},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":31.065999999999999,"5min":31.065999999999999,"15min":31.065999999999999},"last":0.504},{"interface":"front","average":{"1min":3.1589999999999998,"5min":2.3730000000000002,"15min":1.8240000000000001},"min":{"1min":0.63700000000000001,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":27.765000000000001,"5min":27.765000000000001,"15min":27.765000000000001},"last":0.94599999999999995}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":1.794,"15min":1.458},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":15.462999999999999,"5min":15.462999999999999,"15min":15.462999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":2.7879999999999998,"5min":1.9590000000000001,"15min":1.6519999999999999},"min":{"1min":0.48599999999999999,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":23.225999999999999,"5min":23.225999999999999,"15min":23.225999999999999},"last":1.363}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7070000000000001,"15min":1.7010000000000001},"min":{"1min":0.497,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":6.3869999999999996,"5min":10.574,"15min":11.516},"last":0.495},{"interface":"front","average":{"1min":1.929,"5min":2.4420000000000002,"15min":2.0070000000000001},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":13.446,"5min":13.446,"15min":18.081},"last":0.72199999999999998}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.499,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":10.872,"5min":10.872,"15min":10.872},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.51600000000000001,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.26300000000000001},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.9569999999999999},"last":0.33600000000000002}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":8.8109999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.669,"5min":0.66400000000000003,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.30399999999999999,"15min":0.26300000000000001},"max":{"1min":21.373000000000001,"5min":21.373000000000001,"15min":21.373000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.52500000000000002,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":6.2009999999999996},"last":0.437},{"interface":"front","average":{"1min":0.875,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":6.7359999999999998,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":0.375}]}]},{"osd":6,"up_from":13,"seq":55834580652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1601644,"kb_used_data":420,"kb_used_omap":212,"kb_used_meta":1601003,"kb_avail":92770196,"statfs":{"total":96636764160,"available":94996680704,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217819,"internal_metadata":1639427365},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.5900000000000001,"15min":1.296},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":5.4939999999999998,"5min":24.896999999999998,"15min":24.896999999999998},"last":0.622},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.0870000000000002,"15min":1.5760000000000001},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.39200000000000002},"max":{"1min":11.02,"5min":37.939,"15min":37.939},"last":0.73099999999999998}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.8100000000000001,"15min":1.645},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":10.977,"5min":10.977,"15min":11.359999999999999},"last":3.121},{"interface":"front","average":{"1min":4.3490000000000002,"5min":2.1859999999999999,"15min":1.796},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":37.594999999999999,"5min":37.594999999999999,"15min":37.594999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":1.742,"15min":1.599},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":15.630000000000001,"5min":15.630000000000001,"15min":15.630000000000001},"last":9.6799999999999997},{"interface":"front","average":{"1min":2.75,"5min":1.9299999999999999,"15min":1.6100000000000001},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.42699999999999999},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":3.4199999999999999}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":1.9970000000000001,"15min":1.6699999999999999},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"max":{"1min":12.163,"5min":15.5,"15min":15.5},"last":22.184000000000001},{"interface":"front","average":{"1min":2.488,"5min":2.8959999999999999,"15min":1.8839999999999999},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":13.254,"5min":50.070999999999998,"15min":50.070999999999998},"last":1.399}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.68999999999999995,"15min":0.46100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.246},"max":{"1min":1.135,"5min":25.050999999999998,"15min":25.050999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.58599999999999997,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":12.782,"5min":12.782,"15min":12.782},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.998,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.75900000000000001,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.49399999999999999,"5min":24.937999999999999,"15min":24.937999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.627,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.49199999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834580652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1766828,"kb_used_data":420,"kb_used_omap":725,"kb_used_meta":1765674,"kb_avail":92605012,"statfs":{"total":96636764160,"available":94827532288,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":742844,"internal_metadata":1808050756},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.385,"15min":1.175},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.38},"max":{"1min":10.455,"5min":10.455,"15min":10.455},"last":2.544},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.264,"15min":1.2190000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":10.053000000000001,"5min":10.053000000000001,"15min":10.053000000000001},"last":1.103}]},{"osd":1,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":2.1549999999999998,"5min":1.5409999999999999,"15min":1.4930000000000001},"min":{"1min":0.46899999999999997,"5min":0.41899999999999998,"15min":0.36799999999999999},"max":{"1min":10.116,"5min":10.116,"15min":12.682},"last":0.55500000000000005},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.504,"15min":1.413},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.2389999999999999,"5min":9.9830000000000005,"15min":24.847999999999999},"last":2.7679999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":3.883,"5min":2.1299999999999999,"15min":1.7190000000000001},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":27.013999999999999,"5min":27.013999999999999,"15min":27.013999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6339999999999999,"15min":1.347},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":10.146000000000001,"5min":10.146000000000001,"15min":12.281000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2759999999999998,"5min":1.827,"15min":1.819},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":7.6630000000000003,"5min":10.638,"15min":16.055},"last":0.80700000000000005},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.9950000000000001,"15min":1.76},"min":{"1min":0.56000000000000005,"5min":0.45500000000000002,"15min":0.41799999999999998},"max":{"1min":14.384,"5min":14.384,"15min":14.384},"last":6.7190000000000003}]},{"osd":4,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.40500000000000003,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.249,"15min":0.24199999999999999},"max":{"1min":5.2110000000000003,"5min":5.2110000000000003,"15min":5.2110000000000003},"last":0.496},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.38500000000000001,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":0.44},{"interface":"front","average":{"1min":1.141,"5min":0.56499999999999995,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26500000000000001},"max":{"1min":14.951000000000001,"5min":14.951000000000001,"15min":14.951000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.47499999999999998,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.316,"15min":0.316},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.48299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834580650,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1589932,"kb_used_data":420,"kb_used_omap":1298,"kb_used_meta":1588205,"kb_avail":92781908,"statfs":{"total":96636764160,"available":95008673792,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1330133,"internal_metadata":1626321963},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.3779999999999999,"15min":1.214},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":3.1080000000000001,"5min":10.359999999999999,"15min":10.542},"last":3.9849999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.5600000000000001,"15min":1.2310000000000001},"min":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.40899999999999997},"max":{"1min":11.694000000000001,"5min":12.416,"15min":12.416},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":2.1960000000000002,"15min":1.7889999999999999},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":28.722999999999999,"5min":28.722999999999999,"15min":28.722999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":3.0539999999999998,"5min":2.016,"15min":1.671},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.40100000000000002},"max":{"1min":27.699000000000002,"5min":27.699000000000002,"15min":27.699000000000002},"last":3.8439999999999999}]},{"osd":2,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.5649999999999999,"15min":1.4350000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42499999999999999},"max":{"1min":13.481999999999999,"5min":13.481999999999999,"15min":13.481999999999999},"last":8.7910000000000004},{"interface":"front","average":{"1min":2.2589999999999999,"5min":1.6619999999999999,"15min":1.4770000000000001},"min":{"1min":0.51500000000000001,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":7.992,"5min":9.9149999999999991,"15min":11.736000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.8440000000000001,"15min":1.71},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.40100000000000002},"max":{"1min":11.721,"5min":12.382,"15min":12.382},"last":8.9860000000000007},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.2280000000000002,"15min":1.9259999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.39300000000000002},"max":{"1min":12.007999999999999,"5min":12.007999999999999,"15min":13.673999999999999},"last":9.3480000000000008}]},{"osd":5,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.1359999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.374},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.621,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":11.664,"5min":12.446999999999999,"15min":12.446999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.51400000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":11.507999999999999,"5min":11.507999999999999,"15min":11.507999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.53900000000000003,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70499999999999996,"15min":0.52900000000000003},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":11.629,"5min":12.336,"15min":12.336},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.56299999999999994,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":11.471,"5min":11.471,"15min":11.471},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834580478,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2358196,"kb_used_data":507188,"kb_used_omap":1855,"kb_used_meta":1753408,"kb_avail":92013644,"statfs":{"total":96636764160,"available":94221971456,"internally_reserved":0,"allocated":519360512,"data_stored":518072644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1899643,"internal_metadata":1795490693},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":3.544,"15min":3.3690000000000002},"min":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54100000000000004},"max":{"1min":29.311,"5min":29.311,"15min":29.311},"last":4.1230000000000002},{"interface":"front","average":{"1min":3.6379999999999999,"5min":3.5030000000000001,"15min":3.3599999999999999},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.56299999999999994},"max":{"1min":20.762,"5min":21.399999999999999,"15min":21.399999999999999},"last":3.8570000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.7090000000000001,"5min":4.0350000000000001,"15min":3.4969999999999999},"min":{"1min":0.625,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":11.140000000000001,"5min":20.879999999999999,"15min":20.879999999999999},"last":5.4729999999999999},{"interface":"front","average":{"1min":4.9059999999999997,"5min":5.3449999999999998,"15min":4.2279999999999998},"min":{"1min":0.70699999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":29.452999999999999,"5min":48.625999999999998,"15min":48.625999999999998},"last":4.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.859,"5min":4.306,"15min":3.7650000000000001},"min":{"1min":0.93899999999999995,"5min":0.75,"15min":0.66600000000000004},"max":{"1min":25.378,"5min":33.497999999999998,"15min":33.497999999999998},"last":2.766},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.5259999999999998,"15min":3.4700000000000002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65100000000000002},"max":{"1min":11.054,"5min":21.193000000000001,"15min":21.193000000000001},"last":2.661}]},{"osd":4,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.7949999999999999,"15min":2.7570000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55900000000000005},"max":{"1min":9.6820000000000004,"5min":21.931999999999999,"15min":21.931999999999999},"last":1.385},{"interface":"front","average":{"1min":2.544,"5min":3.2669999999999999,"15min":2.839},"min":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.60599999999999998},"max":{"1min":10.705,"5min":21.013999999999999,"15min":21.013999999999999},"last":1.724}]},{"osd":5,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":3.5209999999999999,"15min":3.0129999999999999},"min":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.69499999999999995},"max":{"1min":10.881,"5min":21.344000000000001,"15min":21.344000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":2.2389999999999999,"5min":2.9769999999999999,"15min":2.8319999999999999},"min":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":9.4179999999999993,"5min":21.631,"15min":21.631},"last":2.4289999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":3.077,"15min":2.9769999999999999},"min":{"1min":0.84599999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":9.5670000000000002,"5min":21.792000000000002,"15min":21.792000000000002},"last":2.5539999999999998},{"interface":"front","average":{"1min":2.452,"5min":2.9940000000000002,"15min":2.9790000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.72199999999999998},"max":{"1min":9.7729999999999997,"5min":21.838999999999999,"15min":21.838999999999999},"last":1.488}]},{"osd":7,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":3.1309999999999998,"15min":3.0899999999999999},"min":{"1min":0.91600000000000004,"5min":0.89300000000000002,"15min":0.79700000000000004},"max":{"1min":9.8710000000000004,"5min":25.337,"15min":25.337},"last":1.5629999999999999},{"interface":"front","average":{"1min":2.8199999999999998,"5min":3.6779999999999999,"15min":3.246},"min":{"1min":0.94299999999999995,"5min":0.89200000000000002,"15min":0.80700000000000005},"max":{"1min":11.234,"5min":21.274000000000001,"15min":21.274000000000001},"last":1.8}]}]},{"osd":2,"up_from":13,"seq":55834580577,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1737560,"kb_used_data":654288,"kb_used_omap":591,"kb_used_meta":1082672,"kb_avail":92634280,"statfs":{"total":96636764160,"available":94857502720,"internally_reserved":0,"allocated":669990912,"data_stored":668425939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":605891,"internal_metadata":1108656445},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":97,"apply_latency_ms":97,"commit_latency_ns":97000000,"apply_latency_ns":97000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":2.8530000000000002,"15min":2.8610000000000002},"min":{"1min":0.66200000000000003,"5min":0.58099999999999996,"15min":0.56200000000000006},"max":{"1min":7.4779999999999998,"5min":15.250999999999999,"15min":21.669},"last":5.5759999999999996},{"interface":"front","average":{"1min":4.1440000000000001,"5min":3.3460000000000001,"15min":3.1259999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":27.016999999999999,"5min":27.016999999999999,"15min":27.016999999999999},"last":4.2670000000000003}]},{"osd":1,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3449999999999998,"5min":3.786,"15min":3.3029999999999999},"min":{"1min":0.76900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":15.436999999999999,"5min":15.436999999999999,"15min":18.707000000000001},"last":5.6840000000000002},{"interface":"front","average":{"1min":4.6319999999999997,"5min":3.98,"15min":3.4489999999999998},"min":{"1min":0.80400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"max":{"1min":22.309999999999999,"5min":22.309999999999999,"15min":22.309999999999999},"last":13.265000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":3.2469999999999999,"15min":3.0299999999999998},"min":{"1min":1.149,"5min":0.71599999999999997,"15min":0.65800000000000003},"max":{"1min":13.811999999999999,"5min":16.957000000000001,"15min":17.643000000000001},"last":2.1859999999999999},{"interface":"front","average":{"1min":5.327,"5min":4.1390000000000002,"15min":3.556},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82699999999999996},"max":{"1min":17.016999999999999,"5min":17.016999999999999,"15min":17.016999999999999},"last":19.274999999999999}]},{"osd":4,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.5880000000000001,"15min":2.3719999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.59099999999999997},"max":{"1min":6.8479999999999999,"5min":11.452999999999999,"15min":13.121},"last":2.8519999999999999},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.734,"15min":2.4510000000000001},"min":{"1min":0.66100000000000003,"5min":0.64000000000000001,"15min":0.58199999999999996},"max":{"1min":12.598000000000001,"5min":13.615,"15min":15.178000000000001},"last":3.0720000000000001}]},{"osd":5,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3730000000000002,"5min":2.3490000000000002,"15min":2.0619999999999998},"min":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.60399999999999998},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":2.0110000000000001},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.7320000000000002,"15min":2.5219999999999998},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":7.2169999999999996,"5min":11.573,"15min":13.02},"last":2.952}]},{"osd":6,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":2.9249999999999998,"15min":2.6429999999999998},"min":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.68600000000000005},"max":{"1min":12.707000000000001,"5min":13.789999999999999,"15min":14.960000000000001},"last":3.1749999999999998},{"interface":"front","average":{"1min":3.468,"5min":2.3940000000000001,"15min":2.2029999999999998},"min":{"1min":0.86099999999999999,"5min":0.745,"15min":0.71099999999999997},"max":{"1min":10.02,"5min":11.057,"15min":11.135},"last":2.1000000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.871,"5min":3.0019999999999998,"15min":2.7480000000000002},"min":{"1min":0.873,"5min":0.83699999999999997,"15min":0.78000000000000003},"max":{"1min":12.794,"5min":13.715999999999999,"15min":15.257999999999999},"last":3.2650000000000001},{"interface":"front","average":{"1min":3.569,"5min":2.46,"15min":2.3570000000000002},"min":{"1min":0.98299999999999998,"5min":0.81699999999999995,"15min":0.78300000000000003},"max":{"1min":10.102,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.9079999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580531,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6155088,"kb_used_data":4723732,"kb_used_omap":1951,"kb_used_meta":1409248,"kb_avail":88216752,"statfs":{"total":96636764160,"available":90333954048,"internally_reserved":0,"allocated":4837101568,"data_stored":4826927780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1997886,"internal_metadata":1443070914},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":192,"apply_latency_ms":192,"commit_latency_ns":192000000,"apply_latency_ns":192000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":5.7130000000000001,"5min":3.6629999999999998,"15min":2.9430000000000001},"min":{"1min":0.67000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":27.271999999999998,"5min":27.271999999999998,"15min":27.271999999999998},"last":2.3069999999999999},{"interface":"front","average":{"1min":5.0270000000000001,"5min":3.2719999999999998,"15min":3.0569999999999999},"min":{"1min":0.77300000000000002,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":33.43,"5min":33.43,"15min":33.43},"last":2.577}]},{"osd":2,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.9930000000000003,"5min":3.9260000000000002,"15min":3.2650000000000001},"min":{"1min":0.89100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":18.050999999999998,"5min":18.050999999999998,"15min":18.050999999999998},"last":2.8420000000000001},{"interface":"front","average":{"1min":5.2759999999999998,"5min":4.2300000000000004,"15min":3.355},"min":{"1min":1.2749999999999999,"5min":0.73799999999999999,"15min":0.65300000000000002},"max":{"1min":26.978999999999999,"5min":26.978999999999999,"15min":26.978999999999999},"last":3.3660000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.5490000000000004,"5min":4.2370000000000001,"15min":3.5739999999999998},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.69299999999999995},"max":{"1min":11.843,"5min":11.843,"15min":16.558},"last":13.57},{"interface":"front","average":{"1min":6.7859999999999996,"5min":4.726,"15min":3.9449999999999998},"min":{"1min":0.88100000000000001,"5min":0.73199999999999998,"15min":0.65100000000000002},"max":{"1min":33.329999999999998,"5min":33.329999999999998,"15min":33.329999999999998},"last":8.9710000000000001}]},{"osd":4,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.673,"15min":2.2989999999999999},"min":{"1min":0.71599999999999997,"5min":0.67400000000000004,"15min":0.58099999999999996},"max":{"1min":13.111000000000001,"5min":13.278,"15min":13.278},"last":1.425},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.8660000000000001,"15min":2.4660000000000002},"min":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":6.1710000000000003,"5min":10.628,"15min":12.055999999999999},"last":1.607}]},{"osd":5,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":2.7639999999999998,"15min":2.6200000000000001},"min":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.622},"max":{"1min":13.535,"5min":13.535,"15min":13.535},"last":2.0110000000000001},{"interface":"front","average":{"1min":3.7989999999999999,"5min":2.9340000000000002,"15min":2.4729999999999999},"min":{"1min":0.877,"5min":0.78100000000000003,"15min":0.71799999999999997},"max":{"1min":18.117000000000001,"5min":18.117000000000001,"15min":18.117000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.4220000000000002,"5min":2.843,"15min":2.7450000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":9.9719999999999995,"5min":9.9719999999999995,"15min":12.875},"last":2.133},{"interface":"front","average":{"1min":4.1749999999999998,"5min":3.1099999999999999,"15min":2.645},"min":{"1min":1.0640000000000001,"5min":0.875,"15min":0.80500000000000005},"max":{"1min":27.998999999999999,"5min":27.998999999999999,"15min":27.998999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":3.056,"15min":2.6739999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76100000000000001},"max":{"1min":6.0789999999999997,"5min":10.736000000000001,"15min":12.144},"last":3.21},{"interface":"front","average":{"1min":3.3679999999999999,"5min":2.8999999999999999,"15min":2.8679999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":10.055999999999999,"5min":10.055999999999999,"15min":12.952},"last":2.2160000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580617,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2144224,"kb_used_data":591460,"kb_used_omap":767,"kb_used_meta":1539200,"kb_avail":92227616,"statfs":{"total":96636764160,"available":94441078784,"internally_reserved":0,"allocated":605655040,"data_stored":604390502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786324,"internal_metadata":1576140908},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5230000000000001,"5min":3.1309999999999998,"15min":3.0510000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.4019999999999992,"5min":59.180999999999997,"15min":59.180999999999997},"last":2.9870000000000001},{"interface":"front","average":{"1min":3.657,"5min":2.8799999999999999,"15min":2.9550000000000001},"min":{"1min":0.873,"5min":0.64500000000000002,"15min":0.54900000000000004},"max":{"1min":12.970000000000001,"5min":12.970000000000001,"15min":14.712999999999999},"last":5.7110000000000003}]},{"osd":2,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":3.6480000000000001,"15min":3.1459999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.55000000000000004},"max":{"1min":5.9009999999999998,"5min":80.992000000000004,"15min":80.992000000000004},"last":3.0840000000000001},{"interface":"front","average":{"1min":3.6339999999999999,"5min":3.5779999999999998,"15min":3.1389999999999998},"min":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.59299999999999997},"max":{"1min":12.484,"5min":14.989000000000001,"15min":14.989000000000001},"last":4.093}]},{"osd":3,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.9399999999999999,"5min":3.613,"15min":3.3540000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.5350000000000001,"5min":16.291,"15min":16.291},"last":8.5350000000000001},{"interface":"front","average":{"1min":3.7050000000000001,"5min":5.0620000000000003,"15min":3.9990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":12.747999999999999,"5min":80.918000000000006,"15min":80.918000000000006},"last":7.8239999999999998}]},{"osd":4,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.982,"15min":1.8380000000000001},"min":{"1min":0.67200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":12.039999999999999,"5min":14.657,"15min":14.657},"last":3.4260000000000002},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.8849999999999998,"15min":2.4710000000000001},"min":{"1min":0.82699999999999996,"5min":0.65600000000000003,"15min":0.61599999999999999},"max":{"1min":5.5949999999999998,"5min":80.745000000000005,"15min":80.745000000000005},"last":2.7469999999999999}]},{"osd":5,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5150000000000001,"5min":2.5099999999999998,"15min":2.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.626},"max":{"1min":6.3369999999999997,"5min":15.202999999999999,"15min":15.202999999999999},"last":4.0010000000000003},{"interface":"front","average":{"1min":2.415,"5min":2.1930000000000001,"15min":2.0419999999999998},"min":{"1min":0.93600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":11.775,"5min":14.800000000000001,"15min":14.800000000000001},"last":3.6800000000000002}]},{"osd":6,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.2829999999999999,"15min":2.149},"min":{"1min":1.0129999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":11.959,"5min":14.917,"15min":14.917},"last":3.528},{"interface":"front","average":{"1min":2.177,"5min":3.0350000000000001,"15min":2.6930000000000001},"min":{"1min":1.0069999999999999,"5min":0.82199999999999995,"15min":0.72399999999999998},"max":{"1min":5.8090000000000002,"5min":80.840000000000003,"15min":80.840000000000003},"last":2.8650000000000002}]},{"osd":7,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.657,"15min":2.4700000000000002},"min":{"1min":1.0740000000000001,"5min":0.90600000000000003,"15min":0.72099999999999997},"max":{"1min":6.444,"5min":15.118,"15min":15.118},"last":4.5300000000000002},{"interface":"front","average":{"1min":2.5670000000000002,"5min":2.395,"15min":2.262},"min":{"1min":1.0549999999999999,"5min":0.88,"15min":0.88},"max":{"1min":11.880000000000001,"5min":15.396000000000001,"15min":15.396000000000001},"last":3.5880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T06:32:54.766 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T06:32:54.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T06:32:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.109+0000 7fa2a1cca640 1 Processor -- start 2023-11-28T06:32:55.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.109+0000 7fa2a1cca640 1 -- start start 2023-11-28T06:32:55.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.111+0000 7fa2a1cca640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa29c157b00 0x7fa29c0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa2a1cca640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa29c071a00 0x7fa29c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa2a1cca640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c071e60 con 0x7fa29c15ad60 2023-11-28T06:32:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa2a1cca640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c06f510 con 0x7fa29c071a00 2023-11-28T06:32:55.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa2a1cca640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c06e960 con 0x7fa29c157b00 2023-11-28T06:32:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa29b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa29c157b00 0x7fa29c0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa29b7fe640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa29c157b00 0x7fa29c0714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:41426/0 (socket says 172.21.15.154:41426) 2023-11-28T06:32:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa29b7fe640 1 -- 172.21.15.154:0/4165455923 learned_addr learned my addr 172.21.15.154:0/4165455923 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.112+0000 7fa29affd640 1 --2- 172.21.15.154:0/4165455923 >> v2:172.21.15.154:3300/0 conn(0x7fa29c071a00 0x7fa29c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.113+0000 7fa29affd640 1 -- 172.21.15.154:0/4165455923 >> v2:172.21.15.194:3300/0 conn(0x7fa29c157b00 msgr2=0x7fa29c0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:55.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.113+0000 7fa29affd640 1 --2- 172.21.15.154:0/4165455923 >> v2:172.21.15.194:3300/0 conn(0x7fa29c157b00 0x7fa29c0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.113+0000 7fa29affd640 1 -- 172.21.15.154:0/4165455923 >> v1:172.21.15.194:6789/0 conn(0x7fa29c15ad60 legacy=0x7fa29c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:55.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.113+0000 7fa29affd640 1 -- 172.21.15.154:0/4165455923 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c157ee0 con 0x7fa29c071a00 2023-11-28T06:32:55.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.116+0000 7fa29affd640 1 --2- 172.21.15.154:0/4165455923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c071a00 0x7fa29c15a820 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06cdf0 tx=0x7fa29002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd88da1b112e922e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:55.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.116+0000 7fa29a7fc640 1 -- 172.21.15.154:0/4165455923 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29002e070 con 0x7fa29c071a00 2023-11-28T06:32:55.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.116+0000 7fa29a7fc640 1 -- 172.21.15.154:0/4165455923 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900315a0 con 0x7fa29c071a00 2023-11-28T06:32:55.117 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.116+0000 7fa29a7fc640 1 -- 172.21.15.154:0/4165455923 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290031930 con 0x7fa29c071a00 2023-11-28T06:32:55.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.118+0000 7fa2a1cca640 1 -- 172.21.15.154:0/4165455923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c071a00 msgr2=0x7fa29c15a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:55.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.118+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/4165455923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c071a00 0x7fa29c15a820 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06cdf0 tx=0x7fa29002b840 comp rx=0 tx=0).stop 2023-11-28T06:32:55.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.118+0000 7fa2a1cca640 1 -- 172.21.15.154:0/4165455923 shutdown_connections 2023-11-28T06:32:55.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.118+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/4165455923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c071a00 0x7fa29c15a820 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.118+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/4165455923 >> v2:172.21.15.194:3300/0 conn(0x7fa29c157b00 0x7fa29c0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.118+0000 7fa2a1cca640 1 -- 172.21.15.154:0/4165455923 >> 172.21.15.154:0/4165455923 conn(0x7fa29c0b1de0 msgr2=0x7fa29c0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:55.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.119+0000 7fa2a1cca640 1 -- 172.21.15.154:0/4165455923 shutdown_connections 2023-11-28T06:32:55.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.119+0000 7fa2a1cca640 1 -- 172.21.15.154:0/4165455923 wait complete. 2023-11-28T06:32:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.124+0000 7fa2a1cca640 1 Processor -- start 2023-11-28T06:32:55.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.124+0000 7fa2a1cca640 1 -- start start 2023-11-28T06:32:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa2a1cca640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa29c157b00 0x7fa29c148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:55.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa2a1cca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c15ad60 0x7fa29c0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa2a1cca640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa29c1580a0 0x7fa29c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa29b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa29c157b00 0x7fa29c148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa29b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa29c157b00 0x7fa29c148aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:41430/0 (socket says 172.21.15.154:41430) 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa29b7fe640 1 -- 172.21.15.154:0/1546962720 learned_addr learned my addr 172.21.15.154:0/1546962720 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c148fe0 con 0x7fa29c15ad60 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1594f0 con 0x7fa29c157b00 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.128+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c158690 con 0x7fa29c1580a0 2023-11-28T06:32:55.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.129+0000 7fa29bfff640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa29c1580a0 0x7fa29c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.129+0000 7fa29bfff640 1 -- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa29c157b00 msgr2=0x7fa29c148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.129+0000 7fa29bfff640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa29c157b00 0x7fa29c148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.129+0000 7fa29bfff640 1 -- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c15ad60 msgr2=0x7fa29c0b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:55.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.129+0000 7fa29bfff640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c15ad60 0x7fa29c0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.130+0000 7fa29bfff640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290009400 con 0x7fa29c1580a0 2023-11-28T06:32:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.130+0000 7fa29bfff640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa29c1580a0 0x7fa29c0b12e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa294002150 tx=0x7fa29400cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.131+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294006d50 con 0x7fa29c1580a0 2023-11-28T06:32:55.132 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.131+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294011890 con 0x7fa29c1580a0 2023-11-28T06:32:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.131+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011c80 con 0x7fa29c1580a0 2023-11-28T06:32:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.131+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c158970 con 0x7fa29c1580a0 2023-11-28T06:32:55.133 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.131+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c158f30 con 0x7fa29c1580a0 2023-11-28T06:32:55.135 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.134+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c067420 con 0x7fa29c1580a0 2023-11-28T06:32:55.136 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.136+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa294005080 con 0x7fa29c1580a0 2023-11-28T06:32:55.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.137+0000 7fa283fff640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa28806b210 0x7fa28806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:55.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.137+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa29408d090 con 0x7fa29c1580a0 2023-11-28T06:32:55.138 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.137+0000 7fa29b7fe640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa28806b210 0x7fa28806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:55.139 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.139+0000 7fa29b7fe640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa28806b210 0x7fa28806d6d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00b240 tx=0x7fa28c00b450 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:55.142 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.141+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fa294058130 con 0x7fa29c1580a0 2023-11-28T06:32:55.725 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.724+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa29c06f130 con 0x7fa28806b210 2023-11-28T06:32:55.730 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.730+0000 7fa283fff640 1 -- 172.21.15.154:0/1546962720 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49454 (secure 0 0 0) 0x7fa28c00be30 con 0x7fa28806b210 2023-11-28T06:32:55.731 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:55.732 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-28T06:32:55.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa28806b210 msgr2=0x7fa28806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:55.735 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa28806b210 0x7fa28806d6d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00b240 tx=0x7fa28c00b450 comp rx=0 tx=0).stop 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa29c1580a0 msgr2=0x7fa29c0b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa29c1580a0 0x7fa29c0b12e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa294002150 tx=0x7fa29400cad0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 shutdown_connections 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa28806b210 0x7fa28806d6d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa29c1580a0 0x7fa29c0b12e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa29c15ad60 0x7fa29c0b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 --2- 172.21.15.154:0/1546962720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa29c157b00 0x7fa29c148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:55.736 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 >> 172.21.15.154:0/1546962720 conn(0x7fa29c0b1de0 msgr2=0x7fa29c0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:55.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.734+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 shutdown_connections 2023-11-28T06:32:55.737 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:55.735+0000 7fa2a1cca640 1 -- 172.21.15.154:0/1546962720 wait complete. 2023-11-28T06:32:55.762 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":14529,"stamp":"2023-11-28T06:32:54.078640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":18962608,"kb_used_data":6478928,"kb_used_omap":7985,"kb_used_meta":12346958,"kb_avail":736012112,"statfs":{"total":773094113280,"available":753676402688,"internally_reserved":0,"allocated":6634422272,"data_stored":6619088761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8177315,"internal_metadata":12643285341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":694,"apply_latency_ms":694,"commit_latency_ns":694000000,"apply_latency_ns":694000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31389174013,"num_objects":-26328,"num_object_clones":0,"num_object_copies":-52656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26328,"num_whiteouts":0,"num_read":-2163906,"num_read_kb":-147487704,"num_write":-6623628,"num_write_kb":-170073247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.007804"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":473,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-28T06:32:44.517193+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-28T06:32:44.517193+0000","last_peered":"2023-11-28T06:32:44.517193+0000","last_clean":"2023-11-28T06:32:44.517193+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-28T06:32:44.517193+0000","last_undegraded":"2023-11-28T06:32:44.517193+0000","last_fullsized":"2023-11-28T06:32:44.517193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580652,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1609136,"kb_used_data":1000,"kb_used_omap":582,"kb_used_meta":1607545,"kb_avail":92762704,"statfs":{"total":96636764160,"available":94989008896,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596775,"internal_metadata":1646126297},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.611,"15min":1.3600000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.36399999999999999},"max":{"1min":13.365,"5min":13.487,"15min":13.487},"last":1.786},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.538,"15min":1.3420000000000001},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.46999999999999997},"max":{"1min":7.4039999999999999,"5min":13.518000000000001,"15min":13.518000000000001},"last":1.827}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.0459999999999998,"15min":1.8029999999999999},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":31.065999999999999,"5min":31.065999999999999,"15min":31.065999999999999},"last":0.504},{"interface":"front","average":{"1min":3.1589999999999998,"5min":2.3730000000000002,"15min":1.8240000000000001},"min":{"1min":0.63700000000000001,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":27.765000000000001,"5min":27.765000000000001,"15min":27.765000000000001},"last":0.94599999999999995}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":1.794,"15min":1.458},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":15.462999999999999,"5min":15.462999999999999,"15min":15.462999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":2.7879999999999998,"5min":1.9590000000000001,"15min":1.6519999999999999},"min":{"1min":0.48599999999999999,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":23.225999999999999,"5min":23.225999999999999,"15min":23.225999999999999},"last":1.363}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7070000000000001,"15min":1.7010000000000001},"min":{"1min":0.497,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":6.3869999999999996,"5min":10.574,"15min":11.516},"last":0.495},{"interface":"front","average":{"1min":1.929,"5min":2.4420000000000002,"15min":2.0070000000000001},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":13.446,"5min":13.446,"15min":18.081},"last":0.72199999999999998}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.499,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":10.872,"5min":10.872,"15min":10.872},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.51600000000000001,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.26300000000000001},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.9569999999999999},"last":0.33600000000000002}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":8.8109999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.669,"5min":0.66400000000000003,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.30399999999999999,"15min":0.26300000000000001},"max":{"1min":21.373000000000001,"5min":21.373000000000001,"15min":21.373000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.52500000000000002,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":6.2009999999999996},"last":0.437},{"interface":"front","average":{"1min":0.875,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":6.7359999999999998,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":0.375}]}]},{"osd":6,"up_from":13,"seq":55834580652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1601644,"kb_used_data":420,"kb_used_omap":212,"kb_used_meta":1601003,"kb_avail":92770196,"statfs":{"total":96636764160,"available":94996680704,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217819,"internal_metadata":1639427365},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.5900000000000001,"15min":1.296},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":5.4939999999999998,"5min":24.896999999999998,"15min":24.896999999999998},"last":0.622},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.0870000000000002,"15min":1.5760000000000001},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.39200000000000002},"max":{"1min":11.02,"5min":37.939,"15min":37.939},"last":0.73099999999999998}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.8100000000000001,"15min":1.645},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":10.977,"5min":10.977,"15min":11.359999999999999},"last":3.121},{"interface":"front","average":{"1min":4.3490000000000002,"5min":2.1859999999999999,"15min":1.796},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":37.594999999999999,"5min":37.594999999999999,"15min":37.594999999999999},"last":0.60599999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":1.742,"15min":1.599},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":15.630000000000001,"5min":15.630000000000001,"15min":15.630000000000001},"last":9.6799999999999997},{"interface":"front","average":{"1min":2.75,"5min":1.9299999999999999,"15min":1.6100000000000001},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.42699999999999999},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":3.4199999999999999}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":1.9970000000000001,"15min":1.6699999999999999},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"max":{"1min":12.163,"5min":15.5,"15min":15.5},"last":22.184000000000001},{"interface":"front","average":{"1min":2.488,"5min":2.8959999999999999,"15min":1.8839999999999999},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":13.254,"5min":50.070999999999998,"15min":50.070999999999998},"last":1.399}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.68999999999999995,"15min":0.46100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.246},"max":{"1min":1.135,"5min":25.050999999999998,"15min":25.050999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.58599999999999997,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":12.782,"5min":12.782,"15min":12.782},"last":0.46400000000000002}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.998,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.75900000000000001,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.49399999999999999,"5min":24.937999999999999,"15min":24.937999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.627,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.49199999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.58999999999999997}]}]},{"osd":5,"up_from":13,"seq":55834580652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1766828,"kb_used_data":420,"kb_used_omap":725,"kb_used_meta":1765674,"kb_avail":92605012,"statfs":{"total":96636764160,"available":94827532288,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":742844,"internal_metadata":1808050756},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.385,"15min":1.175},"min":{"1min":0.41599999999999998,"5min":0.39000000000000001,"15min":0.38},"max":{"1min":10.455,"5min":10.455,"15min":10.455},"last":2.544},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.264,"15min":1.2190000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":10.053000000000001,"5min":10.053000000000001,"15min":10.053000000000001},"last":1.103}]},{"osd":1,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":2.1549999999999998,"5min":1.5409999999999999,"15min":1.4930000000000001},"min":{"1min":0.46899999999999997,"5min":0.41899999999999998,"15min":0.36799999999999999},"max":{"1min":10.116,"5min":10.116,"15min":12.682},"last":0.55500000000000005},{"interface":"front","average":{"1min":2.0670000000000002,"5min":1.504,"15min":1.413},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.2389999999999999,"5min":9.9830000000000005,"15min":24.847999999999999},"last":2.7679999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":3.883,"5min":2.1299999999999999,"15min":1.7190000000000001},"min":{"1min":0.501,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":27.013999999999999,"5min":27.013999999999999,"15min":27.013999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6339999999999999,"15min":1.347},"min":{"1min":0.48399999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":10.146000000000001,"5min":10.146000000000001,"15min":12.281000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2759999999999998,"5min":1.827,"15min":1.819},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":7.6630000000000003,"5min":10.638,"15min":16.055},"last":0.80700000000000005},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.9950000000000001,"15min":1.76},"min":{"1min":0.56000000000000005,"5min":0.45500000000000002,"15min":0.41799999999999998},"max":{"1min":14.384,"5min":14.384,"15min":14.384},"last":6.7190000000000003}]},{"osd":4,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.40500000000000003,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.249,"15min":0.24199999999999999},"max":{"1min":5.2110000000000003,"5min":5.2110000000000003,"15min":5.2110000000000003},"last":0.496},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.38500000000000001,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.25,"15min":0.25},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.41199999999999998,"15min":0.39700000000000002},"min":{"1min":0.29799999999999999,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":0.44},{"interface":"front","average":{"1min":1.141,"5min":0.56499999999999995,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.26500000000000001},"max":{"1min":14.951000000000001,"5min":14.951000000000001,"15min":14.951000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Nov 28 06:31:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.45200000000000001,"15min":0.439},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.47499999999999998,"15min":0.46000000000000002},"min":{"1min":0.34399999999999997,"5min":0.316,"15min":0.316},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.48299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834580650,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1589932,"kb_used_data":420,"kb_used_omap":1298,"kb_used_meta":1588205,"kb_avail":92781908,"statfs":{"total":96636764160,"available":95008673792,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1330133,"internal_metadata":1626321963},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.3779999999999999,"15min":1.214},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":3.1080000000000001,"5min":10.359999999999999,"15min":10.542},"last":3.9849999999999999},{"interface":"front","average":{"1min":1.46,"5min":1.5600000000000001,"15min":1.2310000000000001},"min":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.40899999999999997},"max":{"1min":11.694000000000001,"5min":12.416,"15min":12.416},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":2.1960000000000002,"15min":1.7889999999999999},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":28.722999999999999,"5min":28.722999999999999,"15min":28.722999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":3.0539999999999998,"5min":2.016,"15min":1.671},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.40100000000000002},"max":{"1min":27.699000000000002,"5min":27.699000000000002,"15min":27.699000000000002},"last":3.8439999999999999}]},{"osd":2,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.5649999999999999,"15min":1.4350000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42499999999999999},"max":{"1min":13.481999999999999,"5min":13.481999999999999,"15min":13.481999999999999},"last":8.7910000000000004},{"interface":"front","average":{"1min":2.2589999999999999,"5min":1.6619999999999999,"15min":1.4770000000000001},"min":{"1min":0.51500000000000001,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":7.992,"5min":9.9149999999999991,"15min":11.736000000000001},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.8440000000000001,"15min":1.71},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.40100000000000002},"max":{"1min":11.721,"5min":12.382,"15min":12.382},"last":8.9860000000000007},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.2280000000000002,"15min":1.9259999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.39300000000000002},"max":{"1min":12.007999999999999,"5min":12.007999999999999,"15min":13.673999999999999},"last":9.3480000000000008}]},{"osd":5,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.1359999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.374},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.621,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":11.664,"5min":12.446999999999999,"15min":12.446999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.51400000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":11.507999999999999,"5min":11.507999999999999,"15min":11.507999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.53900000000000003,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.47599999999999998}]},{"osd":7,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70499999999999996,"15min":0.52900000000000003},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":11.629,"5min":12.336,"15min":12.336},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.56299999999999994,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":11.471,"5min":11.471,"15min":11.471},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834580478,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2358196,"kb_used_data":507188,"kb_used_omap":1855,"kb_used_meta":1753408,"kb_avail":92013644,"statfs":{"total":96636764160,"available":94221971456,"internally_reserved":0,"allocated":519360512,"data_stored":518072644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1899643,"internal_metadata":1795490693},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":128,"apply_latency_ms":128,"commit_latency_ns":128000000,"apply_latency_ns":128000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":3.544,"15min":3.3690000000000002},"min":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54100000000000004},"max":{"1min":29.311,"5min":29.311,"15min":29.311},"last":4.1230000000000002},{"interface":"front","average":{"1min":3.6379999999999999,"5min":3.5030000000000001,"15min":3.3599999999999999},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.56299999999999994},"max":{"1min":20.762,"5min":21.399999999999999,"15min":21.399999999999999},"last":3.8570000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.7090000000000001,"5min":4.0350000000000001,"15min":3.4969999999999999},"min":{"1min":0.625,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":11.140000000000001,"5min":20.879999999999999,"15min":20.879999999999999},"last":5.4729999999999999},{"interface":"front","average":{"1min":4.9059999999999997,"5min":5.3449999999999998,"15min":4.2279999999999998},"min":{"1min":0.70699999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":29.452999999999999,"5min":48.625999999999998,"15min":48.625999999999998},"last":4.3220000000000001}]},{"osd":2,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.859,"5min":4.306,"15min":3.7650000000000001},"min":{"1min":0.93899999999999995,"5min":0.75,"15min":0.66600000000000004},"max":{"1min":25.378,"5min":33.497999999999998,"15min":33.497999999999998},"last":2.766},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.5259999999999998,"15min":3.4700000000000002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65100000000000002},"max":{"1min":11.054,"5min":21.193000000000001,"15min":21.193000000000001},"last":2.661}]},{"osd":4,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.7949999999999999,"15min":2.7570000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55900000000000005},"max":{"1min":9.6820000000000004,"5min":21.931999999999999,"15min":21.931999999999999},"last":1.385},{"interface":"front","average":{"1min":2.544,"5min":3.2669999999999999,"15min":2.839},"min":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.60599999999999998},"max":{"1min":10.705,"5min":21.013999999999999,"15min":21.013999999999999},"last":1.724}]},{"osd":5,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":3.5209999999999999,"15min":3.0129999999999999},"min":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.69499999999999995},"max":{"1min":10.881,"5min":21.344000000000001,"15min":21.344000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":2.2389999999999999,"5min":2.9769999999999999,"15min":2.8319999999999999},"min":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":9.4179999999999993,"5min":21.631,"15min":21.631},"last":2.4289999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":3.077,"15min":2.9769999999999999},"min":{"1min":0.84599999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":9.5670000000000002,"5min":21.792000000000002,"15min":21.792000000000002},"last":2.5539999999999998},{"interface":"front","average":{"1min":2.452,"5min":2.9940000000000002,"15min":2.9790000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.72199999999999998},"max":{"1min":9.7729999999999997,"5min":21.838999999999999,"15min":21.838999999999999},"last":1.488}]},{"osd":7,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":3.1309999999999998,"15min":3.0899999999999999},"min":{"1min":0.91600000000000004,"5min":0.89300000000000002,"15min":0.79700000000000004},"max":{"1min":9.8710000000000004,"5min":25.337,"15min":25.337},"last":1.5629999999999999},{"interface":"front","average":{"1min":2.8199999999999998,"5min":3.6779999999999999,"15min":3.246},"min":{"1min":0.94299999999999995,"5min":0.89200000000000002,"15min":0.80700000000000005},"max":{"1min":11.234,"5min":21.274000000000001,"15min":21.274000000000001},"last":1.8}]}]},{"osd":2,"up_from":13,"seq":55834580577,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1737560,"kb_used_data":654288,"kb_used_omap":591,"kb_used_meta":1082672,"kb_avail":92634280,"statfs":{"total":96636764160,"available":94857502720,"internally_reserved":0,"allocated":669990912,"data_stored":668425939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":605891,"internal_metadata":1108656445},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":97,"apply_latency_ms":97,"commit_latency_ns":97000000,"apply_latency_ns":97000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":2.8530000000000002,"15min":2.8610000000000002},"min":{"1min":0.66200000000000003,"5min":0.58099999999999996,"15min":0.56200000000000006},"max":{"1min":7.4779999999999998,"5min":15.250999999999999,"15min":21.669},"last":5.5759999999999996},{"interface":"front","average":{"1min":4.1440000000000001,"5min":3.3460000000000001,"15min":3.1259999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":27.016999999999999,"5min":27.016999999999999,"15min":27.016999999999999},"last":4.2670000000000003}]},{"osd":1,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3449999999999998,"5min":3.786,"15min":3.3029999999999999},"min":{"1min":0.76900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":15.436999999999999,"5min":15.436999999999999,"15min":18.707000000000001},"last":5.6840000000000002},{"interface":"front","average":{"1min":4.6319999999999997,"5min":3.98,"15min":3.4489999999999998},"min":{"1min":0.80400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"max":{"1min":22.309999999999999,"5min":22.309999999999999,"15min":22.309999999999999},"last":13.265000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":3.2469999999999999,"15min":3.0299999999999998},"min":{"1min":1.149,"5min":0.71599999999999997,"15min":0.65800000000000003},"max":{"1min":13.811999999999999,"5min":16.957000000000001,"15min":17.643000000000001},"last":2.1859999999999999},{"interface":"front","average":{"1min":5.327,"5min":4.1390000000000002,"15min":3.556},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82699999999999996},"max":{"1min":17.016999999999999,"5min":17.016999999999999,"15min":17.016999999999999},"last":19.274999999999999}]},{"osd":4,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.5880000000000001,"15min":2.3719999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.59099999999999997},"max":{"1min":6.8479999999999999,"5min":11.452999999999999,"15min":13.121},"last":2.8519999999999999},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.734,"15min":2.4510000000000001},"min":{"1min":0.66100000000000003,"5min":0.64000000000000001,"15min":0.58199999999999996},"max":{"1min":12.598000000000001,"5min":13.615,"15min":15.178000000000001},"last":3.0720000000000001}]},{"osd":5,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3730000000000002,"5min":2.3490000000000002,"15min":2.0619999999999998},"min":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.60399999999999998},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":2.0110000000000001},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.7320000000000002,"15min":2.5219999999999998},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":7.2169999999999996,"5min":11.573,"15min":13.02},"last":2.952}]},{"osd":6,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":2.9249999999999998,"15min":2.6429999999999998},"min":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.68600000000000005},"max":{"1min":12.707000000000001,"5min":13.789999999999999,"15min":14.960000000000001},"last":3.1749999999999998},{"interface":"front","average":{"1min":3.468,"5min":2.3940000000000001,"15min":2.2029999999999998},"min":{"1min":0.86099999999999999,"5min":0.745,"15min":0.71099999999999997},"max":{"1min":10.02,"5min":11.057,"15min":11.135},"last":2.1000000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.871,"5min":3.0019999999999998,"15min":2.7480000000000002},"min":{"1min":0.873,"5min":0.83699999999999997,"15min":0.78000000000000003},"max":{"1min":12.794,"5min":13.715999999999999,"15min":15.257999999999999},"last":3.2650000000000001},{"interface":"front","average":{"1min":3.569,"5min":2.46,"15min":2.3570000000000002},"min":{"1min":0.98299999999999998,"5min":0.81699999999999995,"15min":0.78300000000000003},"max":{"1min":10.102,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.9079999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580531,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6155088,"kb_used_data":4723732,"kb_used_omap":1951,"kb_used_meta":1409248,"kb_avail":88216752,"statfs":{"total":96636764160,"available":90333954048,"internally_reserved":0,"allocated":4837101568,"data_stored":4826927780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1997886,"internal_metadata":1443070914},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":192,"apply_latency_ms":192,"commit_latency_ns":192000000,"apply_latency_ns":192000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":5.7130000000000001,"5min":3.6629999999999998,"15min":2.9430000000000001},"min":{"1min":0.67000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":27.271999999999998,"5min":27.271999999999998,"15min":27.271999999999998},"last":2.3069999999999999},{"interface":"front","average":{"1min":5.0270000000000001,"5min":3.2719999999999998,"15min":3.0569999999999999},"min":{"1min":0.77300000000000002,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":33.43,"5min":33.43,"15min":33.43},"last":2.577}]},{"osd":2,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.9930000000000003,"5min":3.9260000000000002,"15min":3.2650000000000001},"min":{"1min":0.89100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":18.050999999999998,"5min":18.050999999999998,"15min":18.050999999999998},"last":2.8420000000000001},{"interface":"front","average":{"1min":5.2759999999999998,"5min":4.2300000000000004,"15min":3.355},"min":{"1min":1.2749999999999999,"5min":0.73799999999999999,"15min":0.65300000000000002},"max":{"1min":26.978999999999999,"5min":26.978999999999999,"15min":26.978999999999999},"last":3.3660000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.5490000000000004,"5min":4.2370000000000001,"15min":3.5739999999999998},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.69299999999999995},"max":{"1min":11.843,"5min":11.843,"15min":16.558},"last":13.57},{"interface":"front","average":{"1min":6.7859999999999996,"5min":4.726,"15min":3.9449999999999998},"min":{"1min":0.88100000000000001,"5min":0.73199999999999998,"15min":0.65100000000000002},"max":{"1min":33.329999999999998,"5min":33.329999999999998,"15min":33.329999999999998},"last":8.9710000000000001}]},{"osd":4,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.673,"15min":2.2989999999999999},"min":{"1min":0.71599999999999997,"5min":0.67400000000000004,"15min":0.58099999999999996},"max":{"1min":13.111000000000001,"5min":13.278,"15min":13.278},"last":1.425},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.8660000000000001,"15min":2.4660000000000002},"min":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":6.1710000000000003,"5min":10.628,"15min":12.055999999999999},"last":1.607}]},{"osd":5,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":2.7639999999999998,"15min":2.6200000000000001},"min":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.622},"max":{"1min":13.535,"5min":13.535,"15min":13.535},"last":2.0110000000000001},{"interface":"front","average":{"1min":3.7989999999999999,"5min":2.9340000000000002,"15min":2.4729999999999999},"min":{"1min":0.877,"5min":0.78100000000000003,"15min":0.71799999999999997},"max":{"1min":18.117000000000001,"5min":18.117000000000001,"15min":18.117000000000001},"last":1.323}]},{"osd":6,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.4220000000000002,"5min":2.843,"15min":2.7450000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":9.9719999999999995,"5min":9.9719999999999995,"15min":12.875},"last":2.133},{"interface":"front","average":{"1min":4.1749999999999998,"5min":3.1099999999999999,"15min":2.645},"min":{"1min":1.0640000000000001,"5min":0.875,"15min":0.80500000000000005},"max":{"1min":27.998999999999999,"5min":27.998999999999999,"15min":27.998999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":3.056,"15min":2.6739999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76100000000000001},"max":{"1min":6.0789999999999997,"5min":10.736000000000001,"15min":12.144},"last":3.21},{"interface":"front","average":{"1min":3.3679999999999999,"5min":2.8999999999999999,"15min":2.8679999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":10.055999999999999,"5min":10.055999999999999,"15min":12.952},"last":2.2160000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580617,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2144224,"kb_used_data":591460,"kb_used_omap":767,"kb_used_meta":1539200,"kb_avail":92227616,"statfs":{"total":96636764160,"available":94441078784,"internally_reserved":0,"allocated":605655040,"data_stored":604390502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786324,"internal_metadata":1576140908},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":105,"apply_latency_ms":105,"commit_latency_ns":105000000,"apply_latency_ns":105000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5230000000000001,"5min":3.1309999999999998,"15min":3.0510000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.4019999999999992,"5min":59.180999999999997,"15min":59.180999999999997},"last":2.9870000000000001},{"interface":"front","average":{"1min":3.657,"5min":2.8799999999999999,"15min":2.9550000000000001},"min":{"1min":0.873,"5min":0.64500000000000002,"15min":0.54900000000000004},"max":{"1min":12.970000000000001,"5min":12.970000000000001,"15min":14.712999999999999},"last":5.7110000000000003}]},{"osd":2,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":3.6480000000000001,"15min":3.1459999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.55000000000000004},"max":{"1min":5.9009999999999998,"5min":80.992000000000004,"15min":80.992000000000004},"last":3.0840000000000001},{"interface":"front","average":{"1min":3.6339999999999999,"5min":3.5779999999999998,"15min":3.1389999999999998},"min":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.59299999999999997},"max":{"1min":12.484,"5min":14.989000000000001,"15min":14.989000000000001},"last":4.093}]},{"osd":3,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.9399999999999999,"5min":3.613,"15min":3.3540000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.5350000000000001,"5min":16.291,"15min":16.291},"last":8.5350000000000001},{"interface":"front","average":{"1min":3.7050000000000001,"5min":5.0620000000000003,"15min":3.9990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":12.747999999999999,"5min":80.918000000000006,"15min":80.918000000000006},"last":7.8239999999999998}]},{"osd":4,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.982,"15min":1.8380000000000001},"min":{"1min":0.67200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":12.039999999999999,"5min":14.657,"15min":14.657},"last":3.4260000000000002},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.8849999999999998,"15min":2.4710000000000001},"min":{"1min":0.82699999999999996,"5min":0.65600000000000003,"15min":0.61599999999999999},"max":{"1min":5.5949999999999998,"5min":80.745000000000005,"15min":80.745000000000005},"last":2.7469999999999999}]},{"osd":5,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5150000000000001,"5min":2.5099999999999998,"15min":2.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.626},"max":{"1min":6.3369999999999997,"5min":15.202999999999999,"15min":15.202999999999999},"last":4.0010000000000003},{"interface":"front","average":{"1min":2.415,"5min":2.1930000000000001,"15min":2.0419999999999998},"min":{"1min":0.93600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":11.775,"5min":14.800000000000001,"15min":14.800000000000001},"last":3.6800000000000002}]},{"osd":6,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.2829999999999999,"15min":2.149},"min":{"1min":1.0129999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":11.959,"5min":14.917,"15min":14.917},"last":3.528},{"interface":"front","average":{"1min":2.177,"5min":3.0350000000000001,"15min":2.6930000000000001},"min":{"1min":1.0069999999999999,"5min":0.82199999999999995,"15min":0.72399999999999998},"max":{"1min":5.8090000000000002,"5min":80.840000000000003,"15min":80.840000000000003},"last":2.8650000000000002}]},{"osd":7,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.657,"15min":2.4700000000000002},"min":{"1min":1.0740000000000001,"5min":0.90600000000000003,"15min":0.72099999999999997},"max":{"1min":6.444,"5min":15.118,"15min":15.118},"last":4.5300000000000002},{"interface":"front","average":{"1min":2.5670000000000002,"5min":2.395,"15min":2.262},"min":{"1min":1.0549999999999999,"5min":0.88,"15min":0.88},"max":{"1min":11.880000000000001,"5min":15.396000000000001,"15min":15.396000000000001},"last":3.5880000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T06:32:55.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T06:32:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.050+0000 7f38dc8b6640 1 Processor -- start 2023-11-28T06:32:56.051 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.050+0000 7f38dc8b6640 1 -- start start 2023-11-28T06:32:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38dc8b6640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38d815d330 0x7f38d80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38dc8b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d80d2910 0x7f38d80d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38dc8b6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d80b2b10 con 0x7f38d80d3730 2023-11-28T06:32:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38dc8b6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80d3bc0 con 0x7f38d80d2910 2023-11-28T06:32:56.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38dc8b6640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80d1590 con 0x7f38d815d330 2023-11-28T06:32:56.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38cdd9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f38d80d2910 0x7f38d80d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:56.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.052+0000 7f38d659c640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38d815d330 0x7f38d80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:56.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d6d9d640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f38d80d3730 0x7f38d80b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:43844/0 (socket says 172.21.15.154:43844) 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d6d9d640 1 -- 172.21.15.154:0/814139797 learned_addr learned my addr 172.21.15.154:0/814139797 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d659c640 1 -- 172.21.15.154:0/814139797 >> v2:172.21.15.154:3300/0 conn(0x7f38d80d2910 msgr2=0x7f38d80d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d659c640 1 --2- 172.21.15.154:0/814139797 >> v2:172.21.15.154:3300/0 conn(0x7f38d80d2910 0x7f38d80d31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d659c640 1 -- 172.21.15.154:0/814139797 >> v1:172.21.15.194:6789/0 conn(0x7f38d80d3730 legacy=0x7f38d80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d5d9b640 1 -- 172.21.15.154:0/814139797 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206495840 0 0) 0x7f38d80b2b10 con 0x7f38d80d3730 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38d659c640 1 -- 172.21.15.154:0/814139797 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80d1870 con 0x7f38d815d330 2023-11-28T06:32:56.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.053+0000 7f38cdd9b640 1 --2- 172.21.15.154:0/814139797 >> v2:172.21.15.154:3300/0 conn(0x7f38d80d2910 0x7f38d80d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:56.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.055+0000 7f38d659c640 1 --2- 172.21.15.154:0/814139797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d80b8b80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f38d80d0d10 tx=0x7f38c802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b278691134a7d03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:56.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.056+0000 7f38d5d9b640 1 -- 172.21.15.154:0/814139797 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c802e070 con 0x7f38d815d330 2023-11-28T06:32:56.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.056+0000 7f38d5d9b640 1 -- 172.21.15.154:0/814139797 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c80315a0 con 0x7f38d815d330 2023-11-28T06:32:56.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.056+0000 7f38d5d9b640 1 -- 172.21.15.154:0/814139797 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8031930 con 0x7f38d815d330 2023-11-28T06:32:56.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.057+0000 7f38dc8b6640 1 -- 172.21.15.154:0/814139797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 msgr2=0x7f38d80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:56.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.057+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/814139797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d80b8b80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f38d80d0d10 tx=0x7f38c802b840 comp rx=0 tx=0).stop 2023-11-28T06:32:56.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.057+0000 7f38dc8b6640 1 -- 172.21.15.154:0/814139797 shutdown_connections 2023-11-28T06:32:56.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.057+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/814139797 >> v2:172.21.15.154:3300/0 conn(0x7f38d80d2910 0x7f38d80d31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.057+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/814139797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d80b8b80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.057+0000 7f38dc8b6640 1 -- 172.21.15.154:0/814139797 >> 172.21.15.154:0/814139797 conn(0x7f38d8072020 msgr2=0x7f38d8072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:56.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.058+0000 7f38dc8b6640 1 -- 172.21.15.154:0/814139797 shutdown_connections 2023-11-28T06:32:56.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.058+0000 7f38dc8b6640 1 -- 172.21.15.154:0/814139797 wait complete. 2023-11-28T06:32:56.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.062+0000 7f38dc8b6640 1 Processor -- start 2023-11-28T06:32:56.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.062+0000 7f38dc8b6640 1 -- start start 2023-11-28T06:32:56.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38dc8b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d80d2910 0x7f38d80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:56.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38dc8b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d80d3730 0x7f38d814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:56.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38dc8b6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:56.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38dc8b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8157da0 con 0x7f38d80d3730 2023-11-28T06:32:56.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38dc8b6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d815e800 con 0x7f38d815d330 2023-11-28T06:32:56.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38dc8b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c9bb0 con 0x7f38d80d2910 2023-11-28T06:32:56.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38cdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d80d3730 0x7f38d814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:56.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38d659c640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d80d2910 0x7f38d80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:56.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38d6d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:56.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38cdd9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d80d3730 0x7f38d814b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55334/0 (socket says 172.21.15.154:55334) 2023-11-28T06:32:56.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.064+0000 7f38cdd9b640 1 -- 172.21.15.154:0/1768530206 learned_addr learned my addr 172.21.15.154:0/1768530206 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:56.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.065+0000 7f38d6d9d640 1 -- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d80d2910 msgr2=0x7f38d80c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:56.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.065+0000 7f38d6d9d640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d80d2910 0x7f38d80c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.065+0000 7f38d6d9d640 1 -- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d80d3730 msgr2=0x7f38d814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:56.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.065+0000 7f38d6d9d640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d80d3730 0x7f38d814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.065+0000 7f38d6d9d640 1 -- 172.21.15.154:0/1768530206 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009400 con 0x7f38d815d330 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.065+0000 7f38d659c640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d80d2910 0x7f38d80c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.066+0000 7f38d6d9d640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d815ec90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c750 tx=0x7f38d000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.066+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000ce60 con 0x7f38d815d330 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.066+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000a640 con 0x7f38d815d330 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.066+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c8009400 con 0x7f38d815d330 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.066+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000a9d0 con 0x7f38d815d330 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.066+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d815ded0 con 0x7f38d815d330 2023-11-28T06:32:56.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.069+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d815e970 con 0x7f38d815d330 2023-11-28T06:32:56.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.069+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f38d000ab30 con 0x7f38d815d330 2023-11-28T06:32:56.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.070+0000 7f38cf7fe640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f38b806b1f0 0x7f38b806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:56.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.071+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f38d0088d50 con 0x7f38d815d330 2023-11-28T06:32:56.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.071+0000 7f38d659c640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f38b806b1f0 0x7f38b806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:56.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.072+0000 7f38d659c640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f38b806b1f0 0x7f38b806d6b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f38c8036000 tx=0x7f38c803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:56.076 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.075+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f38d008c030 con 0x7f38d815d330 2023-11-28T06:32:56.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.631+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38d8069400 con 0x7f38d815d330 2023-11-28T06:32:56.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.632+0000 7f38cf7fe640 1 -- 172.21.15.154:0/1768530206 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13013 (secure 0 0 0) 0x7f38d0018090 con 0x7f38d815d330 2023-11-28T06:32:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:32:56.633 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":37,"fsid":"480179ad-e540-429b-b1ff-bfa2150dc1f7","created":"2023-11-27T22:29:14.874190+0000","modified":"2023-11-28T06:32:46.055332+0000","last_up_change":"2023-11-27T22:29:25.899295+0000","last_in_change":"2023-11-27T22:29:17.168050+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T22:29:27.002801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"660e47f5-88f5-4658-82b2-2f3bc1aa0425","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6809","nonce":1665928512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6811","nonce":1665928512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6815","nonce":1665928512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1665928512},{"type":"v1","addr":"172.21.15.154:6813","nonce":1665928512}]},"public_addr":"172.21.15.154:6809/1665928512","cluster_addr":"172.21.15.154:6811/1665928512","heartbeat_back_addr":"172.21.15.154:6815/1665928512","heartbeat_front_addr":"172.21.15.154:6813/1665928512","state":["exists","up"]},{"osd":1,"uuid":"5a64a2f5-2127-41d8-be29-8a94f7478320","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6801","nonce":2129709276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6803","nonce":2129709276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6807","nonce":2129709276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2129709276},{"type":"v1","addr":"172.21.15.154:6805","nonce":2129709276}]},"public_addr":"172.21.15.154:6801/2129709276","cluster_addr":"172.21.15.154:6803/2129709276","heartbeat_back_addr":"172.21.15.154:6807/2129709276","heartbeat_front_addr":"172.21.15.154:6805/2129709276","state":["exists","up"]},{"osd":2,"uuid":"1e14ec85-3b64-4de3-ae11-8b86befd036b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6817","nonce":498194302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6819","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6821","nonce":498194302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6827","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6829","nonce":498194302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6823","nonce":498194302},{"type":"v1","addr":"172.21.15.154:6825","nonce":498194302}]},"public_addr":"172.21.15.154:6817/498194302","cluster_addr":"172.21.15.154:6821/498194302","heartbeat_back_addr":"172.21.15.154:6829/498194302","heartbeat_front_addr":"172.21.15.154:6825/498194302","state":["exists","up"]},{"osd":3,"uuid":"8f0db288-fd6e-469b-819a-01696349bb99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6820","nonce":85167042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6824","nonce":85167042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6831","nonce":85167042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":85167042},{"type":"v1","addr":"172.21.15.154:6828","nonce":85167042}]},"public_addr":"172.21.15.154:6820/85167042","cluster_addr":"172.21.15.154:6824/85167042","heartbeat_back_addr":"172.21.15.154:6831/85167042","heartbeat_front_addr":"172.21.15.154:6828/85167042","state":["exists","up"]},{"osd":4,"uuid":"250928a5-f1a8-4488-8e26-96ee99a8fc38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6801","nonce":3400970964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6803","nonce":3400970964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6807","nonce":3400970964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3400970964},{"type":"v1","addr":"172.21.15.194:6805","nonce":3400970964}]},"public_addr":"172.21.15.194:6801/3400970964","cluster_addr":"172.21.15.194:6803/3400970964","heartbeat_back_addr":"172.21.15.194:6807/3400970964","heartbeat_front_addr":"172.21.15.194:6805/3400970964","state":["exists","up"]},{"osd":5,"uuid":"038313a0-a52b-4ac3-b461-90ef1cee37cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6809","nonce":3406558424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6811","nonce":3406558424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6815","nonce":3406558424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3406558424},{"type":"v1","addr":"172.21.15.194:6813","nonce":3406558424}]},"public_addr":"172.21.15.194:6809/3406558424","cluster_addr":"172.21.15.194:6811/3406558424","heartbeat_back_addr":"172.21.15.194:6815/3406558424","heartbeat_front_addr":"172.21.15.194:6813/3406558424","state":["exists","up"]},{"osd":6,"uuid":"2539ff84-b615-4650-87fa-8b5551c1978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6817","nonce":1458667325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6819","nonce":1458667325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6823","nonce":1458667325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1458667325},{"type":"v1","addr":"172.21.15.194:6821","nonce":1458667325}]},"public_addr":"172.21.15.194:6817/1458667325","cluster_addr":"172.21.15.194:6819/1458667325","heartbeat_back_addr":"172.21.15.194:6823/1458667325","heartbeat_front_addr":"172.21.15.194:6821/1458667325","state":["exists","up"]},{"osd":7,"uuid":"da39cc8a-67ce-490f-a9be-1e93bb7b1e48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6825","nonce":1808763162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6827","nonce":1808763162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6831","nonce":1808763162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1808763162},{"type":"v1","addr":"172.21.15.194:6829","nonce":1808763162}]},"public_addr":"172.21.15.194:6825/1808763162","cluster_addr":"172.21.15.194:6827/1808763162","heartbeat_back_addr":"172.21.15.194:6831/1808763162","heartbeat_front_addr":"172.21.15.194:6829/1808763162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.353505+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.346256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.328681+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.307662+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.309046+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.308166+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.283791+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T22:29:22.363214+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.154:6837/1494168994":"2023-11-29T06:32:41.009115+0000","172.21.15.154:6835/1494168994":"2023-11-29T06:32:41.009115+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T06:32:56.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f38b806b1f0 msgr2=0x7f38b806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f38b806b1f0 0x7f38b806d6b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f38c8036000 tx=0x7f38c803d040 comp rx=0 tx=0).stop 2023-11-28T06:32:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 msgr2=0x7f38d815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d815ec90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c750 tx=0x7f38d000cc10 comp rx=0 tx=0).stop 2023-11-28T06:32:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 shutdown_connections 2023-11-28T06:32:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38d815d330 0x7f38d815ec90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.639 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f38b806b1f0 0x7f38b806d6b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d80d3730 0x7f38d814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 --2- 172.21.15.154:0/1768530206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f38d80d2910 0x7f38d80c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.637+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 >> 172.21.15.154:0/1768530206 conn(0x7f38d8072020 msgr2=0x7f38d8072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.638+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 shutdown_connections 2023-11-28T06:32:56.640 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:56.638+0000 7f38dc8b6640 1 -- 172.21.15.154:0/1768530206 wait complete. 2023-11-28T06:32:57.668 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T06:32:57.669 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:32:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.970+0000 7f9cbc4fc640 1 Processor -- start 2023-11-28T06:32:57.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.971+0000 7f9cbc4fc640 1 -- start start 2023-11-28T06:32:57.974 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.973+0000 7f9cbc4fc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9cb41432a0 0x7f9cb415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.973+0000 7f9cbc4fc640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 0x7f9cb41409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.973+0000 7f9cbc4fc640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb406e960 con 0x7f9cb4143680 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.973+0000 7f9cbc4fc640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb415dec0 con 0x7f9cb406abe0 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.973+0000 7f9cbc4fc640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb415e1a0 con 0x7f9cb41432a0 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cbaa99640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 0x7f9cb41409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cbaa99640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 0x7f9cb41409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55348/0 (socket says 172.21.15.154:55348) 2023-11-28T06:32:57.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cbaa99640 1 -- 172.21.15.154:0/1097622998 learned_addr learned my addr 172.21.15.154:0/1097622998 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:57.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cba298640 1 --2- 172.21.15.154:0/1097622998 >> v2:172.21.15.194:3300/0 conn(0x7f9cb41432a0 0x7f9cb415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cb9a97640 1 --1- 172.21.15.154:0/1097622998 >> v1:172.21.15.194:6789/0 conn(0x7f9cb4143680 0x7f9cb406a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:43852/0 (socket says 172.21.15.154:43852) 2023-11-28T06:32:57.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cba298640 1 -- 172.21.15.154:0/1097622998 >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 msgr2=0x7f9cb41409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:57.976 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cba298640 1 --2- 172.21.15.154:0/1097622998 >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 0x7f9cb41409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cba298640 1 -- 172.21.15.154:0/1097622998 >> v1:172.21.15.194:6789/0 conn(0x7f9cb4143680 legacy=0x7f9cb406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cb9296640 1 -- 172.21.15.154:0/1097622998 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229077192 0 0) 0x7f9cb406e960 con 0x7f9cb4143680 2023-11-28T06:32:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cba298640 1 -- 172.21.15.154:0/1097622998 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb415e480 con 0x7f9cb41432a0 2023-11-28T06:32:57.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.974+0000 7f9cbaa99640 1 --2- 172.21.15.154:0/1097622998 >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 0x7f9cb41409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:57.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.977+0000 7f9cba298640 1 --2- 172.21.15.154:0/1097622998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb415d8e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9cb406cf10 tx=0x7f9cb002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=523513e1ec85c040 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:57.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.977+0000 7f9cb9296640 1 -- 172.21.15.154:0/1097622998 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0031830 con 0x7f9cb41432a0 2023-11-28T06:32:57.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.977+0000 7f9cb9296640 1 -- 172.21.15.154:0/1097622998 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0031990 con 0x7f9cb41432a0 2023-11-28T06:32:57.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.977+0000 7f9cb9296640 1 -- 172.21.15.154:0/1097622998 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0031d20 con 0x7f9cb41432a0 2023-11-28T06:32:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.978+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1097622998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 msgr2=0x7f9cb415d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:57.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.978+0000 7f9cbc4fc640 1 --2- 172.21.15.154:0/1097622998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb415d8e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f9cb406cf10 tx=0x7f9cb002b8d0 comp rx=0 tx=0).stop 2023-11-28T06:32:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.979+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1097622998 shutdown_connections 2023-11-28T06:32:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.979+0000 7f9cbc4fc640 1 --2- 172.21.15.154:0/1097622998 >> v2:172.21.15.154:3300/0 conn(0x7f9cb406abe0 0x7f9cb41409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.979+0000 7f9cbc4fc640 1 --2- 172.21.15.154:0/1097622998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb415d8e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:57.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.979+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1097622998 >> 172.21.15.154:0/1097622998 conn(0x7f9cb40b1de0 msgr2=0x7f9cb40b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.979+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1097622998 shutdown_connections 2023-11-28T06:32:57.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.979+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1097622998 wait complete. 2023-11-28T06:32:57.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.982+0000 7f9cbc4fc640 1 Processor -- start 2023-11-28T06:32:57.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.982+0000 7f9cbc4fc640 1 -- start start 2023-11-28T06:32:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.984+0000 7f9cbc4fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cb406abe0 0x7f9cb4141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.984+0000 7f9cbc4fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb413f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.984+0000 7f9cbc4fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4143680 0x7f9cb4156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.984+0000 7f9cbc4fc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb4142370 con 0x7f9cb4143680 2023-11-28T06:32:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.984+0000 7f9cbc4fc640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb41f32a0 con 0x7f9cb41432a0 2023-11-28T06:32:57.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.984+0000 7f9cbc4fc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb413fea0 con 0x7f9cb406abe0 2023-11-28T06:32:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cbaa99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4143680 0x7f9cb4156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cb406abe0 0x7f9cb4141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cb9a97640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb413f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cbaa99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4143680 0x7f9cb4156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:55354/0 (socket says 172.21.15.154:55354) 2023-11-28T06:32:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cb406abe0 0x7f9cb4141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:45000/0 (socket says 172.21.15.154:45000) 2023-11-28T06:32:57.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cbaa99640 1 -- 172.21.15.154:0/1066043296 learned_addr learned my addr 172.21.15.154:0/1066043296 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 -- 172.21.15.154:0/1066043296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 msgr2=0x7f9cb413f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:57.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb413f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 -- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4143680 msgr2=0x7f9cb4156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cb4143680 0x7f9cb4156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.985+0000 7f9cba298640 1 -- 172.21.15.154:0/1066043296 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009b30 con 0x7f9cb406abe0 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.986+0000 7f9cb9a97640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cb41432a0 0x7f9cb413f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.986+0000 7f9cba298640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cb406abe0 0x7f9cb4141210 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0033000 tx=0x7f9cb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.986+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb003a630 con 0x7f9cb406abe0 2023-11-28T06:32:57.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.986+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb003a7b0 con 0x7f9cb406abe0 2023-11-28T06:32:57.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.987+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb0009400 con 0x7f9cb406abe0 2023-11-28T06:32:57.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.987+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb003ab60 con 0x7f9cb406abe0 2023-11-28T06:32:57.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.987+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb4141ad0 con 0x7f9cb406abe0 2023-11-28T06:32:57.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.989+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9cb4140680 con 0x7f9cb406abe0 2023-11-28T06:32:57.991 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.990+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f9cb003acc0 con 0x7f9cb406abe0 2023-11-28T06:32:57.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.991+0000 7f9caaffd640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c9806b1c0 0x7f9c9806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.991+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9cb00ab2e0 con 0x7f9cb406abe0 2023-11-28T06:32:57.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.991+0000 7f9cb9a97640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c9806b1c0 0x7f9c9806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.992+0000 7f9caaffd640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7f9c98071020 0x7f9c98073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:57.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.992+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 --> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c98073af0 con 0x7f9c98071020 2023-11-28T06:32:57.993 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.992+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9cb00ad9a0 con 0x7f9cb406abe0 2023-11-28T06:32:57.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.992+0000 7f9cbaa99640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7f9c98071020 0x7f9c98073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:57.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.993+0000 7f9cb9a97640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c9806b1c0 0x7f9c9806d680 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4161050 tx=0x7f9ca4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:57.994 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.993+0000 7f9cbaa99640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7f9c98071020 0x7f9c98073440 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:57.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:57.995+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== osd.0 v2:172.21.15.154:6808/1665928512 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9c98073af0 con 0x7f9c98071020 2023-11-28T06:32:58.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.034+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 --> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9cb4067420 con 0x7f9c98071020 2023-11-28T06:32:58.035 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.034+0000 7f9caaffd640 1 -- 172.21.15.154:0/1066043296 <== osd.0 v2:172.21.15.154:6808/1665928512 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9cb4067420 con 0x7f9c98071020 2023-11-28T06:32:58.035 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:32:58.036 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:32:58.036 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:32:58.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7f9c98071020 msgr2=0x7f9c98073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6808/1665928512,v1:172.21.15.154:6809/1665928512] conn(0x7f9c98071020 0x7f9c98073440 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c9806b1c0 msgr2=0x7f9c9806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f9c9806b1c0 0x7f9c9806d680 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4161050 tx=0x7f9ca4007de0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cb406abe0 msgr2=0x7f9cb4141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 --2- 172.21.15.154:0/1066043296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cb406abe0 0x7f9cb4141210 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0033000 tx=0x7f9cb00046c0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbaa99640 1 -- 172.21.15.154:0/1066043296 reap_dead start 2023-11-28T06:32:58.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 shutdown_connections 2023-11-28T06:32:58.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.035+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 >> 172.21.15.154:0/1066043296 conn(0x7f9cb40b1de0 msgr2=0x7f9cb40b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:58.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.036+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 shutdown_connections 2023-11-28T06:32:58.038 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.036+0000 7f9cbc4fc640 1 -- 172.21.15.154:0/1066043296 wait complete. 2023-11-28T06:32:58.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T06:32:58.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.355+0000 7ff29d314640 1 Processor -- start 2023-11-28T06:32:58.356 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.355+0000 7ff29d314640 1 -- start start 2023-11-28T06:32:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff29d314640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2980d2910 0x7ff2980d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:58.358 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff29d314640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff2980d3730 0x7ff2980b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff29d314640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980b2b10 con 0x7ff29815d330 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff29d314640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980d3bc0 con 0x7ff2980d3730 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff29d314640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980d1590 con 0x7ff2980d2910 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff28e7fc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2980d2910 0x7ff2980d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff296ffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff29815d330 0x7ff2980b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:43854/0 (socket says 172.21.15.154:43854) 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff296ffd640 1 -- 172.21.15.154:0/730647808 learned_addr learned my addr 172.21.15.154:0/730647808 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:58.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.357+0000 7ff2977fe640 1 --2- 172.21.15.154:0/730647808 >> v2:172.21.15.154:3300/0 conn(0x7ff2980d3730 0x7ff2980b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.358+0000 7ff28e7fc640 1 -- 172.21.15.154:0/730647808 >> v2:172.21.15.154:3300/0 conn(0x7ff2980d3730 msgr2=0x7ff2980b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.358+0000 7ff28e7fc640 1 --2- 172.21.15.154:0/730647808 >> v2:172.21.15.154:3300/0 conn(0x7ff2980d3730 0x7ff2980b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.358+0000 7ff28e7fc640 1 -- 172.21.15.154:0/730647808 >> v1:172.21.15.194:6789/0 conn(0x7ff29815d330 legacy=0x7ff2980b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.358+0000 7ff2967fc640 1 -- 172.21.15.154:0/730647808 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141585944 0 0) 0x7ff2980b2b10 con 0x7ff29815d330 2023-11-28T06:32:58.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.358+0000 7ff28e7fc640 1 -- 172.21.15.154:0/730647808 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980d1870 con 0x7ff2980d2910 2023-11-28T06:32:58.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.360+0000 7ff28e7fc640 1 --2- 172.21.15.154:0/730647808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2980d31f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff2980d1540 tx=0x7ff28002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584d1b2bfb32bfe4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:58.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.361+0000 7ff2967fc640 1 -- 172.21.15.154:0/730647808 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28002e070 con 0x7ff2980d2910 2023-11-28T06:32:58.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.361+0000 7ff2967fc640 1 -- 172.21.15.154:0/730647808 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2800315a0 con 0x7ff2980d2910 2023-11-28T06:32:58.362 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.361+0000 7ff2967fc640 1 -- 172.21.15.154:0/730647808 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280031930 con 0x7ff2980d2910 2023-11-28T06:32:58.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 -- 172.21.15.154:0/730647808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 msgr2=0x7ff2980d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 --2- 172.21.15.154:0/730647808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2980d31f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff2980d1540 tx=0x7ff28002b840 comp rx=0 tx=0).stop 2023-11-28T06:32:58.363 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 -- 172.21.15.154:0/730647808 shutdown_connections 2023-11-28T06:32:58.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 --2- 172.21.15.154:0/730647808 >> v2:172.21.15.154:3300/0 conn(0x7ff2980d3730 0x7ff2980b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 --2- 172.21.15.154:0/730647808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2980d31f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 -- 172.21.15.154:0/730647808 >> 172.21.15.154:0/730647808 conn(0x7ff298072020 msgr2=0x7ff298072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:58.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 -- 172.21.15.154:0/730647808 shutdown_connections 2023-11-28T06:32:58.364 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.362+0000 7ff29d314640 1 -- 172.21.15.154:0/730647808 wait complete. 2023-11-28T06:32:58.366 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.366+0000 7ff29d314640 1 Processor -- start 2023-11-28T06:32:58.367 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.366+0000 7ff29d314640 1 -- start start 2023-11-28T06:32:58.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff29d314640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2981600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:58.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff29d314640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2980d3730 0x7ff298157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff29d314640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29815d330 0x7ff2980c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff29d314640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29815d710 con 0x7ff2980d3730 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff29d314640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980cbe30 con 0x7ff2980d2910 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff29d314640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff298160630 con 0x7ff29815d330 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff296ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2981600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff2977fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29815d330 0x7ff2980c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:58.371 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff296ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2981600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:41496/0 (socket says 172.21.15.154:41496) 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.368+0000 7ff296ffd640 1 -- 172.21.15.154:0/3429334173 learned_addr learned my addr 172.21.15.154:0/3429334173 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff28e7fc640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2980d3730 0x7ff298157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff296ffd640 1 -- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29815d330 msgr2=0x7ff2980c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff296ffd640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29815d330 0x7ff2980c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff296ffd640 1 -- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2980d3730 msgr2=0x7ff298157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff296ffd640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2980d3730 0x7ff298157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff296ffd640 1 -- 172.21.15.154:0/3429334173 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280009400 con 0x7ff2980d2910 2023-11-28T06:32:58.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.369+0000 7ff2977fe640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29815d330 0x7ff2980c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.370+0000 7ff296ffd640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2981600f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c430 tx=0x7ff28800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:58.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.370+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880074e0 con 0x7ff2980d2910 2023-11-28T06:32:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.370+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288007660 con 0x7ff2980d2910 2023-11-28T06:32:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.370+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980cc0d0 con 0x7ff2980d2910 2023-11-28T06:32:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.370+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288004a20 con 0x7ff2980d2910 2023-11-28T06:32:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.370+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2980cc690 con 0x7ff2980d2910 2023-11-28T06:32:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.372+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff298069400 con 0x7ff2980d2910 2023-11-28T06:32:58.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.373+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7ff288004b80 con 0x7ff2980d2910 2023-11-28T06:32:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.374+0000 7ff28ffff640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff27806b1c0 0x7ff27806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.374+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2880893d0 con 0x7ff2980d2910 2023-11-28T06:32:58.375 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.374+0000 7ff28e7fc640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff27806b1c0 0x7ff27806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:58.376 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.375+0000 7ff28e7fc640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff27806b1c0 0x7ff27806d680 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff280036000 tx=0x7ff28003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:58.379 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.378+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7ff288054540 con 0x7ff2980d2910 2023-11-28T06:32:58.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.899+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff298066da0 con 0x7ff27806b1c0 2023-11-28T06:32:58.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.900+0000 7ff28ffff640 1 -- 172.21.15.154:0/3429334173 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff298066da0 con 0x7ff27806b1c0 2023-11-28T06:32:58.901 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T06:32:58.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff27806b1c0 msgr2=0x7ff27806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff27806b1c0 0x7ff27806d680 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff280036000 tx=0x7ff28003d040 comp rx=0 tx=0).stop 2023-11-28T06:32:58.907 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 msgr2=0x7ff2981600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:58.908 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2981600f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff28800c430 tx=0x7ff28800c8f0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 shutdown_connections 2023-11-28T06:32:58.909 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7ff27806b1c0 0x7ff27806d680 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff29815d330 0x7ff2980c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2980d3730 0x7ff298157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 --2- 172.21.15.154:0/3429334173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2980d2910 0x7ff2981600f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.905+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 >> 172.21.15.154:0/3429334173 conn(0x7ff298072020 msgr2=0x7ff2980cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:58.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.906+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 shutdown_connections 2023-11-28T06:32:58.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:58.906+0000 7ff29d314640 1 -- 172.21.15.154:0/3429334173 wait complete. 2023-11-28T06:32:58.936 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T06:32:58.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:32:59.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.235+0000 7fa21edd8640 1 Processor -- start 2023-11-28T06:32:59.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.235+0000 7fa21edd8640 1 -- start start 2023-11-28T06:32:59.238 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21edd8640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2180cf970 0x7fa21806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21edd8640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa21806ee30 0x7fa2180b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21edd8640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180cfe00 con 0x7fa218142e70 2023-11-28T06:32:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21edd8640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180cd4b0 con 0x7fa21806ee30 2023-11-28T06:32:59.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21edd8640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21806f280 con 0x7fa2180cf970 2023-11-28T06:32:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21d375640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa21806ee30 0x7fa2180b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21cb74640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa218142e70 0x7fa2180cca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38198/0 (socket says 172.21.15.154:38198) 2023-11-28T06:32:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa217fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2180cf970 0x7fa21806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.238+0000 7fa21cb74640 1 -- 172.21.15.154:0/2860116566 learned_addr learned my addr 172.21.15.154:0/2860116566 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.239+0000 7fa217fff640 1 -- 172.21.15.154:0/2860116566 >> v2:172.21.15.154:3300/0 conn(0x7fa21806ee30 msgr2=0x7fa2180b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:32:59.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.239+0000 7fa217fff640 1 --2- 172.21.15.154:0/2860116566 >> v2:172.21.15.154:3300/0 conn(0x7fa21806ee30 0x7fa2180b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.239+0000 7fa217fff640 1 -- 172.21.15.154:0/2860116566 >> v1:172.21.15.154:6789/0 conn(0x7fa218142e70 legacy=0x7fa2180cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.239+0000 7fa217fff640 1 -- 172.21.15.154:0/2860116566 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180cf4e0 con 0x7fa2180cf970 2023-11-28T06:32:59.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.241+0000 7fa217fff640 1 --2- 172.21.15.154:0/2860116566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 0x7fa21806e8f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa2181439a0 tx=0x7fa20402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3615bfd7c375b737 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.241+0000 7fa2177fe640 1 -- 172.21.15.154:0/2860116566 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204031830 con 0x7fa2180cf970 2023-11-28T06:32:59.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.242+0000 7fa2177fe640 1 -- 172.21.15.154:0/2860116566 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa204031990 con 0x7fa2180cf970 2023-11-28T06:32:59.243 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.242+0000 7fa2177fe640 1 -- 172.21.15.154:0/2860116566 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204031d20 con 0x7fa2180cf970 2023-11-28T06:32:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 -- 172.21.15.154:0/2860116566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 msgr2=0x7fa21806e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 --2- 172.21.15.154:0/2860116566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 0x7fa21806e8f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa2181439a0 tx=0x7fa20402b8d0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.244 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 -- 172.21.15.154:0/2860116566 shutdown_connections 2023-11-28T06:32:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 --2- 172.21.15.154:0/2860116566 >> v2:172.21.15.154:3300/0 conn(0x7fa21806ee30 0x7fa2180b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 --2- 172.21.15.154:0/2860116566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 0x7fa21806e8f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 -- 172.21.15.154:0/2860116566 >> 172.21.15.154:0/2860116566 conn(0x7fa21806d3b0 msgr2=0x7fa21806d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 -- 172.21.15.154:0/2860116566 shutdown_connections 2023-11-28T06:32:59.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.243+0000 7fa21edd8640 1 -- 172.21.15.154:0/2860116566 wait complete. 2023-11-28T06:32:59.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.247+0000 7fa21edd8640 1 Processor -- start 2023-11-28T06:32:59.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.247+0000 7fa21edd8640 1 -- start start 2023-11-28T06:32:59.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.249+0000 7fa21edd8640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa21806ee30 0x7fa2180c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.249+0000 7fa21edd8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 0x7fa21806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.249+0000 7fa21edd8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa218142e70 0x7fa218152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.249+0000 7fa21edd8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218142760 con 0x7fa218142e70 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.249+0000 7fa21edd8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218141790 con 0x7fa2180cf970 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.249+0000 7fa21edd8640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180a8870 con 0x7fa21806ee30 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21d375640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa218142e70 0x7fa218152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21cb74640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa21806ee30 0x7fa2180c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21d375640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa218142e70 0x7fa218152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49214/0 (socket says 172.21.15.154:49214) 2023-11-28T06:32:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21d375640 1 -- 172.21.15.154:0/2219858536 learned_addr learned my addr 172.21.15.154:0/2219858536 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:59.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa217fff640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 0x7fa21806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21cb74640 1 -- 172.21.15.154:0/2219858536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 msgr2=0x7fa21806a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21cb74640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2180cf970 0x7fa21806a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21cb74640 1 -- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa218142e70 msgr2=0x7fa218152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21cb74640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa218142e70 0x7fa218152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.250+0000 7fa21cb74640 1 -- 172.21.15.154:0/2219858536 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa204009400 con 0x7fa21806ee30 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.251+0000 7fa21cb74640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa21806ee30 0x7fa2180c6940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00c440 tx=0x7fa20c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.251+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c005ce0 con 0x7fa21806ee30 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.251+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c005e40 con 0x7fa21806ee30 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.251+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180c6e80 con 0x7fa21806ee30 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.251+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0072d0 con 0x7fa21806ee30 2023-11-28T06:32:59.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.251+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa218141c80 con 0x7fa21806ee30 2023-11-28T06:32:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.253+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2180cee90 con 0x7fa21806ee30 2023-11-28T06:32:59.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.254+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fa20c0074f0 con 0x7fa21806ee30 2023-11-28T06:32:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.255+0000 7fa2157fa640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1fc06b1c0 0x7fa1fc06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.255+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa20c088960 con 0x7fa21806ee30 2023-11-28T06:32:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.255+0000 7fa217fff640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1fc06b1c0 0x7fa1fc06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.256+0000 7fa2157fa640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7fa1fc071020 0x7fa1fc073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.256+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 --> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1fc073af0 con 0x7fa1fc071020 2023-11-28T06:32:59.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.256+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa20c08d2c0 con 0x7fa21806ee30 2023-11-28T06:32:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.256+0000 7fa21d375640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7fa1fc071020 0x7fa1fc073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.257+0000 7fa217fff640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1fc06b1c0 0x7fa1fc06d680 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa204036000 tx=0x7fa20403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.257+0000 7fa21d375640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7fa1fc071020 0x7fa1fc073440 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.260 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.259+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== osd.1 v2:172.21.15.154:6800/2129709276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa1fc073af0 con 0x7fa1fc071020 2023-11-28T06:32:59.298 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.297+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 --> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa2180cebb0 con 0x7fa1fc071020 2023-11-28T06:32:59.299 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.298+0000 7fa2157fa640 1 -- 172.21.15.154:0/2219858536 <== osd.1 v2:172.21.15.154:6800/2129709276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa21000f040 con 0x7fa1fc071020 2023-11-28T06:32:59.299 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:32:59.300 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:32:59.300 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7fa1fc071020 msgr2=0x7fa1fc073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6800/2129709276,v1:172.21.15.154:6801/2129709276] conn(0x7fa1fc071020 0x7fa1fc073440 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1fc06b1c0 msgr2=0x7fa1fc06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fa1fc06b1c0 0x7fa1fc06d680 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa204036000 tx=0x7fa20403c040 comp rx=0 tx=0).stop 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa21806ee30 msgr2=0x7fa2180c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 --2- 172.21.15.154:0/2219858536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa21806ee30 0x7fa2180c6940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa20c00c440 tx=0x7fa20c00c900 comp rx=0 tx=0).stop 2023-11-28T06:32:59.301 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21d375640 1 -- 172.21.15.154:0/2219858536 reap_dead start 2023-11-28T06:32:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 shutdown_connections 2023-11-28T06:32:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 >> 172.21.15.154:0/2219858536 conn(0x7fa21806d3b0 msgr2=0x7fa2180b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.299+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 shutdown_connections 2023-11-28T06:32:59.302 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.300+0000 7fa21edd8640 1 -- 172.21.15.154:0/2219858536 wait complete. 2023-11-28T06:32:59.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T06:32:59.617 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.616+0000 7fb60164f640 1 Processor -- start 2023-11-28T06:32:59.618 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.616+0000 7fb60164f640 1 -- start start 2023-11-28T06:32:59.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb60164f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d2910 0x7fb5fc0d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb60164f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc0b2b10 con 0x7fb5fc0d3730 2023-11-28T06:32:59.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb60164f640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5fc0d3b50 con 0x7fb5fc15d330 2023-11-28T06:32:59.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb60164f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0d1590 con 0x7fb5fc0d2910 2023-11-28T06:32:59.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb5fa7fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d2910 0x7fb5fc0d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.620 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb5fb7fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb5fc0d3730 0x7fb5fc0b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38210/0 (socket says 172.21.15.154:38210) 2023-11-28T06:32:59.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb5faffd640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb5fc15d330 0x7fb5fc0b8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53514/0 (socket says 172.21.15.154:53514) 2023-11-28T06:32:59.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.619+0000 7fb5fb7fe640 1 -- 172.21.15.154:0/850897699 learned_addr learned my addr 172.21.15.154:0/850897699 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:32:59.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.620+0000 7fb5fa7fc640 1 -- 172.21.15.154:0/850897699 >> v1:172.21.15.194:6789/0 conn(0x7fb5fc15d330 legacy=0x7fb5fc0b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.620+0000 7fb5fa7fc640 1 -- 172.21.15.154:0/850897699 >> v1:172.21.15.154:6789/0 conn(0x7fb5fc0d3730 legacy=0x7fb5fc0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.621 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.620+0000 7fb5f9ffb640 1 -- 172.21.15.154:0/850897699 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651266777 0 0) 0x7fb5fc0d3b50 con 0x7fb5fc15d330 2023-11-28T06:32:59.622 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.620+0000 7fb5fa7fc640 1 -- 172.21.15.154:0/850897699 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc0d1870 con 0x7fb5fc0d2910 2023-11-28T06:32:59.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.622+0000 7fb5fa7fc640 1 --2- 172.21.15.154:0/850897699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d2910 0x7fb5fc0d31f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00097d0 tx=0x7fb5f002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aae104200a2a4db8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.622+0000 7fb5f9ffb640 1 -- 172.21.15.154:0/850897699 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0031800 con 0x7fb5fc0d2910 2023-11-28T06:32:59.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.622+0000 7fb5f9ffb640 1 -- 172.21.15.154:0/850897699 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0031960 con 0x7fb5fc0d2910 2023-11-28T06:32:59.623 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.622+0000 7fb5f9ffb640 1 -- 172.21.15.154:0/850897699 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0031cf0 con 0x7fb5fc0d2910 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 -- 172.21.15.154:0/850897699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d2910 msgr2=0x7fb5fc0d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 --2- 172.21.15.154:0/850897699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d2910 0x7fb5fc0d31f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb5f00097d0 tx=0x7fb5f002b8a0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 -- 172.21.15.154:0/850897699 shutdown_connections 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 --2- 172.21.15.154:0/850897699 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d2910 0x7fb5fc0d31f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 -- 172.21.15.154:0/850897699 >> 172.21.15.154:0/850897699 conn(0x7fb5fc072020 msgr2=0x7fb5fc072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 -- 172.21.15.154:0/850897699 shutdown_connections 2023-11-28T06:32:59.625 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.624+0000 7fb60164f640 1 -- 172.21.15.154:0/850897699 wait complete. 2023-11-28T06:32:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.627+0000 7fb60164f640 1 Processor -- start 2023-11-28T06:32:59.628 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.627+0000 7fb60164f640 1 -- start start 2023-11-28T06:32:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.629+0000 7fb60164f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 0x7fb5fc0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.629+0000 7fb60164f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d3730 0x7fb5fc1f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.629+0000 7fb60164f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5fc15d330 0x7fb5fc0b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.629+0000 7fb60164f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc0cd220 con 0x7fb5fc0d2910 2023-11-28T06:32:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.629+0000 7fb60164f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc1f3a80 con 0x7fb5fc15d330 2023-11-28T06:32:59.631 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.629+0000 7fb60164f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc1f31e0 con 0x7fb5fc0d3730 2023-11-28T06:32:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.630+0000 7fb5faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 0x7fb5fc0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.630+0000 7fb5faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 0x7fb5fc0ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49230/0 (socket says 172.21.15.154:49230) 2023-11-28T06:32:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.630+0000 7fb5faffd640 1 -- 172.21.15.154:0/3165982464 learned_addr learned my addr 172.21.15.154:0/3165982464 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:32:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.630+0000 7fb5fb7fe640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5fc15d330 0x7fb5fc0b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.632 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.630+0000 7fb5fa7fc640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d3730 0x7fb5fc1f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fa7fc640 1 -- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5fc15d330 msgr2=0x7fb5fc0b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fa7fc640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5fc15d330 0x7fb5fc0b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.633 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fa7fc640 1 -- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 msgr2=0x7fb5fc0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fa7fc640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 0x7fb5fc0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fa7fc640 1 -- 172.21.15.154:0/3165982464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0009400 con 0x7fb5fc0d3730 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5faffd640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 0x7fb5fc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fb7fe640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5fc15d330 0x7fb5fc0b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.631+0000 7fb5fa7fc640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d3730 0x7fb5fc1f3c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0033000 tx=0x7fb5f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.632+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00453f0 con 0x7fb5fc0d3730 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.632+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0045590 con 0x7fb5fc0d3730 2023-11-28T06:32:59.634 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.632+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc1f34c0 con 0x7fb5fc0d3730 2023-11-28T06:32:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.632+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0045940 con 0x7fb5fc0d3730 2023-11-28T06:32:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.632+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc15d840 con 0x7fb5fc0d3730 2023-11-28T06:32:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.634+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc069400 con 0x7fb5fc0d3730 2023-11-28T06:32:59.635 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.635+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb5f004e450 con 0x7fb5fc0d3730 2023-11-28T06:32:59.636 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.636+0000 7fb5e37fe640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb5e806b1f0 0x7fb5e806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:32:59.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.636+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5f002e070 con 0x7fb5fc0d3730 2023-11-28T06:32:59.637 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.636+0000 7fb5faffd640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb5e806b1f0 0x7fb5e806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:32:59.638 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.637+0000 7fb5faffd640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb5e806b1f0 0x7fb5e806d6b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000f60 tx=0x7fb5ec007ea0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:32:59.641 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:32:59.640+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb5f0076b00 con 0x7fb5fc0d3730 2023-11-28T06:33:00.167 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.166+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5fc0d2110 con 0x7fb5e806b1f0 2023-11-28T06:33:00.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.167+0000 7fb5e37fe640 1 -- 172.21.15.154:0/3165982464 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb5ec001cf0 con 0x7fb5e806b1f0 2023-11-28T06:33:00.168 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T06:33:00.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.171+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb5e806b1f0 msgr2=0x7fb5e806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.171+0000 7fb60164f640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb5e806b1f0 0x7fb5e806d6b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000f60 tx=0x7fb5ec007ea0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.171+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d3730 msgr2=0x7fb5fc1f3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.171+0000 7fb60164f640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d3730 0x7fb5fc1f3c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0033000 tx=0x7fb5f00046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 shutdown_connections 2023-11-28T06:33:00.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5fc15d330 0x7fb5fc0b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb5e806b1f0 0x7fb5e806d6b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5fc0d3730 0x7fb5fc1f3c80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 --2- 172.21.15.154:0/3165982464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5fc0d2910 0x7fb5fc0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 >> 172.21.15.154:0/3165982464 conn(0x7fb5fc072020 msgr2=0x7fb5fc0b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:00.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 shutdown_connections 2023-11-28T06:33:00.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.172+0000 7fb60164f640 1 -- 172.21.15.154:0/3165982464 wait complete. 2023-11-28T06:33:00.199 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T06:33:00.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:33:00.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.499+0000 7fee3b18b640 1 Processor -- start 2023-11-28T06:33:00.500 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.499+0000 7fee3b18b640 1 -- start start 2023-11-28T06:33:00.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee3b18b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 0x7fee3406b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.504 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee3b18b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee3406ba20 0x7fee3406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee3b18b640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fee3406d280 0x7fee34160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee3b18b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3415de00 con 0x7fee3406ba20 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee3b18b640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3406bea0 con 0x7fee3406d280 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee3b18b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee340ada00 con 0x7fee34157a20 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee33fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee3406ba20 0x7fee3406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee38f27640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 0x7fee3406b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.505 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee39728640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fee3406d280 0x7fee34160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee38f27640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 0x7fee3406b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:56476/0 (socket says 172.21.15.154:56476) 2023-11-28T06:33:00.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee33fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee3406ba20 0x7fee3406cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49236/0 (socket says 172.21.15.154:49236) 2023-11-28T06:33:00.506 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.503+0000 7fee38f27640 1 -- 172.21.15.154:0/3062901315 learned_addr learned my addr 172.21.15.154:0/3062901315 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.504+0000 7fee39728640 1 -- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 msgr2=0x7fee3406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.504+0000 7fee39728640 1 --2- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 0x7fee3406b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.504+0000 7fee39728640 1 -- 172.21.15.154:0/3062901315 >> v2:172.21.15.154:3300/0 conn(0x7fee3406ba20 msgr2=0x7fee3406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.504+0000 7fee39728640 1 --2- 172.21.15.154:0/3062901315 >> v2:172.21.15.154:3300/0 conn(0x7fee3406ba20 0x7fee3406cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.504+0000 7fee39728640 1 -- 172.21.15.154:0/3062901315 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3406d9c0 con 0x7fee3406d280 2023-11-28T06:33:00.507 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.504+0000 7fee38f27640 1 --2- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 0x7fee3406b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:00.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.506+0000 7fee39728640 1 --2- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee3406d280 0x7fee34160fc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fee340714a0 tx=0x7fee2c02bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f201cb6edfc60aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.507+0000 7fee337fe640 1 -- 172.21.15.154:0/3062901315 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c02cb40 con 0x7fee3406d280 2023-11-28T06:33:00.508 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.507+0000 7fee337fe640 1 -- 172.21.15.154:0/3062901315 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c02cca0 con 0x7fee3406d280 2023-11-28T06:33:00.509 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.507+0000 7fee337fe640 1 -- 172.21.15.154:0/3062901315 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c034660 con 0x7fee3406d280 2023-11-28T06:33:00.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 -- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee3406d280 msgr2=0x7fee34160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 --2- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee3406d280 0x7fee34160fc0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fee340714a0 tx=0x7fee2c02bd90 comp rx=0 tx=0).stop 2023-11-28T06:33:00.510 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 -- 172.21.15.154:0/3062901315 shutdown_connections 2023-11-28T06:33:00.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 --2- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee3406d280 0x7fee34160fc0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 --2- 172.21.15.154:0/3062901315 >> v2:172.21.15.154:3300/0 conn(0x7fee3406ba20 0x7fee3406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 --2- 172.21.15.154:0/3062901315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee34157a20 0x7fee3406b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.508+0000 7fee3b18b640 1 -- 172.21.15.154:0/3062901315 >> 172.21.15.154:0/3062901315 conn(0x7fee340b1bc0 msgr2=0x7fee34070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:00.511 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.509+0000 7fee3b18b640 1 -- 172.21.15.154:0/3062901315 shutdown_connections 2023-11-28T06:33:00.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.509+0000 7fee3b18b640 1 -- 172.21.15.154:0/3062901315 wait complete. 2023-11-28T06:33:00.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.512+0000 7fee3b18b640 1 Processor -- start 2023-11-28T06:33:00.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.512+0000 7fee3b18b640 1 -- start start 2023-11-28T06:33:00.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.514+0000 7fee3b18b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee3406ba20 0x7fee3413e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.514+0000 7fee3b18b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3406d280 0x7fee3415eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.516 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.514+0000 7fee3b18b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34157a20 0x7fee340af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee3b18b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee341536d0 con 0x7fee3406d280 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee3b18b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee34153ee0 con 0x7fee34157a20 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee3b18b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee34155340 con 0x7fee3406ba20 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee33fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3406d280 0x7fee3415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee33fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3406d280 0x7fee3415eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49248/0 (socket says 172.21.15.154:49248) 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee33fff640 1 -- 172.21.15.154:0/1429028946 learned_addr learned my addr 172.21.15.154:0/1429028946 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:00.517 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee38f27640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee3406ba20 0x7fee3413e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.518 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.515+0000 7fee39728640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34157a20 0x7fee340af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee38f27640 1 -- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34157a20 msgr2=0x7fee340af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee38f27640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34157a20 0x7fee340af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee38f27640 1 -- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3406d280 msgr2=0x7fee3415eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee38f27640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3406d280 0x7fee3415eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee38f27640 1 -- 172.21.15.154:0/1429028946 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280094d0 con 0x7fee3406ba20 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee33fff640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee3406d280 0x7fee3415eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee39728640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34157a20 0x7fee340af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.516+0000 7fee38f27640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee3406ba20 0x7fee3413e890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fee2800e900 tx=0x7fee2800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.517+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2800ca00 con 0x7fee3406ba20 2023-11-28T06:33:00.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.517+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2800cb60 con 0x7fee3406ba20 2023-11-28T06:33:00.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.517+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c009a70 con 0x7fee3406ba20 2023-11-28T06:33:00.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.517+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee28004030 con 0x7fee3406ba20 2023-11-28T06:33:00.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.517+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee34153920 con 0x7fee3406ba20 2023-11-28T06:33:00.521 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.519+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee340cf230 con 0x7fee3406ba20 2023-11-28T06:33:00.522 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.521+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fee28004190 con 0x7fee3406ba20 2023-11-28T06:33:00.523 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.522+0000 7fee317fa640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee1806b1c0 0x7fee1806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.522+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fee28089750 con 0x7fee3406ba20 2023-11-28T06:33:00.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.523+0000 7fee33fff640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee1806b1c0 0x7fee1806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.523+0000 7fee317fa640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7fee18071020 0x7fee18073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.523+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 --> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee18073af0 con 0x7fee18071020 2023-11-28T06:33:00.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.523+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee2808be10 con 0x7fee3406ba20 2023-11-28T06:33:00.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.523+0000 7fee39728640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7fee18071020 0x7fee18073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.524+0000 7fee33fff640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee1806b1c0 0x7fee1806d680 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fee340b42a0 tx=0x7fee20009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.525 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.524+0000 7fee39728640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7fee18071020 0x7fee18073440 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.527 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.526+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== osd.2 v2:172.21.15.154:6816/498194302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fee18073af0 con 0x7fee18071020 2023-11-28T06:33:00.566 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.565+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 --> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fee3406ea50 con 0x7fee18071020 2023-11-28T06:33:00.567 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.565+0000 7fee317fa640 1 -- 172.21.15.154:0/1429028946 <== osd.2 v2:172.21.15.154:6816/498194302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fee3406ea50 con 0x7fee18071020 2023-11-28T06:33:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:33:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:33:00.567 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:33:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.566+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7fee18071020 msgr2=0x7fee18073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.566+0000 7fee3b18b640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6816/498194302,v1:172.21.15.154:6817/498194302] conn(0x7fee18071020 0x7fee18073440 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.568 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.566+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee1806b1c0 msgr2=0x7fee1806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.566+0000 7fee3b18b640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fee1806b1c0 0x7fee1806d680 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fee340b42a0 tx=0x7fee20009190 comp rx=0 tx=0).stop 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.566+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee3406ba20 msgr2=0x7fee3413e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.566+0000 7fee3b18b640 1 --2- 172.21.15.154:0/1429028946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee3406ba20 0x7fee3413e890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fee2800e900 tx=0x7fee2800edc0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.567+0000 7fee39728640 1 -- 172.21.15.154:0/1429028946 reap_dead start 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.567+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 shutdown_connections 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.567+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 >> 172.21.15.154:0/1429028946 conn(0x7fee340b1bc0 msgr2=0x7fee3415df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.567+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 shutdown_connections 2023-11-28T06:33:00.569 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.567+0000 7fee3b18b640 1 -- 172.21.15.154:0/1429028946 wait complete. 2023-11-28T06:33:00.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T06:33:00.885 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.884+0000 7f4e43a83640 1 Processor -- start 2023-11-28T06:33:00.886 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.885+0000 7f4e43a83640 1 -- start start 2023-11-28T06:33:00.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.887+0000 7f4e43a83640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c13cfd0 0x7f4e3c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.887+0000 7f4e43a83640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e3c0b2860 0x7f4e3c15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.887+0000 7f4e43a83640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e3c15e1c0 0x7f4e3c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.887+0000 7f4e43a83640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c0b2cf0 con 0x7f4e3c15e1c0 2023-11-28T06:33:00.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.887+0000 7f4e43a83640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c15ea20 con 0x7f4e3c0b2860 2023-11-28T06:33:00.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.887+0000 7f4e43a83640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c15a930 con 0x7f4e3c13cfd0 2023-11-28T06:33:00.889 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e42020640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e3c15e1c0 0x7f4e3c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e3c0b2860 0x7f4e3c15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4181f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c13cfd0 0x7f4e3c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e42020640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4e3c15e1c0 0x7f4e3c06d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49258/0 (socket says 172.21.15.154:49258) 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e42020640 1 -- 172.21.15.154:0/1817579927 learned_addr learned my addr 172.21.15.154:0/1817579927 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e3c0b2860 0x7f4e3c15dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:53570/0 (socket says 172.21.15.154:53570) 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 -- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c13cfd0 msgr2=0x7f4e3c0b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:00.890 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 --2- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c13cfd0 0x7f4e3c0b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 -- 172.21.15.154:0/1817579927 >> v2:172.21.15.154:3300/0 conn(0x7f4e3c15e1c0 msgr2=0x7f4e3c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 --2- 172.21.15.154:0/1817579927 >> v2:172.21.15.154:3300/0 conn(0x7f4e3c15e1c0 0x7f4e3c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.888+0000 7f4e4101e640 1 -- 172.21.15.154:0/1817579927 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c15ac10 con 0x7f4e3c0b2860 2023-11-28T06:33:00.891 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.890+0000 7f4e4101e640 1 --2- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c0b2860 0x7f4e3c15dc80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c06e680 tx=0x7f4e2c02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd3f58d21ec633a9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.891+0000 7f4e4081d640 1 -- 172.21.15.154:0/1817579927 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c02f050 con 0x7f4e3c0b2860 2023-11-28T06:33:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.891+0000 7f4e4081d640 1 -- 172.21.15.154:0/1817579927 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c031700 con 0x7f4e3c0b2860 2023-11-28T06:33:00.892 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.891+0000 7f4e4081d640 1 -- 172.21.15.154:0/1817579927 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c031a90 con 0x7f4e3c0b2860 2023-11-28T06:33:00.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 -- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c0b2860 msgr2=0x7f4e3c15dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.893 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 --2- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c0b2860 0x7f4e3c15dc80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c06e680 tx=0x7f4e2c02b7a0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 -- 172.21.15.154:0/1817579927 shutdown_connections 2023-11-28T06:33:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 --2- 172.21.15.154:0/1817579927 >> v2:172.21.15.154:3300/0 conn(0x7f4e3c15e1c0 0x7f4e3c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 --2- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c0b2860 0x7f4e3c15dc80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 --2- 172.21.15.154:0/1817579927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c13cfd0 0x7f4e3c0b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.894 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.892+0000 7f4e43a83640 1 -- 172.21.15.154:0/1817579927 >> 172.21.15.154:0/1817579927 conn(0x7f4e3c066270 msgr2=0x7f4e3c066650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.893+0000 7f4e43a83640 1 -- 172.21.15.154:0/1817579927 shutdown_connections 2023-11-28T06:33:00.895 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.893+0000 7f4e43a83640 1 -- 172.21.15.154:0/1817579927 wait complete. 2023-11-28T06:33:00.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.896+0000 7f4e43a83640 1 Processor -- start 2023-11-28T06:33:00.897 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.896+0000 7f4e43a83640 1 -- start start 2023-11-28T06:33:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e43a83640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c0b2860 0x7f4e3c13b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e43a83640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c13cfd0 0x7f4e3c1eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e43a83640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c15e1c0 0x7f4e3c137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e43a83640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c139420 con 0x7f4e3c13cfd0 2023-11-28T06:33:00.899 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e43a83640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c13ba00 con 0x7f4e3c15e1c0 2023-11-28T06:33:00.900 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e43a83640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c13ab60 con 0x7f4e3c0b2860 2023-11-28T06:33:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.898+0000 7f4e4101e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c13cfd0 0x7f4e3c1eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4181f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c0b2860 0x7f4e3c13b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4101e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c13cfd0 0x7f4e3c1eeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49266/0 (socket says 172.21.15.154:49266) 2023-11-28T06:33:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4101e640 1 -- 172.21.15.154:0/3817335718 learned_addr learned my addr 172.21.15.154:0/3817335718 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:00.901 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e42020640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c15e1c0 0x7f4e3c137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4181f640 1 -- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c15e1c0 msgr2=0x7f4e3c137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4181f640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c15e1c0 0x7f4e3c137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4181f640 1 -- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c13cfd0 msgr2=0x7f4e3c1eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4181f640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c13cfd0 0x7f4e3c1eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.899+0000 7f4e4181f640 1 -- 172.21.15.154:0/3817335718 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c009400 con 0x7f4e3c0b2860 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.900+0000 7f4e4181f640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c0b2860 0x7f4e3c13b400 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800e870 tx=0x7f4e3800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.900+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800c940 con 0x7f4e3c0b2860 2023-11-28T06:33:00.902 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.900+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800caa0 con 0x7f4e3c0b2860 2023-11-28T06:33:00.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.900+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800ce10 con 0x7f4e3c0b2860 2023-11-28T06:33:00.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.900+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c15a700 con 0x7f4e3c0b2860 2023-11-28T06:33:00.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.900+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c13b120 con 0x7f4e3c0b2860 2023-11-28T06:33:00.903 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.902+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c067420 con 0x7f4e3c0b2860 2023-11-28T06:33:00.904 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.903+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f4e38013470 con 0x7f4e3c0b2860 2023-11-28T06:33:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.904+0000 7f4e327fc640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4e2006b1f0 0x7f4e2006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.905+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e380898e0 con 0x7f4e3c0b2860 2023-11-28T06:33:00.905 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.905+0000 7f4e4101e640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4e2006b1f0 0x7f4e2006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:00.906 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.906+0000 7f4e4101e640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4e2006b1f0 0x7f4e2006d6b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c152780 tx=0x7f4e2c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:00.910 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:00.909+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f4e38054890 con 0x7f4e3c0b2860 2023-11-28T06:33:01.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.434+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e3c15a580 con 0x7f4e2006b1f0 2023-11-28T06:33:01.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.435+0000 7f4e327fc640 1 -- 172.21.15.154:0/3817335718 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4e2c042070 con 0x7f4e2006b1f0 2023-11-28T06:33:01.436 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T06:33:01.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4e2006b1f0 msgr2=0x7f4e2006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4e2006b1f0 0x7f4e2006d6b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c152780 tx=0x7f4e2c008030 comp rx=0 tx=0).stop 2023-11-28T06:33:01.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c0b2860 msgr2=0x7f4e3c13b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c0b2860 0x7f4e3c13b400 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800e870 tx=0x7f4e3800ed30 comp rx=0 tx=0).stop 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 shutdown_connections 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e3c15e1c0 0x7f4e3c137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f4e2006b1f0 0x7f4e2006d6b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e3c13cfd0 0x7f4e3c1eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 --2- 172.21.15.154:0/3817335718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e3c0b2860 0x7f4e3c13b400 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 >> 172.21.15.154:0/3817335718 conn(0x7f4e3c066270 msgr2=0x7f4e3c06b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 shutdown_connections 2023-11-28T06:33:01.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.439+0000 7f4e43a83640 1 -- 172.21.15.154:0/3817335718 wait complete. 2023-11-28T06:33:01.467 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T06:33:01.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:33:01.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.766+0000 7fb5c04b6640 1 Processor -- start 2023-11-28T06:33:01.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.767+0000 7fb5c04b6640 1 -- start start 2023-11-28T06:33:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.769+0000 7fb5c04b6640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5b8157a20 0x7fb5b806b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:01.770 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.769+0000 7fb5c04b6640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b80ada00 con 0x7fb5b806ba20 2023-11-28T06:33:01.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.769+0000 7fb5c04b6640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b806d9c0 con 0x7fb5b806d450 2023-11-28T06:33:01.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.769+0000 7fb5c04b6640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b815de00 con 0x7fb5b8157a20 2023-11-28T06:33:01.771 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.770+0000 7fb5be252640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5b8157a20 0x7fb5b806b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.770+0000 7fb5be252640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb5b8157a20 0x7fb5b806b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49272/0 (socket says 172.21.15.154:49272) 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.770+0000 7fb5be252640 1 -- 172.21.15.154:0/1555059493 learned_addr learned my addr 172.21.15.154:0/1555059493 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.770+0000 7fb5bea53640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb5b806d450 0x7fb5b80ade90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53528/0 (socket says 172.21.15.154:53528) 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.771+0000 7fb5be252640 1 -- 172.21.15.154:0/1555059493 >> v1:172.21.15.194:6789/0 conn(0x7fb5b806d450 legacy=0x7fb5b80ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.771+0000 7fb5bd250640 1 -- 172.21.15.154:0/1555059493 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852849105 0 0) 0x7fb5b806d9c0 con 0x7fb5b806d450 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.771+0000 7fb5be252640 1 -- 172.21.15.154:0/1555059493 >> v1:172.21.15.154:6789/0 conn(0x7fb5b806ba20 legacy=0x7fb5b806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.772 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.771+0000 7fb5be252640 1 -- 172.21.15.154:0/1555059493 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b806dca0 con 0x7fb5b8157a20 2023-11-28T06:33:01.773 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.773+0000 7fb5be252640 1 --2- 172.21.15.154:0/1555059493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b806b4e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009e50 tx=0x7fb5b402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39ee26739cb2ddb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:01.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.773+0000 7fb5bd250640 1 -- 172.21.15.154:0/1555059493 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b402c8d0 con 0x7fb5b8157a20 2023-11-28T06:33:01.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.773+0000 7fb5bd250640 1 -- 172.21.15.154:0/1555059493 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b402ca30 con 0x7fb5b8157a20 2023-11-28T06:33:01.774 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.773+0000 7fb5bd250640 1 -- 172.21.15.154:0/1555059493 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b402cdc0 con 0x7fb5b8157a20 2023-11-28T06:33:01.775 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1555059493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 msgr2=0x7fb5b806b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 --2- 172.21.15.154:0/1555059493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b806b4e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009e50 tx=0x7fb5b402bdb0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1555059493 shutdown_connections 2023-11-28T06:33:01.776 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 --2- 172.21.15.154:0/1555059493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b806b4e0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1555059493 >> 172.21.15.154:0/1555059493 conn(0x7fb5b80b1bc0 msgr2=0x7fb5b8070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:01.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1555059493 shutdown_connections 2023-11-28T06:33:01.777 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.775+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1555059493 wait complete. 2023-11-28T06:33:01.779 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.779+0000 7fb5c04b6640 1 Processor -- start 2023-11-28T06:33:01.780 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.779+0000 7fb5c04b6640 1 -- start start 2023-11-28T06:33:01.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5c04b6640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5b806ba20 0x7fb5b8143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:01.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5c04b6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5b806d450 0x7fb5b8155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:01.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5c04b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b8155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:01.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5c04b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8156f50 con 0x7fb5b8157a20 2023-11-28T06:33:01.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5c04b6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b81563d0 con 0x7fb5b806d450 2023-11-28T06:33:01.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5c04b6640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b81566b0 con 0x7fb5b806ba20 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5bea53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b8155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5bea53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b8155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49288/0 (socket says 172.21.15.154:49288) 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5bda51640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5b806d450 0x7fb5b8155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5be252640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5b806ba20 0x7fb5b8143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.781+0000 7fb5bea53640 1 -- 172.21.15.154:0/1566587988 learned_addr learned my addr 172.21.15.154:0/1566587988 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.782+0000 7fb5be252640 1 -- 172.21.15.154:0/1566587988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5b806d450 msgr2=0x7fb5b8155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.784 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.782+0000 7fb5be252640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb5b806d450 0x7fb5b8155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.782+0000 7fb5be252640 1 -- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 msgr2=0x7fb5b8155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.782+0000 7fb5be252640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5b8157a20 0x7fb5b8155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.782+0000 7fb5be252640 1 -- 172.21.15.154:0/1566587988 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4009b30 con 0x7fb5b806ba20 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.782+0000 7fb5be252640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5b806ba20 0x7fb5b8143d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4032000 tx=0x7fb5b4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.783+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4007a30 con 0x7fb5b806ba20 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.783+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b4007bb0 con 0x7fb5b806ba20 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.783+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b8156990 con 0x7fb5b806ba20 2023-11-28T06:33:01.785 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.783+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b403e450 con 0x7fb5b806ba20 2023-11-28T06:33:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.783+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b81560d0 con 0x7fb5b806ba20 2023-11-28T06:33:01.786 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.785+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5b80ad640 con 0x7fb5b806ba20 2023-11-28T06:33:01.787 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.786+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb5b403e5b0 con 0x7fb5b806ba20 2023-11-28T06:33:01.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.787+0000 7fb5aeffd640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb59c06b1c0 0x7fb59c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:01.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.787+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb5b40ac0f0 con 0x7fb5b806ba20 2023-11-28T06:33:01.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.787+0000 7fb5bda51640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb59c06b1c0 0x7fb59c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:01.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.788+0000 7fb5aeffd640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fb59c071020 0x7fb59c073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:01.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.788+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 --> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb59c073af0 con 0x7fb59c071020 2023-11-28T06:33:01.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.788+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5b40ae7b0 con 0x7fb5b806ba20 2023-11-28T06:33:01.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.788+0000 7fb5bea53640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fb59c071020 0x7fb59c073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:01.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.789+0000 7fb5bda51640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb59c06b1c0 0x7fb59c06d680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb5b815f060 tx=0x7fb5a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:01.790 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.789+0000 7fb5bea53640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fb59c071020 0x7fb59c073440 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:01.791 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.791+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== osd.3 v2:172.21.15.154:6818/85167042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb59c073af0 con 0x7fb59c071020 2023-11-28T06:33:01.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.830+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 --> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5b8157e00 con 0x7fb59c071020 2023-11-28T06:33:01.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.831+0000 7fb5aeffd640 1 -- 172.21.15.154:0/1566587988 <== osd.3 v2:172.21.15.154:6818/85167042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb5b00047e0 con 0x7fb59c071020 2023-11-28T06:33:01.832 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:33:01.832 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:33:01.832 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:33:01.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.831+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fb59c071020 msgr2=0x7fb59c073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.831+0000 7fb5c04b6640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6818/85167042,v1:172.21.15.154:6820/85167042] conn(0x7fb59c071020 0x7fb59c073440 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:01.833 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb59c06b1c0 msgr2=0x7fb59c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb59c06b1c0 0x7fb59c06d680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb5b815f060 tx=0x7fb5a8009040 comp rx=0 tx=0).stop 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5b806ba20 msgr2=0x7fb5b8143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 --2- 172.21.15.154:0/1566587988 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb5b806ba20 0x7fb5b8143d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4032000 tx=0x7fb5b4004a40 comp rx=0 tx=0).stop 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5bea53640 1 -- 172.21.15.154:0/1566587988 reap_dead start 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 shutdown_connections 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 >> 172.21.15.154:0/1566587988 conn(0x7fb5b80b1bc0 msgr2=0x7fb5b80b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:01.834 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 shutdown_connections 2023-11-28T06:33:01.835 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:01.832+0000 7fb5c04b6640 1 -- 172.21.15.154:0/1566587988 wait complete. 2023-11-28T06:33:01.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T06:33:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.149+0000 7f529c7a5640 1 Processor -- start 2023-11-28T06:33:02.151 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.150+0000 7f529c7a5640 1 -- start start 2023-11-28T06:33:02.153 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.152+0000 7f529c7a5640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f529415afe0 0x7f529406e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.152+0000 7f529c7a5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52940cdbd0 0x7f529406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.152+0000 7f529c7a5640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529406d1b0 con 0x7f52940ccbd0 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.152+0000 7f529c7a5640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529406d490 con 0x7f529415afe0 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.152+0000 7f529c7a5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529406d770 con 0x7f52940cdbd0 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529a541640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f529415afe0 0x7f529406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529ad42640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f52940ccbd0 0x7f529406b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38230/0 (socket says 172.21.15.154:38230) 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529ad42640 1 -- 172.21.15.154:0/1734679730 learned_addr learned my addr 172.21.15.154:0/1734679730 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:02.154 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f5299d40640 1 --2- 172.21.15.154:0/1734679730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52940cdbd0 0x7f529406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:02.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529a541640 1 -- 172.21.15.154:0/1734679730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52940cdbd0 msgr2=0x7f529406e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:02.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529a541640 1 --2- 172.21.15.154:0/1734679730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52940cdbd0 0x7f529406e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.155 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529a541640 1 -- 172.21.15.154:0/1734679730 >> v1:172.21.15.154:6789/0 conn(0x7f52940ccbd0 legacy=0x7f529406b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:02.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.153+0000 7f529953f640 1 -- 172.21.15.154:0/1734679730 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420002380 0 0) 0x7f529406d1b0 con 0x7f52940ccbd0 2023-11-28T06:33:02.156 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.154+0000 7f529a541640 1 -- 172.21.15.154:0/1734679730 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529406da50 con 0x7f529415afe0 2023-11-28T06:33:02.157 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.157+0000 7f529a541640 1 --2- 172.21.15.154:0/1734679730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f529415afe0 0x7f529406e250 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f52900097a0 tx=0x7f529002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979039f21d59fcf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:02.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.157+0000 7f529953f640 1 -- 172.21.15.154:0/1734679730 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290031830 con 0x7f529415afe0 2023-11-28T06:33:02.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.157+0000 7f529953f640 1 -- 172.21.15.154:0/1734679730 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290031990 con 0x7f529415afe0 2023-11-28T06:33:02.158 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.157+0000 7f529953f640 1 -- 172.21.15.154:0/1734679730 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290031d20 con 0x7f529415afe0 2023-11-28T06:33:02.159 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 -- 172.21.15.154:0/1734679730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f529415afe0 msgr2=0x7f529406e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1734679730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f529415afe0 0x7f529406e250 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f52900097a0 tx=0x7f529002b8d0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 -- 172.21.15.154:0/1734679730 shutdown_connections 2023-11-28T06:33:02.160 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1734679730 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f52940cdbd0 0x7f529406e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1734679730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f529415afe0 0x7f529406e250 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 -- 172.21.15.154:0/1734679730 >> 172.21.15.154:0/1734679730 conn(0x7f52940b1bc0 msgr2=0x7f5294070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 -- 172.21.15.154:0/1734679730 shutdown_connections 2023-11-28T06:33:02.161 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.159+0000 7f529c7a5640 1 -- 172.21.15.154:0/1734679730 wait complete. 2023-11-28T06:33:02.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.162+0000 7f529c7a5640 1 Processor -- start 2023-11-28T06:33:02.163 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.162+0000 7f529c7a5640 1 -- start start 2023-11-28T06:33:02.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.164+0000 7f529c7a5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52940ccbd0 0x7f529414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:02.165 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.164+0000 7f529c7a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52940cdbd0 0x7f52941f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:02.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.164+0000 7f529c7a5640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f529415afe0 0x7f5294149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:02.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.164+0000 7f529c7a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529414dc20 con 0x7f52940cdbd0 2023-11-28T06:33:02.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.164+0000 7f529c7a5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529414abc0 con 0x7f52940ccbd0 2023-11-28T06:33:02.166 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.164+0000 7f529c7a5640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52940aa8b0 con 0x7f529415afe0 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.165+0000 7f5299d40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52940cdbd0 0x7f52941f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.165+0000 7f529ad42640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f529415afe0 0x7f5294149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.165+0000 7f529a541640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52940ccbd0 0x7f529414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.165+0000 7f5299d40640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52940cdbd0 0x7f52941f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49304/0 (socket says 172.21.15.154:49304) 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.165+0000 7f5299d40640 1 -- 172.21.15.154:0/1531947704 learned_addr learned my addr 172.21.15.154:0/1531947704 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529a541640 1 -- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f529415afe0 msgr2=0x7f5294149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529a541640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f529415afe0 0x7f5294149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.168 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529a541640 1 -- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52940cdbd0 msgr2=0x7f52941f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529a541640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52940cdbd0 0x7f52941f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529a541640 1 -- 172.21.15.154:0/1531947704 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290009400 con 0x7f52940ccbd0 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529ad42640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f529415afe0 0x7f5294149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f529a541640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52940ccbd0 0x7f529414d6e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5290033000 tx=0x7f52900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.166+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529003a6f0 con 0x7f52940ccbd0 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.167+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529003a870 con 0x7f52940ccbd0 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.167+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529003ac20 con 0x7f52940ccbd0 2023-11-28T06:33:02.169 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.167+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52940aab90 con 0x7f52940ccbd0 2023-11-28T06:33:02.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.167+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529414ae60 con 0x7f52940ccbd0 2023-11-28T06:33:02.170 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.169+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52940b12d0 con 0x7f52940ccbd0 2023-11-28T06:33:02.171 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.171+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f529004c430 con 0x7f52940ccbd0 2023-11-28T06:33:02.172 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.172+0000 7f528affd640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f527806b1c0 0x7f527806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:02.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.172+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f52900ab410 con 0x7f52940ccbd0 2023-11-28T06:33:02.173 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.172+0000 7f5299d40640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f527806b1c0 0x7f527806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:02.174 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.173+0000 7f5299d40640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f527806b1c0 0x7f527806d680 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f52940cb960 tx=0x7f5284009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:02.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.177+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f52900764f0 con 0x7f52940ccbd0 2023-11-28T06:33:02.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.702+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f529406bbf0 con 0x7f527806b1c0 2023-11-28T06:33:02.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.702+0000 7f528affd640 1 -- 172.21.15.154:0/1531947704 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5284011a60 con 0x7f527806b1c0 2023-11-28T06:33:02.703 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T06:33:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.707+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f527806b1c0 msgr2=0x7f527806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f527806b1c0 0x7f527806d680 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f52940cb960 tx=0x7f5284009190 comp rx=0 tx=0).stop 2023-11-28T06:33:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52940ccbd0 msgr2=0x7f529414d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:02.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52940ccbd0 0x7f529414d6e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5290033000 tx=0x7f52900046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 shutdown_connections 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f527806b1c0 0x7f527806d680 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f529415afe0 0x7f5294149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52940cdbd0 0x7f52941f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 --2- 172.21.15.154:0/1531947704 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52940ccbd0 0x7f529414d6e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 >> 172.21.15.154:0/1531947704 conn(0x7f52940b1bc0 msgr2=0x7f52940b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 shutdown_connections 2023-11-28T06:33:02.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:02.708+0000 7f529c7a5640 1 -- 172.21.15.154:0/1531947704 wait complete. 2023-11-28T06:33:02.736 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T06:33:02.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:33:03.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.035+0000 7f1cc9a89640 1 Processor -- start 2023-11-28T06:33:03.037 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.035+0000 7f1cc9a89640 1 -- start start 2023-11-28T06:33:03.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc9a89640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4157b00 0x7f1cc40714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.039 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc9a89640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cc415af30 0x7f1cc40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc9a89640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc4071e60 con 0x7f1cc4071a00 2023-11-28T06:33:03.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc9a89640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc406f510 con 0x7f1cc415af30 2023-11-28T06:33:03.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc9a89640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc406e960 con 0x7f1cc4157b00 2023-11-28T06:33:03.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cc415af30 0x7f1cc40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cbaffd640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f1cc4071a00 0x7f1cc415a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38244/0 (socket says 172.21.15.154:38244) 2023-11-28T06:33:03.040 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cc3fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cc415af30 0x7f1cc40b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49312/0 (socket says 172.21.15.154:49312) 2023-11-28T06:33:03.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.037+0000 7f1cbaffd640 1 -- 172.21.15.154:0/3507465348 learned_addr learned my addr 172.21.15.154:0/3507465348 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:03.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.038+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/3507465348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4157b00 0x7f1cc40714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.038+0000 7f1cc37fe640 1 -- 172.21.15.154:0/3507465348 >> v2:172.21.15.154:3300/0 conn(0x7f1cc415af30 msgr2=0x7f1cc40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:03.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.038+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/3507465348 >> v2:172.21.15.154:3300/0 conn(0x7f1cc415af30 0x7f1cc40b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.041 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.038+0000 7f1cc37fe640 1 -- 172.21.15.154:0/3507465348 >> v1:172.21.15.154:6789/0 conn(0x7f1cc4071a00 legacy=0x7f1cc415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.038+0000 7f1cc37fe640 1 -- 172.21.15.154:0/3507465348 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4157ee0 con 0x7f1cc4157b00 2023-11-28T06:33:03.042 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.040+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/3507465348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4157b00 0x7f1cc40714c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40097a0 tx=0x7f1cb402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5294d3ff07822004 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.041+0000 7f1cc2ffd640 1 -- 172.21.15.154:0/3507465348 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4031780 con 0x7f1cc4157b00 2023-11-28T06:33:03.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.041+0000 7f1cc2ffd640 1 -- 172.21.15.154:0/3507465348 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb40318e0 con 0x7f1cc4157b00 2023-11-28T06:33:03.043 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.041+0000 7f1cc2ffd640 1 -- 172.21.15.154:0/3507465348 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4031c70 con 0x7f1cc4157b00 2023-11-28T06:33:03.044 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.042+0000 7f1cc9a89640 1 -- 172.21.15.154:0/3507465348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4157b00 msgr2=0x7f1cc40714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.042+0000 7f1cc9a89640 1 --2- 172.21.15.154:0/3507465348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4157b00 0x7f1cc40714c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40097a0 tx=0x7f1cb402b820 comp rx=0 tx=0).stop 2023-11-28T06:33:03.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.043+0000 7f1cc9a89640 1 -- 172.21.15.154:0/3507465348 shutdown_connections 2023-11-28T06:33:03.045 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.043+0000 7f1cc9a89640 1 --2- 172.21.15.154:0/3507465348 >> v2:172.21.15.154:3300/0 conn(0x7f1cc415af30 0x7f1cc40b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.043+0000 7f1cc9a89640 1 --2- 172.21.15.154:0/3507465348 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4157b00 0x7f1cc40714c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.043+0000 7f1cc9a89640 1 -- 172.21.15.154:0/3507465348 >> 172.21.15.154:0/3507465348 conn(0x7f1cc40b1de0 msgr2=0x7f1cc40b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:03.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.043+0000 7f1cc9a89640 1 -- 172.21.15.154:0/3507465348 shutdown_connections 2023-11-28T06:33:03.046 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.043+0000 7f1cc9a89640 1 -- 172.21.15.154:0/3507465348 wait complete. 2023-11-28T06:33:03.047 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.046+0000 7f1cc9a89640 1 Processor -- start 2023-11-28T06:33:03.048 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.047+0000 7f1cc9a89640 1 -- start start 2023-11-28T06:33:03.052 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc9a89640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4071a00 0x7f1cc41f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc9a89640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc4157b00 0x7f1cc40c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc9a89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc415af30 0x7f1cc414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.053 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc9a89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40c6560 con 0x7f1cc415af30 2023-11-28T06:33:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc9a89640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40c6840 con 0x7f1cc4157b00 2023-11-28T06:33:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc9a89640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40c6b20 con 0x7f1cc4071a00 2023-11-28T06:33:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc415af30 0x7f1cc414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.054 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc415af30 0x7f1cc414a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49324/0 (socket says 172.21.15.154:49324) 2023-11-28T06:33:03.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc3fff640 1 -- 172.21.15.154:0/159379990 learned_addr learned my addr 172.21.15.154:0/159379990 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:03.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4071a00 0x7f1cc41f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.055 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.049+0000 7f1cbaffd640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc4157b00 0x7f1cc40c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc37fe640 1 -- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc4157b00 msgr2=0x7f1cc40c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc4157b00 0x7f1cc40c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc37fe640 1 -- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc415af30 msgr2=0x7f1cc414a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc415af30 0x7f1cc414a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc37fe640 1 -- 172.21.15.154:0/159379990 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4009400 con 0x7f1cc4071a00 2023-11-28T06:33:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc3fff640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cc415af30 0x7f1cc414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cbaffd640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cc4157b00 0x7f1cc40c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.050+0000 7f1cc37fe640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4071a00 0x7f1cc41f1bd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4033000 tx=0x7f1cb40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.057 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.051+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4032820 con 0x7f1cc4071a00 2023-11-28T06:33:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.051+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb40329a0 con 0x7f1cc4071a00 2023-11-28T06:33:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.051+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc40c6e00 con 0x7f1cc4071a00 2023-11-28T06:33:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.051+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4032d50 con 0x7f1cc4071a00 2023-11-28T06:33:03.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.051+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc4159840 con 0x7f1cc4071a00 2023-11-28T06:33:03.060 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.054+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cc40c69b0 con 0x7f1cc4071a00 2023-11-28T06:33:03.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.054+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f1cb404e440 con 0x7f1cc4071a00 2023-11-28T06:33:03.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.055+0000 7f1cc0ff9640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1ca406b1f0 0x7f1ca406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.056+0000 7f1cbaffd640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1ca406b1f0 0x7f1ca406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.056+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1cb40ab6d0 con 0x7f1cc4071a00 2023-11-28T06:33:03.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.056+0000 7f1cc0ff9640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7f1ca4071050 0x7f1ca4073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.056+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 --> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ca4073b20 con 0x7f1ca4071050 2023-11-28T06:33:03.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.056+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cb40adcb0 con 0x7f1cc4071a00 2023-11-28T06:33:03.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.057+0000 7f1cc3fff640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7f1ca4071050 0x7f1ca4073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.057+0000 7f1cbaffd640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1ca406b1f0 0x7f1ca406d6b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4159c20 tx=0x7f1cac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.057+0000 7f1cc3fff640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7f1ca4071050 0x7f1ca4073470 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.058+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== osd.4 v2:172.21.15.194:6800/3400970964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1ca4073b20 con 0x7f1ca4071050 2023-11-28T06:33:03.098 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.097+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 --> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1cc406f130 con 0x7f1ca4071050 2023-11-28T06:33:03.099 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.098+0000 7f1cc0ff9640 1 -- 172.21.15.154:0/159379990 <== osd.4 v2:172.21.15.194:6800/3400970964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1cbc011040 con 0x7f1ca4071050 2023-11-28T06:33:03.100 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:33:03.100 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:33:03.100 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:33:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.098+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7f1ca4071050 msgr2=0x7f1ca4073470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.098+0000 7f1cc9a89640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:6800/3400970964,v1:172.21.15.194:6801/3400970964] conn(0x7f1ca4071050 0x7f1ca4073470 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.098+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1ca406b1f0 msgr2=0x7f1ca406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.098+0000 7f1cc9a89640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f1ca406b1f0 0x7f1ca406d6b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4159c20 tx=0x7f1cac009040 comp rx=0 tx=0).stop 2023-11-28T06:33:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4071a00 msgr2=0x7f1cc41f1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.103 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc9a89640 1 --2- 172.21.15.154:0/159379990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cc4071a00 0x7f1cc41f1bd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4033000 tx=0x7f1cb40046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc3fff640 1 -- 172.21.15.154:0/159379990 reap_dead start 2023-11-28T06:33:03.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 shutdown_connections 2023-11-28T06:33:03.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 >> 172.21.15.154:0/159379990 conn(0x7f1cc40b1de0 msgr2=0x7f1cc40cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:03.104 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 shutdown_connections 2023-11-28T06:33:03.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.099+0000 7f1cc9a89640 1 -- 172.21.15.154:0/159379990 wait complete. 2023-11-28T06:33:03.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T06:33:03.418 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.417+0000 7fd641c3a640 1 Processor -- start 2023-11-28T06:33:03.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.417+0000 7fd641c3a640 1 -- start start 2023-11-28T06:33:03.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.419+0000 7fd641c3a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c15b130 0x7fd63c0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.419+0000 7fd641c3a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd63c15f760 0x7fd63c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.422 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd641c3a640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63c0b3f10 con 0x7fd63c0cf150 2023-11-28T06:33:03.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd641c3a640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63c15fd20 con 0x7fd63c15f760 2023-11-28T06:33:03.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd641c3a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0d0730 con 0x7fd63c15b130 2023-11-28T06:33:03.423 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd632ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd63c15f760 0x7fd63c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd632ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd63c15f760 0x7fd63c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49328/0 (socket says 172.21.15.154:49328) 2023-11-28T06:33:03.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd632ffd640 1 -- 172.21.15.154:0/2985228060 learned_addr learned my addr 172.21.15.154:0/2985228060 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:03.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.420+0000 7fd63b7fe640 1 --2- 172.21.15.154:0/2985228060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c15b130 0x7fd63c0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.421+0000 7fd63affd640 1 -- 172.21.15.154:0/2985228060 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520360073 0 0) 0x7fd63c0b3f10 con 0x7fd63c0cf150 2023-11-28T06:33:03.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.421+0000 7fd63b7fe640 1 -- 172.21.15.154:0/2985228060 >> v2:172.21.15.154:3300/0 conn(0x7fd63c15f760 msgr2=0x7fd63c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:03.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.421+0000 7fd63b7fe640 1 --2- 172.21.15.154:0/2985228060 >> v2:172.21.15.154:3300/0 conn(0x7fd63c15f760 0x7fd63c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.421+0000 7fd63b7fe640 1 -- 172.21.15.154:0/2985228060 >> v1:172.21.15.194:6789/0 conn(0x7fd63c0cf150 legacy=0x7fd63c06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.421+0000 7fd63b7fe640 1 -- 172.21.15.154:0/2985228060 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63c0d0a50 con 0x7fd63c15b130 2023-11-28T06:33:03.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.423+0000 7fd63b7fe640 1 --2- 172.21.15.154:0/2985228060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c15b130 0x7fd63c0d01f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0097a0 tx=0x7fd62c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc35b934855524b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.423+0000 7fd63affd640 1 -- 172.21.15.154:0/2985228060 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c031830 con 0x7fd63c15b130 2023-11-28T06:33:03.427 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.423+0000 7fd63affd640 1 -- 172.21.15.154:0/2985228060 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c031990 con 0x7fd63c15b130 2023-11-28T06:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.423+0000 7fd63affd640 1 -- 172.21.15.154:0/2985228060 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c031d20 con 0x7fd63c15b130 2023-11-28T06:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 -- 172.21.15.154:0/2985228060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c15b130 msgr2=0x7fd63c0d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 --2- 172.21.15.154:0/2985228060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c15b130 0x7fd63c0d01f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0097a0 tx=0x7fd62c02b8d0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 -- 172.21.15.154:0/2985228060 shutdown_connections 2023-11-28T06:33:03.428 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 --2- 172.21.15.154:0/2985228060 >> v2:172.21.15.154:3300/0 conn(0x7fd63c15f760 0x7fd63c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 --2- 172.21.15.154:0/2985228060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c15b130 0x7fd63c0d01f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 -- 172.21.15.154:0/2985228060 >> 172.21.15.154:0/2985228060 conn(0x7fd63c0b2c10 msgr2=0x7fd63c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 -- 172.21.15.154:0/2985228060 shutdown_connections 2023-11-28T06:33:03.429 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.425+0000 7fd641c3a640 1 -- 172.21.15.154:0/2985228060 wait complete. 2023-11-28T06:33:03.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.428+0000 7fd641c3a640 1 Processor -- start 2023-11-28T06:33:03.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.429+0000 7fd641c3a640 1 -- start start 2023-11-28T06:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd641c3a640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 0x7fd63c148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd641c3a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 0x7fd63c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.433 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd641c3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c15f760 0x7fd63c15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd641c3a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c148bb0 con 0x7fd63c15f760 2023-11-28T06:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd641c3a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c1f13d0 con 0x7fd63c15b130 2023-11-28T06:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd641c3a640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c0c4ee0 con 0x7fd63c0cf150 2023-11-28T06:33:03.434 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd632ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 0x7fd63c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd63b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 0x7fd63c148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd63bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c15f760 0x7fd63c15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd63b7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 0x7fd63c148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:56562/0 (socket says 172.21.15.154:56562) 2023-11-28T06:33:03.435 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd63b7fe640 1 -- 172.21.15.154:0/1124163614 learned_addr learned my addr 172.21.15.154:0/1124163614 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.431+0000 7fd632ffd640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 0x7fd63c0c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:53626/0 (socket says 172.21.15.154:53626) 2023-11-28T06:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd63b7fe640 1 -- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 msgr2=0x7fd63c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd63b7fe640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 0x7fd63c0c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.436 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd63b7fe640 1 -- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c15f760 msgr2=0x7fd63c15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd63b7fe640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c15f760 0x7fd63c15cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd63b7fe640 1 -- 172.21.15.154:0/1124163614 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c009400 con 0x7fd63c0cf150 2023-11-28T06:33:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd632ffd640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 0x7fd63c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:03.437 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd63b7fe640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 0x7fd63c148670 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd62c02bee0 tx=0x7fd62c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.432+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c03a6f0 con 0x7fd63c0cf150 2023-11-28T06:33:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.433+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c03a870 con 0x7fd63c0cf150 2023-11-28T06:33:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.433+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c0c5160 con 0x7fd63c0cf150 2023-11-28T06:33:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.433+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62c03ac20 con 0x7fd63c0cf150 2023-11-28T06:33:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.433+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c0c5720 con 0x7fd63c0cf150 2023-11-28T06:33:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.436+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c067fc0 con 0x7fd63c0cf150 2023-11-28T06:33:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.436+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fd62c04c3b0 con 0x7fd63c0cf150 2023-11-28T06:33:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.437+0000 7fd638ff9640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd61c06b1c0 0x7fd61c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.438+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd62c0ab200 con 0x7fd63c0cf150 2023-11-28T06:33:03.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.438+0000 7fd632ffd640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd61c06b1c0 0x7fd61c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:03.442 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.439+0000 7fd632ffd640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd61c06b1c0 0x7fd61c06d680 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0c45a0 tx=0x7fd624009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:03.443 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.442+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fd62c076370 con 0x7fd63c0cf150 2023-11-28T06:33:03.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.970+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd63c0cb690 con 0x7fd61c06b1c0 2023-11-28T06:33:03.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.970+0000 7fd638ff9640 1 -- 172.21.15.154:0/1124163614 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd624011e60 con 0x7fd61c06b1c0 2023-11-28T06:33:03.972 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.975+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd61c06b1c0 msgr2=0x7fd61c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.975+0000 7fd641c3a640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd61c06b1c0 0x7fd61c06d680 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0c45a0 tx=0x7fd624009240 comp rx=0 tx=0).stop 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.975+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 msgr2=0x7fd63c148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.975+0000 7fd641c3a640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 0x7fd63c148670 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd62c02bee0 tx=0x7fd62c0046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 shutdown_connections 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63c15b130 0x7fd63c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fd61c06b1c0 0x7fd61c06d680 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd63c15f760 0x7fd63c15cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 --2- 172.21.15.154:0/1124163614 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd63c0cf150 0x7fd63c148670 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:03.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 >> 172.21.15.154:0/1124163614 conn(0x7fd63c0b2c10 msgr2=0x7fd63c0d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:03.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 shutdown_connections 2023-11-28T06:33:03.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:03.976+0000 7fd641c3a640 1 -- 172.21.15.154:0/1124163614 wait complete. 2023-11-28T06:33:04.004 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T06:33:04.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:33:04.307 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.305+0000 7f49011a0640 1 Processor -- start 2023-11-28T06:33:04.308 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.305+0000 7f49011a0640 1 -- start start 2023-11-28T06:33:04.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f49011a0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc15b090 0x7f48fc0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f49011a0640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48fc0d1980 0x7f48fc0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f49011a0640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48fc0cb9e0 con 0x7f48fc0cee70 2023-11-28T06:33:04.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f49011a0640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48fc0cccf0 con 0x7f48fc0d1980 2023-11-28T06:33:04.310 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f49011a0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0cbc50 con 0x7f48fc15b090 2023-11-28T06:33:04.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f48fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48fc0d1980 0x7f48fc0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.311 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc15b090 0x7f48fc0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f48fb7fe640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48fc0d1980 0x7f48fc0cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49344/0 (socket says 172.21.15.154:49344) 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f490099f640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f48fc0cee70 0x7f48fc0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53540/0 (socket says 172.21.15.154:53540) 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.308+0000 7f48fb7fe640 1 -- 172.21.15.154:0/1197973797 learned_addr learned my addr 172.21.15.154:0/1197973797 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.309+0000 7f48faffd640 1 -- 172.21.15.154:0/1197973797 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370920312 0 0) 0x7f48fc0cb9e0 con 0x7f48fc0cee70 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.309+0000 7f48fbfff640 1 -- 172.21.15.154:0/1197973797 >> v2:172.21.15.154:3300/0 conn(0x7f48fc0d1980 msgr2=0x7f48fc0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.309+0000 7f48fbfff640 1 --2- 172.21.15.154:0/1197973797 >> v2:172.21.15.154:3300/0 conn(0x7f48fc0d1980 0x7f48fc0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.312 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.309+0000 7f48fbfff640 1 -- 172.21.15.154:0/1197973797 >> v1:172.21.15.194:6789/0 conn(0x7f48fc0cee70 legacy=0x7f48fc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.309+0000 7f48fbfff640 1 -- 172.21.15.154:0/1197973797 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0cbf30 con 0x7f48fc15b090 2023-11-28T06:33:04.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.311+0000 7f48fbfff640 1 --2- 172.21.15.154:0/1197973797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc15b090 0x7f48fc0cd800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0097a0 tx=0x7f48ec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d272c999925b3b3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.313 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.311+0000 7f48faffd640 1 -- 172.21.15.154:0/1197973797 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec031830 con 0x7f48fc15b090 2023-11-28T06:33:04.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.311+0000 7f48faffd640 1 -- 172.21.15.154:0/1197973797 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec031990 con 0x7f48fc15b090 2023-11-28T06:33:04.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.311+0000 7f48faffd640 1 -- 172.21.15.154:0/1197973797 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec031d20 con 0x7f48fc15b090 2023-11-28T06:33:04.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 -- 172.21.15.154:0/1197973797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc15b090 msgr2=0x7f48fc0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 --2- 172.21.15.154:0/1197973797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc15b090 0x7f48fc0cd800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0097a0 tx=0x7f48ec02b8d0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 -- 172.21.15.154:0/1197973797 shutdown_connections 2023-11-28T06:33:04.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 --2- 172.21.15.154:0/1197973797 >> v2:172.21.15.154:3300/0 conn(0x7f48fc0d1980 0x7f48fc0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 --2- 172.21.15.154:0/1197973797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc15b090 0x7f48fc0cd800 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 -- 172.21.15.154:0/1197973797 >> 172.21.15.154:0/1197973797 conn(0x7f48fc0d0df0 msgr2=0x7f48fc0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:04.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 -- 172.21.15.154:0/1197973797 shutdown_connections 2023-11-28T06:33:04.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.313+0000 7f49011a0640 1 -- 172.21.15.154:0/1197973797 wait complete. 2023-11-28T06:33:04.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.316+0000 7f49011a0640 1 Processor -- start 2023-11-28T06:33:04.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.317+0000 7f49011a0640 1 -- start start 2023-11-28T06:33:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f49011a0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48fc0cee70 0x7f48fc155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f49011a0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc0d1980 0x7f48fc0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f49011a0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48fc15b090 0x7f48fc0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f49011a0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc1f2e60 con 0x7f48fc15b090 2023-11-28T06:33:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f49011a0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc0b65f0 con 0x7f48fc0cee70 2023-11-28T06:33:04.321 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f49011a0640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48fc06c040 con 0x7f48fc0d1980 2023-11-28T06:33:04.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48fc0cee70 0x7f48fc155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f490099f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48fc15b090 0x7f48fc0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f48fb7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc0d1980 0x7f48fc0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f48fbfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48fc0cee70 0x7f48fc155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:53630/0 (socket says 172.21.15.154:53630) 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.319+0000 7f48fbfff640 1 -- 172.21.15.154:0/2378954486 learned_addr learned my addr 172.21.15.154:0/2378954486 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fbfff640 1 -- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc0d1980 msgr2=0x7f48fc0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fbfff640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc0d1980 0x7f48fc0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fbfff640 1 -- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48fc15b090 msgr2=0x7f48fc0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fbfff640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48fc15b090 0x7f48fc0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fbfff640 1 -- 172.21.15.154:0/2378954486 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec009400 con 0x7f48fc0cee70 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fb7fe640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48fc0d1980 0x7f48fc0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:04.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.320+0000 7f48fbfff640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48fc0cee70 0x7f48fc155aa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f48ec034040 tx=0x7f48ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.321+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec03a9e0 con 0x7f48fc0cee70 2023-11-28T06:33:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.321+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec03ab60 con 0x7f48fc0cee70 2023-11-28T06:33:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.321+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec044400 con 0x7f48fc0cee70 2023-11-28T06:33:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.321+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48fc155fe0 con 0x7f48fc0cee70 2023-11-28T06:33:04.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.321+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48fc06b9f0 con 0x7f48fc0cee70 2023-11-28T06:33:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.324+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48fc0cc7d0 con 0x7f48fc0cee70 2023-11-28T06:33:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.324+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f48ec04d440 con 0x7f48fc0cee70 2023-11-28T06:33:04.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.325+0000 7f48f8ff9640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f48e806b1c0 0x7f48e806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.325+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f48ec0ab6b0 con 0x7f48fc0cee70 2023-11-28T06:33:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.325+0000 7f48fb7fe640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f48e806b1c0 0x7f48e806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.325+0000 7f48f8ff9640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7f48e8071020 0x7f48e8073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.325+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 --> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48e8073af0 con 0x7f48e8071020 2023-11-28T06:33:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.325+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48ec0add70 con 0x7f48fc0cee70 2023-11-28T06:33:04.328 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.326+0000 7f490099f640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7f48e8071020 0x7f48e8073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.326+0000 7f48fb7fe640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f48e806b1c0 0x7f48e806d680 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b6830 tx=0x7f48f000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.327+0000 7f490099f640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7f48e8071020 0x7f48e8073440 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.329 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.328+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== osd.5 v2:172.21.15.194:6808/3406558424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f48e8073af0 con 0x7f48e8071020 2023-11-28T06:33:04.369 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.367+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 --> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f48fc0cc4f0 con 0x7f48e8071020 2023-11-28T06:33:04.370 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.368+0000 7f48f8ff9640 1 -- 172.21.15.154:0/2378954486 <== osd.5 v2:172.21.15.194:6808/3406558424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f48f40047e0 con 0x7f48e8071020 2023-11-28T06:33:04.371 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:33:04.371 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:33:04.371 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:33:04.372 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7f48e8071020 msgr2=0x7f48e8073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:6808/3406558424,v1:172.21.15.194:6809/3406558424] conn(0x7f48e8071020 0x7f48e8073440 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f48e806b1c0 msgr2=0x7f48e806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f48e806b1c0 0x7f48e806d680 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0b6830 tx=0x7f48f000b040 comp rx=0 tx=0).stop 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48fc0cee70 msgr2=0x7f48fc155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 --2- 172.21.15.154:0/2378954486 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48fc0cee70 0x7f48fc155aa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f48ec034040 tx=0x7f48ec0046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f490099f640 1 -- 172.21.15.154:0/2378954486 reap_dead start 2023-11-28T06:33:04.373 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 shutdown_connections 2023-11-28T06:33:04.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 >> 172.21.15.154:0/2378954486 conn(0x7f48fc0d0df0 msgr2=0x7f48fc158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:04.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 shutdown_connections 2023-11-28T06:33:04.374 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.369+0000 7f49011a0640 1 -- 172.21.15.154:0/2378954486 wait complete. 2023-11-28T06:33:04.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T06:33:04.687 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.685+0000 7f6089b59640 1 Processor -- start 2023-11-28T06:33:04.688 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.686+0000 7f6089b59640 1 -- start start 2023-11-28T06:33:04.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.689+0000 7f6089b59640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f608406abe0 0x7f608415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.691 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.689+0000 7f6089b59640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6084143680 0x7f60841409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.689+0000 7f6089b59640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608406e960 con 0x7f60841432a0 2023-11-28T06:33:04.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.689+0000 7f6089b59640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608415dec0 con 0x7f6084143680 2023-11-28T06:33:04.692 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.689+0000 7f6089b59640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608415e1a0 con 0x7f608406abe0 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f6083fff640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6084143680 0x7f60841409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f6082ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f608406abe0 0x7f608415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f60837fe640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f60841432a0 0x7f608406a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38248/0 (socket says 172.21.15.154:38248) 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f60837fe640 1 -- 172.21.15.154:0/833421644 learned_addr learned my addr 172.21.15.154:0/833421644 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f6082ffd640 1 -- 172.21.15.154:0/833421644 >> v2:172.21.15.154:3300/0 conn(0x7f6084143680 msgr2=0x7f60841409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f6082ffd640 1 --2- 172.21.15.154:0/833421644 >> v2:172.21.15.154:3300/0 conn(0x7f6084143680 0x7f60841409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.690+0000 7f6082ffd640 1 -- 172.21.15.154:0/833421644 >> v1:172.21.15.154:6789/0 conn(0x7f60841432a0 legacy=0x7f608406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.693 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.691+0000 7f6082ffd640 1 -- 172.21.15.154:0/833421644 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608415e480 con 0x7f608406abe0 2023-11-28T06:33:04.695 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.692+0000 7f6082ffd640 1 --2- 172.21.15.154:0/833421644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608406abe0 0x7f608415d8e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f60841549d0 tx=0x7f607002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b79b2b697a366dd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.693+0000 7f60827fc640 1 -- 172.21.15.154:0/833421644 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607002e070 con 0x7f608406abe0 2023-11-28T06:33:04.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.693+0000 7f60827fc640 1 -- 172.21.15.154:0/833421644 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700315a0 con 0x7f608406abe0 2023-11-28T06:33:04.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.693+0000 7f60827fc640 1 -- 172.21.15.154:0/833421644 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070031930 con 0x7f608406abe0 2023-11-28T06:33:04.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.694+0000 7f6089b59640 1 -- 172.21.15.154:0/833421644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608406abe0 msgr2=0x7f608415d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.694+0000 7f6089b59640 1 --2- 172.21.15.154:0/833421644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608406abe0 0x7f608415d8e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f60841549d0 tx=0x7f607002b840 comp rx=0 tx=0).stop 2023-11-28T06:33:04.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.694+0000 7f6089b59640 1 -- 172.21.15.154:0/833421644 shutdown_connections 2023-11-28T06:33:04.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.694+0000 7f6089b59640 1 --2- 172.21.15.154:0/833421644 >> v2:172.21.15.154:3300/0 conn(0x7f6084143680 0x7f60841409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.694+0000 7f6089b59640 1 --2- 172.21.15.154:0/833421644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f608406abe0 0x7f608415d8e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.694+0000 7f6089b59640 1 -- 172.21.15.154:0/833421644 >> 172.21.15.154:0/833421644 conn(0x7f60840b1de0 msgr2=0x7f60840b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:04.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.695+0000 7f6089b59640 1 -- 172.21.15.154:0/833421644 shutdown_connections 2023-11-28T06:33:04.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.695+0000 7f6089b59640 1 -- 172.21.15.154:0/833421644 wait complete. 2023-11-28T06:33:04.699 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.698+0000 7f6089b59640 1 Processor -- start 2023-11-28T06:33:04.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.698+0000 7f6089b59640 1 -- start start 2023-11-28T06:33:04.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.700+0000 7f6089b59640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 0x7f6084157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.700+0000 7f6089b59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841432a0 0x7f60841316b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.700+0000 7f6089b59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6084143680 0x7f6084131bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.700+0000 7f6089b59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608415ff20 con 0x7f60841432a0 2023-11-28T06:33:04.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.700+0000 7f6089b59640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6084160200 con 0x7f6084143680 2023-11-28T06:33:04.703 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.700+0000 7f6089b59640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608412f650 con 0x7f608406abe0 2023-11-28T06:33:04.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f6082ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841432a0 0x7f60841316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 0x7f6084157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f6083fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6084143680 0x7f6084131bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 0x7f6084157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:56602/0 (socket says 172.21.15.154:56602) 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f6082ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841432a0 0x7f60841316b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49364/0 (socket says 172.21.15.154:49364) 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 -- 172.21.15.154:0/82648888 learned_addr learned my addr 172.21.15.154:0/82648888 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 -- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6084143680 msgr2=0x7f6084131bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6084143680 0x7f6084131bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 -- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841432a0 msgr2=0x7f60841316b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.701+0000 7f60837fe640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841432a0 0x7f60841316b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.702+0000 7f60837fe640 1 -- 172.21.15.154:0/82648888 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009400 con 0x7f608406abe0 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.702+0000 7f6083fff640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6084143680 0x7f6084131bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.702+0000 7f60837fe640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 0x7f6084157370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f607400c400 tx=0x7f607400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.702+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074005ce0 con 0x7f608406abe0 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.702+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074005e40 con 0x7f608406abe0 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.702+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608412f930 con 0x7f608406abe0 2023-11-28T06:33:04.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.703+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60740072d0 con 0x7f608406abe0 2023-11-28T06:33:04.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.703+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60841578b0 con 0x7f608406abe0 2023-11-28T06:33:04.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.706+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608412ff80 con 0x7f608406abe0 2023-11-28T06:33:04.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.706+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f60740074f0 con 0x7f608406abe0 2023-11-28T06:33:04.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.707+0000 7f607bfff640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f606c06b1c0 0x7f606c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:04.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.707+0000 7f6082ffd640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f606c06b1c0 0x7f606c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:04.709 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.707+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6074088c40 con 0x7f608406abe0 2023-11-28T06:33:04.710 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.708+0000 7f6082ffd640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f606c06b1c0 0x7f606c06d680 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6070036000 tx=0x7f607003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:04.713 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:04.711+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f6074053db0 con 0x7f608406abe0 2023-11-28T06:33:05.241 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.239+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f60840afbc0 con 0x7f606c06b1c0 2023-11-28T06:33:05.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.240+0000 7f607bfff640 1 -- 172.21.15.154:0/82648888 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60840afbc0 con 0x7f606c06b1c0 2023-11-28T06:33:05.242 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.244+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f606c06b1c0 msgr2=0x7f606c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.244+0000 7f6089b59640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f606c06b1c0 0x7f606c06d680 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6070036000 tx=0x7f607003d040 comp rx=0 tx=0).stop 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.244+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 msgr2=0x7f6084157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.244+0000 7f6089b59640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 0x7f6084157370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f607400c400 tx=0x7f607400c8c0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 shutdown_connections 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6084143680 0x7f6084131bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f606c06b1c0 0x7f606c06d680 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60841432a0 0x7f60841316b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 --2- 172.21.15.154:0/82648888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f608406abe0 0x7f6084157370 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 >> 172.21.15.154:0/82648888 conn(0x7f60840b1de0 msgr2=0x7f60840b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 shutdown_connections 2023-11-28T06:33:05.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.245+0000 7f6089b59640 1 -- 172.21.15.154:0/82648888 wait complete. 2023-11-28T06:33:05.274 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T06:33:05.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:33:05.584 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.581+0000 7f8813d14640 1 Processor -- start 2023-11-28T06:33:05.586 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.582+0000 7f8813d14640 1 -- start start 2023-11-28T06:33:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f8813d14640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f8813d14640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 0x7f880c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f8813d14640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c071c40 con 0x7f880c06a4d0 2023-11-28T06:33:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f8813d14640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c0b2b30 con 0x7f880c0ccec0 2023-11-28T06:33:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f8813d14640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c06b040 con 0x7f880c143ea0 2023-11-28T06:33:05.606 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f88122b1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 0x7f880c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f88122b1640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 0x7f880c06a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49374/0 (socket says 172.21.15.154:49374) 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f88112af640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f880c06a4d0 0x7f880c0cc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53554/0 (socket says 172.21.15.154:53554) 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f8811ab0640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.584+0000 7f88122b1640 1 -- 172.21.15.154:0/2575536649 learned_addr learned my addr 172.21.15.154:0/2575536649 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f8810aae640 1 -- 172.21.15.154:0/2575536649 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344958257 0 0) 0x7f880c071c40 con 0x7f880c06a4d0 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f8810aae640 1 -- 172.21.15.154:0/2575536649 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f8003520 con 0x7f880c06a4d0 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f8811ab0640 1 -- 172.21.15.154:0/2575536649 >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 msgr2=0x7f880c06a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:05.607 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f8811ab0640 1 --2- 172.21.15.154:0/2575536649 >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 0x7f880c06a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f8811ab0640 1 -- 172.21.15.154:0/2575536649 >> v1:172.21.15.194:6789/0 conn(0x7f880c06a4d0 legacy=0x7f880c0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f8811ab0640 1 -- 172.21.15.154:0/2575536649 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c06b320 con 0x7f880c143ea0 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.585+0000 7f88122b1640 1 --2- 172.21.15.154:0/2575536649 >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 0x7f880c06a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.587+0000 7f8811ab0640 1 --2- 172.21.15.154:0/2575536649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c0720d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f88080097a0 tx=0x7f880802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a3117267135bbe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.588+0000 7f8810aae640 1 -- 172.21.15.154:0/2575536649 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808031830 con 0x7f880c143ea0 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.588+0000 7f8810aae640 1 -- 172.21.15.154:0/2575536649 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808031990 con 0x7f880c143ea0 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.588+0000 7f8810aae640 1 -- 172.21.15.154:0/2575536649 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808031d20 con 0x7f880c143ea0 2023-11-28T06:33:05.608 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 -- 172.21.15.154:0/2575536649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 msgr2=0x7f880c0720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 --2- 172.21.15.154:0/2575536649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c0720d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f88080097a0 tx=0x7f880802b8d0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 -- 172.21.15.154:0/2575536649 shutdown_connections 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 --2- 172.21.15.154:0/2575536649 >> v2:172.21.15.154:3300/0 conn(0x7f880c0ccec0 0x7f880c06a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 --2- 172.21.15.154:0/2575536649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c0720d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 -- 172.21.15.154:0/2575536649 >> 172.21.15.154:0/2575536649 conn(0x7f880c0b1d50 msgr2=0x7f880c0b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 -- 172.21.15.154:0/2575536649 shutdown_connections 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.589+0000 7f8813d14640 1 -- 172.21.15.154:0/2575536649 wait complete. 2023-11-28T06:33:05.609 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.593+0000 7f8813d14640 1 Processor -- start 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.593+0000 7f8813d14640 1 -- start start 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8813d14640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f880c06a4d0 0x7f880c131b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8813d14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c0ccec0 0x7f880c1429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8813d14640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8813d14640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1320d0 con 0x7f880c0ccec0 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8813d14640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c135430 con 0x7f880c06a4d0 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8813d14640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c158830 con 0x7f880c143ea0 2023-11-28T06:33:05.610 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f88112af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c0ccec0 0x7f880c1429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f88112af640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c0ccec0 0x7f880c1429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49380/0 (socket says 172.21.15.154:49380) 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f88112af640 1 -- 172.21.15.154:0/29749891 learned_addr learned my addr 172.21.15.154:0/29749891 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f8811ab0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f880c06a4d0 0x7f880c131b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.595+0000 7f88122b1640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.596+0000 7f8811ab0640 1 -- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 msgr2=0x7f880c142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.596+0000 7f8811ab0640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f880c143ea0 0x7f880c142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.596+0000 7f8811ab0640 1 -- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c0ccec0 msgr2=0x7f880c1429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.596+0000 7f8811ab0640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f880c0ccec0 0x7f880c1429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.611 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.596+0000 7f8811ab0640 1 -- 172.21.15.154:0/29749891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804009b30 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.596+0000 7f8811ab0640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f880c06a4d0 0x7f880c131b90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f880c06b180 tx=0x7f88080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.597+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880803a8f0 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.597+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808009400 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.597+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880803aa90 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.597+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880803ae40 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.597+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c144400 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.599+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f880c144280 con 0x7f880c06a4d0 2023-11-28T06:33:05.612 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.600+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8808030380 con 0x7f880c06a4d0 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.601+0000 7f88027fc640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f87f006b1c0 0x7f87f006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.601+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88080ab440 con 0x7f880c06a4d0 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.601+0000 7f88112af640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f87f006b1c0 0x7f87f006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.601+0000 7f88027fc640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f87f0071020 0x7f87f0073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.601+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 --> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87f0073af0 con 0x7f87f0071020 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.601+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88080ada20 con 0x7f880c06a4d0 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.602+0000 7f88122b1640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f87f0071020 0x7f87f0073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.602+0000 7f88112af640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f87f006b1c0 0x7f87f006d680 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f880c142990 tx=0x7f87fc007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.613 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.603+0000 7f88122b1640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f87f0071020 0x7f87f0073440 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.614 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.604+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== osd.6 v2:172.21.15.194:6816/1458667325 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f87f0073af0 con 0x7f87f0071020 2023-11-28T06:33:05.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.643+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 --> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f880c0718d0 con 0x7f87f0071020 2023-11-28T06:33:05.645 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.643+0000 7f88027fc640 1 -- 172.21.15.154:0/29749891 <== osd.6 v2:172.21.15.194:6816/1458667325 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f880400f040 con 0x7f87f0071020 2023-11-28T06:33:05.645 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:33:05.646 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:33:05.646 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:33:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f87f0071020 msgr2=0x7f87f0073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:6816/1458667325,v1:172.21.15.194:6817/1458667325] conn(0x7f87f0071020 0x7f87f0073440 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f87f006b1c0 msgr2=0x7f87f006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f87f006b1c0 0x7f87f006d680 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f880c142990 tx=0x7f87fc007df0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f880c06a4d0 msgr2=0x7f880c131b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 --2- 172.21.15.154:0/29749891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f880c06a4d0 0x7f880c131b90 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f880c06b180 tx=0x7f88080046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f88122b1640 1 -- 172.21.15.154:0/29749891 reap_dead start 2023-11-28T06:33:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 shutdown_connections 2023-11-28T06:33:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.644+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 >> 172.21.15.154:0/29749891 conn(0x7f880c0b1d50 msgr2=0x7f880c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:05.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.645+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 shutdown_connections 2023-11-28T06:33:05.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.645+0000 7f8813d14640 1 -- 172.21.15.154:0/29749891 wait complete. 2023-11-28T06:33:05.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T06:33:05.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.962+0000 7f25b984f640 1 Processor -- start 2023-11-28T06:33:05.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.962+0000 7f25b984f640 1 -- start start 2023-11-28T06:33:05.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b984f640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25b415d330 0x7f25b40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.966 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b984f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b40b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b984f640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40b2b10 con 0x7f25b40d2910 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b984f640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40d1590 con 0x7f25b415d330 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b984f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40d1870 con 0x7f25b40d3900 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b2ffd640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f25b415d330 0x7f25b40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b27fc640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f25b40d2910 0x7f25b40d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38254/0 (socket says 172.21.15.154:38254) 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.964+0000 7f25b27fc640 1 -- 172.21.15.154:0/3172858247 learned_addr learned my addr 172.21.15.154:0/3172858247 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:05.967 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.965+0000 7f25b37fe640 1 --2- 172.21.15.154:0/3172858247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b40b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.965+0000 7f25b2ffd640 1 -- 172.21.15.154:0/3172858247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 msgr2=0x7f25b40b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:05.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.965+0000 7f25b2ffd640 1 --2- 172.21.15.154:0/3172858247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b40b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.965+0000 7f25b2ffd640 1 -- 172.21.15.154:0/3172858247 >> v1:172.21.15.154:6789/0 conn(0x7f25b40d2910 legacy=0x7f25b40d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.968 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.965+0000 7f25b2ffd640 1 -- 172.21.15.154:0/3172858247 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40d1b50 con 0x7f25b415d330 2023-11-28T06:33:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.965+0000 7f25b1ffb640 1 -- 172.21.15.154:0/3172858247 <== mon.0 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524816544 0 0) 0x7f25b40b2b10 con 0x7f25b40d2910 2023-11-28T06:33:05.969 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.967+0000 7f25b2ffd640 1 --2- 172.21.15.154:0/3172858247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b415d330 0x7f25b40b8b80 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009d90 tx=0x7f25a402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ebb044fb54fe94 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.968+0000 7f25b1ffb640 1 -- 172.21.15.154:0/3172858247 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a402cbc0 con 0x7f25b415d330 2023-11-28T06:33:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.968+0000 7f25b1ffb640 1 -- 172.21.15.154:0/3172858247 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a402cd20 con 0x7f25b415d330 2023-11-28T06:33:05.970 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.968+0000 7f25b1ffb640 1 -- 172.21.15.154:0/3172858247 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4034660 con 0x7f25b415d330 2023-11-28T06:33:05.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.969+0000 7f25b984f640 1 -- 172.21.15.154:0/3172858247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b415d330 msgr2=0x7f25b40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.971 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.969+0000 7f25b984f640 1 --2- 172.21.15.154:0/3172858247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b415d330 0x7f25b40b8b80 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009d90 tx=0x7f25a402be10 comp rx=0 tx=0).stop 2023-11-28T06:33:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.969+0000 7f25b984f640 1 -- 172.21.15.154:0/3172858247 shutdown_connections 2023-11-28T06:33:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.970+0000 7f25b984f640 1 --2- 172.21.15.154:0/3172858247 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b40b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.970+0000 7f25b984f640 1 --2- 172.21.15.154:0/3172858247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b415d330 0x7f25b40b8b80 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.970+0000 7f25b984f640 1 -- 172.21.15.154:0/3172858247 >> 172.21.15.154:0/3172858247 conn(0x7f25b4072020 msgr2=0x7f25b4072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.970+0000 7f25b984f640 1 -- 172.21.15.154:0/3172858247 shutdown_connections 2023-11-28T06:33:05.972 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.970+0000 7f25b984f640 1 -- 172.21.15.154:0/3172858247 wait complete. 2023-11-28T06:33:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.973+0000 7f25b984f640 1 Processor -- start 2023-11-28T06:33:05.975 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.973+0000 7f25b984f640 1 -- start start 2023-11-28T06:33:05.977 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.975+0000 7f25b984f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 0x7f25b40cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.975+0000 7f25b984f640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b41604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.975+0000 7f25b984f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25b415d330 0x7f25b41506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.975+0000 7f25b984f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4150c10 con 0x7f25b40d2910 2023-11-28T06:33:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.975+0000 7f25b984f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b415f450 con 0x7f25b415d330 2023-11-28T06:33:05.978 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.975+0000 7f25b984f640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b415f730 con 0x7f25b40d3900 2023-11-28T06:33:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 0x7f25b40cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 0x7f25b40cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49404/0 (socket says 172.21.15.154:49404) 2023-11-28T06:33:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b2ffd640 1 -- 172.21.15.154:0/1962624319 learned_addr learned my addr 172.21.15.154:0/1962624319 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b27fc640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b41604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.979 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b37fe640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25b415d330 0x7f25b41506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.980 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b37fe640 1 -- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 msgr2=0x7f25b41604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b37fe640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b41604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b37fe640 1 -- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 msgr2=0x7f25b40cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b37fe640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 0x7f25b40cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b37fe640 1 -- 172.21.15.154:0/1962624319 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009a70 con 0x7f25b415d330 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.976+0000 7f25b2ffd640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 0x7f25b40cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.977+0000 7f25b37fe640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25b415d330 0x7f25b41506d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00e7f0 tx=0x7f25ac00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.981 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.977+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac009590 con 0x7f25b415d330 2023-11-28T06:33:05.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.977+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac00c940 con 0x7f25b415d330 2023-11-28T06:33:05.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.977+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b415fa10 con 0x7f25b415d330 2023-11-28T06:33:05.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.977+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac00ccd0 con 0x7f25b415d330 2023-11-28T06:33:05.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.977+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b415ffd0 con 0x7f25b415d330 2023-11-28T06:33:05.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.980+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b41601f0 con 0x7f25b415d330 2023-11-28T06:33:05.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.981+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f25ac013470 con 0x7f25b415d330 2023-11-28T06:33:05.983 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.982+0000 7f259bfff640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f25a006b1f0 0x7f25a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.982+0000 7f25b2ffd640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f25a006b1f0 0x7f25a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:05.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.982+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f25ac089480 con 0x7f25b415d330 2023-11-28T06:33:05.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.983+0000 7f25b2ffd640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f25a006b1f0 0x7f25a006d6b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f25a4000f80 tx=0x7f25a4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:05.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:05.986+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f25ac054560 con 0x7f25b415d330 2023-11-28T06:33:06.512 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.510+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f25b40d23f0 con 0x7f25a006b1f0 2023-11-28T06:33:06.513 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.511+0000 7f259bfff640 1 -- 172.21.15.154:0/1962624319 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25a402ce90 con 0x7f25a006b1f0 2023-11-28T06:33:06.514 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.516+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f25a006b1f0 msgr2=0x7f25a006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.516+0000 7f25b984f640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f25a006b1f0 0x7f25a006d6b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f25a4000f80 tx=0x7f25a4030000 comp rx=0 tx=0).stop 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.516+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25b415d330 msgr2=0x7f25b41506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.516+0000 7f25b984f640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25b415d330 0x7f25b41506d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00e7f0 tx=0x7f25ac00ecb0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.516+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 shutdown_connections 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.516+0000 7f25b984f640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25b415d330 0x7f25b41506d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.519 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.517+0000 7f25b984f640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f25a006b1f0 0x7f25a006d6b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.517+0000 7f25b984f640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25b40d3900 0x7f25b41604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.517+0000 7f25b984f640 1 --2- 172.21.15.154:0/1962624319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b40d2910 0x7f25b40cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.517+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 >> 172.21.15.154:0/1962624319 conn(0x7f25b4072020 msgr2=0x7f25b40b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.517+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 shutdown_connections 2023-11-28T06:33:06.520 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.517+0000 7f25b984f640 1 -- 172.21.15.154:0/1962624319 wait complete. 2023-11-28T06:33:06.547 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T06:33:06.547 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T06:33:06.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.847+0000 7f21071ad640 1 Processor -- start 2023-11-28T06:33:06.850 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.847+0000 7f21071ad640 1 -- start start 2023-11-28T06:33:06.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f21071ad640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f210015b130 0x7f21000d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f21071ad640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f210015f760 0x7f21000cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f21071ad640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21000cf150 0x7f210006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f21071ad640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210015fd20 con 0x7f21000cf150 2023-11-28T06:33:06.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f21071ad640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21000d0730 con 0x7f210015b130 2023-11-28T06:33:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f21071ad640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000cf5c0 con 0x7f210015f760 2023-11-28T06:33:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f210574a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21000cf150 0x7f210006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f210574a640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f21000cf150 0x7f210006ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49408/0 (socket says 172.21.15.154:49408) 2023-11-28T06:33:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f2104f49640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f210015b130 0x7f21000d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.854 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f210015f760 0x7f21000cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.850+0000 7f210574a640 1 -- 172.21.15.154:0/614185442 learned_addr learned my addr 172.21.15.154:0/614185442 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.851+0000 7f2104f49640 1 -- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f210015f760 msgr2=0x7f21000cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.851+0000 7f2104f49640 1 --2- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f210015f760 0x7f21000cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.856 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.851+0000 7f2104f49640 1 -- 172.21.15.154:0/614185442 >> v2:172.21.15.154:3300/0 conn(0x7f21000cf150 msgr2=0x7f210006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.851+0000 7f2104f49640 1 --2- 172.21.15.154:0/614185442 >> v2:172.21.15.154:3300/0 conn(0x7f21000cf150 0x7f210006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.851+0000 7f2104f49640 1 -- 172.21.15.154:0/614185442 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000b3f10 con 0x7f210015b130 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.851+0000 7f20f7fff640 1 --2- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f210015f760 0x7f21000cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.853+0000 7f2104f49640 1 --2- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015b130 0x7f21000d01f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f210006ede0 tx=0x7f20fc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8d34b9c2cd2d2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.853+0000 7f20f77fe640 1 -- 172.21.15.154:0/614185442 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc031780 con 0x7f210015b130 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.853+0000 7f20f77fe640 1 -- 172.21.15.154:0/614185442 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc0318e0 con 0x7f210015b130 2023-11-28T06:33:06.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.853+0000 7f20f77fe640 1 -- 172.21.15.154:0/614185442 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc031c70 con 0x7f210015b130 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 -- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015b130 msgr2=0x7f21000d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 --2- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015b130 0x7f21000d01f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f210006ede0 tx=0x7f20fc02b820 comp rx=0 tx=0).stop 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 -- 172.21.15.154:0/614185442 shutdown_connections 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 --2- 172.21.15.154:0/614185442 >> v2:172.21.15.154:3300/0 conn(0x7f21000cf150 0x7f210006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 --2- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f210015f760 0x7f21000cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 --2- 172.21.15.154:0/614185442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015b130 0x7f21000d01f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 -- 172.21.15.154:0/614185442 >> 172.21.15.154:0/614185442 conn(0x7f21000b2c10 msgr2=0x7f21000b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:06.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 -- 172.21.15.154:0/614185442 shutdown_connections 2023-11-28T06:33:06.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.855+0000 7f21071ad640 1 -- 172.21.15.154:0/614185442 wait complete. 2023-11-28T06:33:06.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.858+0000 7f21071ad640 1 Processor -- start 2023-11-28T06:33:06.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.858+0000 7f21071ad640 1 -- start start 2023-11-28T06:33:06.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f21071ad640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21000cf150 0x7f21001505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f21071ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f210015b130 0x7f210015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.863 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f21071ad640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015f760 0x7f21000d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f21071ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21000c5920 con 0x7f210015b130 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f21071ad640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21000c77e0 con 0x7f210015f760 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f21071ad640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000c4d10 con 0x7f21000cf150 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f2104f49640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21000cf150 0x7f21001505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f210015b130 0x7f210015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f210574a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015f760 0x7f21000d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f20f7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f210015b130 0x7f210015bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49412/0 (socket says 172.21.15.154:49412) 2023-11-28T06:33:06.864 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f2104f49640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21000cf150 0x7f21001505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:56660/0 (socket says 172.21.15.154:56660) 2023-11-28T06:33:06.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f210574a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015f760 0x7f21000d0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:53688/0 (socket says 172.21.15.154:53688) 2023-11-28T06:33:06.865 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.861+0000 7f20f7fff640 1 -- 172.21.15.154:0/598499933 learned_addr learned my addr 172.21.15.154:0/598499933 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:06.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.862+0000 7f210574a640 1 -- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21000cf150 msgr2=0x7f21001505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.862+0000 7f210574a640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21000cf150 0x7f21001505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.862+0000 7f210574a640 1 -- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f210015b130 msgr2=0x7f210015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.862+0000 7f210574a640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f210015b130 0x7f210015bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.862+0000 7f210574a640 1 -- 172.21.15.154:0/598499933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009400 con 0x7f210015f760 2023-11-28T06:33:06.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.862+0000 7f210574a640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015f760 0x7f21000d0f70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f20f800eed0 tx=0x7f20f800b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:06.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.863+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8010040 con 0x7f210015f760 2023-11-28T06:33:06.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.863+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f800bd10 con 0x7f210015f760 2023-11-28T06:33:06.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.863+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8003bd0 con 0x7f210015f760 2023-11-28T06:33:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.863+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc009400 con 0x7f210015f760 2023-11-28T06:33:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.863+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21000c52d0 con 0x7f210015f760 2023-11-28T06:33:06.869 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.865+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21000cb690 con 0x7f210015f760 2023-11-28T06:33:06.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.866+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f20f8003d30 con 0x7f210015f760 2023-11-28T06:33:06.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.867+0000 7f20f57fa640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20ec06b1f0 0x7f20ec06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.868+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f20f8089500 con 0x7f210015f760 2023-11-28T06:33:06.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.868+0000 7f2104f49640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20ec06b1f0 0x7f20ec06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.868+0000 7f20f57fa640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7f20ec071050 0x7f20ec073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:06.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.868+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 --> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20ec073b20 con 0x7f20ec071050 2023-11-28T06:33:06.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.868+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20f808bbc0 con 0x7f210015f760 2023-11-28T06:33:06.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.868+0000 7f20f7fff640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7f20ec071050 0x7f20ec073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:06.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.869+0000 7f2104f49640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20ec06b1f0 0x7f20ec06d6b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f20fc036000 tx=0x7f20fc03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:06.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.869+0000 7f20f7fff640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7f20ec071050 0x7f20ec073470 crc :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:06.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.870+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== osd.7 v2:172.21.15.194:6824/1808763162 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f20ec073b20 con 0x7f20ec071050 2023-11-28T06:33:06.911 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.909+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 --> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f21000d0d30 con 0x7f20ec071050 2023-11-28T06:33:06.912 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.910+0000 7f20f57fa640 1 -- 172.21.15.154:0/598499933 <== osd.7 v2:172.21.15.194:6824/1808763162 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f20f0009980 con 0x7f20ec071050 2023-11-28T06:33:06.912 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-11-28T06:33:06.913 INFO:teuthology.orchestra.run.smithi154.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-28T06:33:06.913 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-11-28T06:33:06.913 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7f20ec071050 msgr2=0x7f20ec073470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:6824/1808763162,v1:172.21.15.194:6825/1808763162] conn(0x7f20ec071050 0x7f20ec073470 crc :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:06.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20ec06b1f0 msgr2=0x7f20ec06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f20ec06b1f0 0x7f20ec06d6b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f20fc036000 tx=0x7f20fc03d040 comp rx=0 tx=0).stop 2023-11-28T06:33:06.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015f760 msgr2=0x7f21000d0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:06.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 --2- 172.21.15.154:0/598499933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f210015f760 0x7f21000d0f70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f20f800eed0 tx=0x7f20f800b480 comp rx=0 tx=0).stop 2023-11-28T06:33:06.914 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f210574a640 1 -- 172.21.15.154:0/598499933 reap_dead start 2023-11-28T06:33:06.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 shutdown_connections 2023-11-28T06:33:06.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 >> 172.21.15.154:0/598499933 conn(0x7f21000b2c10 msgr2=0x7f21000cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:06.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 shutdown_connections 2023-11-28T06:33:06.915 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:06.911+0000 7f21071ad640 1 -- 172.21.15.154:0/598499933 wait complete. 2023-11-28T06:33:06.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T06:33:07.231 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.229+0000 7f8aeae9b640 1 Processor -- start 2023-11-28T06:33:07.232 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.229+0000 7f8aeae9b640 1 -- start start 2023-11-28T06:33:07.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.231+0000 7f8aeae9b640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ae415b130 0x7f8ae40d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:07.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8aeae9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae40cf320 0x7f8ae40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:07.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8aeae9b640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40b3f10 con 0x7f8ae415f760 2023-11-28T06:33:07.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8aeae9b640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae415fd20 con 0x7f8ae415b130 2023-11-28T06:33:07.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8aeae9b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40d0730 con 0x7f8ae40cf320 2023-11-28T06:33:07.234 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8ae8c37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ae415b130 0x7f8ae40d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:07.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8ae8c37640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8ae415b130 0x7f8ae40d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49422/0 (socket says 172.21.15.154:49422) 2023-11-28T06:33:07.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8ae9438640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae40cf320 0x7f8ae40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:07.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8ae3fff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8ae415f760 0x7f8ae40cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53566/0 (socket says 172.21.15.154:53566) 2023-11-28T06:33:07.235 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.232+0000 7f8ae8c37640 1 -- 172.21.15.154:0/2563818257 learned_addr learned my addr 172.21.15.154:0/2563818257 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:07.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.233+0000 7f8ae9438640 1 -- 172.21.15.154:0/2563818257 >> v2:172.21.15.154:3300/0 conn(0x7f8ae415b130 msgr2=0x7f8ae40d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:07.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.233+0000 7f8ae37fe640 1 -- 172.21.15.154:0/2563818257 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250198811 0 0) 0x7f8ae40b3f10 con 0x7f8ae415f760 2023-11-28T06:33:07.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.233+0000 7f8ae9438640 1 --2- 172.21.15.154:0/2563818257 >> v2:172.21.15.154:3300/0 conn(0x7f8ae415b130 0x7f8ae40d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.233+0000 7f8ae9438640 1 -- 172.21.15.154:0/2563818257 >> v1:172.21.15.194:6789/0 conn(0x7f8ae415f760 legacy=0x7f8ae40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:07.236 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.233+0000 7f8ae9438640 1 -- 172.21.15.154:0/2563818257 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40d0a50 con 0x7f8ae40cf320 2023-11-28T06:33:07.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.235+0000 7f8ae9438640 1 --2- 172.21.15.154:0/2563818257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae40cf320 0x7f8ae40cd310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009d90 tx=0x7f8adc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c6deb05b70b466 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:07.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.235+0000 7f8ae37fe640 1 -- 172.21.15.154:0/2563818257 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc02cbc0 con 0x7f8ae40cf320 2023-11-28T06:33:07.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.235+0000 7f8ae37fe640 1 -- 172.21.15.154:0/2563818257 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc02cd20 con 0x7f8ae40cf320 2023-11-28T06:33:07.237 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.235+0000 7f8ae37fe640 1 -- 172.21.15.154:0/2563818257 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc034660 con 0x7f8ae40cf320 2023-11-28T06:33:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 -- 172.21.15.154:0/2563818257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae40cf320 msgr2=0x7f8ae40cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/2563818257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae40cf320 0x7f8ae40cd310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009d90 tx=0x7f8adc02be10 comp rx=0 tx=0).stop 2023-11-28T06:33:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 -- 172.21.15.154:0/2563818257 shutdown_connections 2023-11-28T06:33:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/2563818257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae40cf320 0x7f8ae40cd310 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.239 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/2563818257 >> v2:172.21.15.154:3300/0 conn(0x7f8ae415b130 0x7f8ae40d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 -- 172.21.15.154:0/2563818257 >> 172.21.15.154:0/2563818257 conn(0x7f8ae40b2c10 msgr2=0x7f8ae40b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:07.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 -- 172.21.15.154:0/2563818257 shutdown_connections 2023-11-28T06:33:07.240 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.237+0000 7f8aeae9b640 1 -- 172.21.15.154:0/2563818257 wait complete. 2023-11-28T06:33:07.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.240+0000 7f8aeae9b640 1 Processor -- start 2023-11-28T06:33:07.242 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.240+0000 7f8aeae9b640 1 -- start start 2023-11-28T06:33:07.245 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8aeae9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae40cf320 0x7f8ae40c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8aeae9b640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 0x7f8ae415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8aeae9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae415f760 0x7f8ae40c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8aeae9b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40c81c0 con 0x7f8ae415f760 2023-11-28T06:33:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8aeae9b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae415ca30 con 0x7f8ae40cf320 2023-11-28T06:33:07.246 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8aeae9b640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae415cd10 con 0x7f8ae415b130 2023-11-28T06:33:07.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 0x7f8ae415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:07.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8ae9438640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae415f760 0x7f8ae40c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:07.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8ae8c37640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae40cf320 0x7f8ae40c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:07.247 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 0x7f8ae415c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:56680/0 (socket says 172.21.15.154:56680) 2023-11-28T06:33:07.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8ae3fff640 1 -- 172.21.15.154:0/1744120639 learned_addr learned my addr 172.21.15.154:0/1744120639 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:07.248 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.243+0000 7f8ae9438640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae415f760 0x7f8ae40c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:49436/0 (socket says 172.21.15.154:49436) 2023-11-28T06:33:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.244+0000 7f8ae3fff640 1 -- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae40cf320 msgr2=0x7f8ae40c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.244+0000 7f8ae3fff640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae40cf320 0x7f8ae40c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.244+0000 7f8ae3fff640 1 -- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae415f760 msgr2=0x7f8ae40c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:07.250 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.244+0000 7f8ae3fff640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae415f760 0x7f8ae40c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.244+0000 7f8ae3fff640 1 -- 172.21.15.154:0/1744120639 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009a70 con 0x7f8ae415b130 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.244+0000 7f8ae3fff640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 0x7f8ae415c1b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0001770 tx=0x7f8ad0001c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.245+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0013070 con 0x7f8ae415b130 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.245+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad000e2e0 con 0x7f8ae415b130 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.245+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae415cff0 con 0x7f8ae415b130 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.245+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0007270 con 0x7f8ae415b130 2023-11-28T06:33:07.251 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.245+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae415c6f0 con 0x7f8ae415b130 2023-11-28T06:33:07.252 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.247+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae4067fc0 con 0x7f8ae415b130 2023-11-28T06:33:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.249+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8ad00073d0 con 0x7f8ae415b130 2023-11-28T06:33:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.250+0000 7f8ae17fa640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ac806b1c0 0x7f8ac806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.250+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8ad008cfc0 con 0x7f8ae415b130 2023-11-28T06:33:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.251+0000 7f8ae8c37640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ac806b1c0 0x7f8ac806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:07.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.251+0000 7f8ae8c37640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ac806b1c0 0x7f8ac806d680 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009bd0 tx=0x7f8ad8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:07.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.255+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8ad00bfe90 con 0x7f8ae415b130 2023-11-28T06:33:07.781 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.779+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ae40cb970 con 0x7f8ac806b1c0 2023-11-28T06:33:07.782 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.780+0000 7f8ae17fa640 1 -- 172.21.15.154:0/1744120639 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8ad8011af0 con 0x7f8ac806b1c0 2023-11-28T06:33:07.782 INFO:teuthology.orchestra.run.smithi154.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T06:33:07.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.785+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ac806b1c0 msgr2=0x7f8ac806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:07.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.785+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ac806b1c0 0x7f8ac806d680 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009bd0 tx=0x7f8ad8009240 comp rx=0 tx=0).stop 2023-11-28T06:33:07.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.785+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 msgr2=0x7f8ae415c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:07.788 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 0x7f8ae415c1b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0001770 tx=0x7f8ad0001c30 comp rx=0 tx=0).stop 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 shutdown_connections 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ac806b1c0 0x7f8ac806d680 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ae415f760 0x7f8ae40c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ae415b130 0x7f8ae415c1b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 --2- 172.21.15.154:0/1744120639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ae40cf320 0x7f8ae40c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 >> 172.21.15.154:0/1744120639 conn(0x7f8ae40b2c10 msgr2=0x7f8ae415a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 shutdown_connections 2023-11-28T06:33:07.789 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:07.786+0000 7f8aeae9b640 1 -- 172.21.15.154:0/1744120639 wait complete. 2023-11-28T06:33:07.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T06:33:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.103+0000 7fdb066d3640 1 Processor -- start 2023-11-28T06:33:08.105 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.103+0000 7fdb066d3640 1 -- start start 2023-11-28T06:33:08.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdb066d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000cfce0 0x7fdb000b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:08.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdb066d3640 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb000cdf00 con 0x7fdb000cda40 2023-11-28T06:33:08.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdb066d3640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb000ce1e0 con 0x7fdb0015b120 2023-11-28T06:33:08.109 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdb066d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000ce7a0 con 0x7fdb000cfce0 2023-11-28T06:33:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdaff7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000cfce0 0x7fdb000b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdafffff640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fdb0015b120 0x7fdb0015f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:53572/0 (socket says 172.21.15.154:53572) 2023-11-28T06:33:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdb04c70640 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fdb000cda40 0x7fdb0015b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:38258/0 (socket says 172.21.15.154:38258) 2023-11-28T06:33:08.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.107+0000 7fdafffff640 1 -- 172.21.15.154:0/486353902 learned_addr learned my addr 172.21.15.154:0/486353902 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.108+0000 7fdaff7fe640 1 -- 172.21.15.154:0/486353902 >> v1:172.21.15.194:6789/0 conn(0x7fdb0015b120 legacy=0x7fdb0015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.108+0000 7fdaff7fe640 1 -- 172.21.15.154:0/486353902 >> v1:172.21.15.154:6789/0 conn(0x7fdb000cda40 legacy=0x7fdb0015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.108+0000 7fdafeffd640 1 -- 172.21.15.154:0/486353902 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022487389 0 0) 0x7fdb000ce1e0 con 0x7fdb0015b120 2023-11-28T06:33:08.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.108+0000 7fdaff7fe640 1 -- 172.21.15.154:0/486353902 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000ce4c0 con 0x7fdb000cfce0 2023-11-28T06:33:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.110+0000 7fdaff7fe640 1 --2- 172.21.15.154:0/486353902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000cfce0 0x7fdb000b22e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40097d0 tx=0x7fdaf402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2734179a7d238dac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.110+0000 7fdafeffd640 1 -- 172.21.15.154:0/486353902 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4031800 con 0x7fdb000cfce0 2023-11-28T06:33:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.110+0000 7fdafeffd640 1 -- 172.21.15.154:0/486353902 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4031960 con 0x7fdb000cfce0 2023-11-28T06:33:08.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.110+0000 7fdafeffd640 1 -- 172.21.15.154:0/486353902 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4031cf0 con 0x7fdb000cfce0 2023-11-28T06:33:08.114 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 -- 172.21.15.154:0/486353902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000cfce0 msgr2=0x7fdb000b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 --2- 172.21.15.154:0/486353902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000cfce0 0x7fdb000b22e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40097d0 tx=0x7fdaf402b8a0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 -- 172.21.15.154:0/486353902 shutdown_connections 2023-11-28T06:33:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 --2- 172.21.15.154:0/486353902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb000cfce0 0x7fdb000b22e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 -- 172.21.15.154:0/486353902 >> 172.21.15.154:0/486353902 conn(0x7fdb00066270 msgr2=0x7fdb00066650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:08.115 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 -- 172.21.15.154:0/486353902 shutdown_connections 2023-11-28T06:33:08.116 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.112+0000 7fdb066d3640 1 -- 172.21.15.154:0/486353902 wait complete. 2023-11-28T06:33:08.119 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.117+0000 7fdb066d3640 1 Processor -- start 2023-11-28T06:33:08.120 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.118+0000 7fdb066d3640 1 -- start start 2023-11-28T06:33:08.123 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.121+0000 7fdb066d3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000cda40 0x7fdb0014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.121+0000 7fdb066d3640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 0x7fdb000ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.121+0000 7fdb066d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb000b5060 0x7fdb000adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.121+0000 7fdb066d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0015a0e0 con 0x7fdb000b5060 2023-11-28T06:33:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.121+0000 7fdb066d3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000aedb0 con 0x7fdb000cda40 2023-11-28T06:33:08.124 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.121+0000 7fdb066d3640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb000ae510 con 0x7fdb0015b120 2023-11-28T06:33:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdafffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000cda40 0x7fdb0014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 0x7fdb000ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 0x7fdb000ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:56698/0 (socket says 172.21.15.154:56698) 2023-11-28T06:33:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 -- 172.21.15.154:0/2289037818 learned_addr learned my addr 172.21.15.154:0/2289037818 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:08.125 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdafffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000cda40 0x7fdb0014b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:53704/0 (socket says 172.21.15.154:53704) 2023-11-28T06:33:08.126 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdb04c70640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb000b5060 0x7fdb000adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:08.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 -- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000cda40 msgr2=0x7fdb0014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000cda40 0x7fdb0014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.127 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 -- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb000b5060 msgr2=0x7fdb000adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb000b5060 0x7fdb000adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdaff7fe640 1 -- 172.21.15.154:0/2289037818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4009400 con 0x7fdb0015b120 2023-11-28T06:33:08.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.122+0000 7fdb04c70640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb000b5060 0x7fdb000adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T06:33:08.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.123+0000 7fdaff7fe640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 0x7fdb000ad7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40098f0 tx=0x7fdaf40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:08.128 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.123+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf403bd80 con 0x7fdb0015b120 2023-11-28T06:33:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.123+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40453f0 con 0x7fdb0015b120 2023-11-28T06:33:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.123+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb000ae7f0 con 0x7fdb0015b120 2023-11-28T06:33:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.123+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40457a0 con 0x7fdb0015b120 2023-11-28T06:33:08.129 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.123+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb000ae230 con 0x7fdb0015b120 2023-11-28T06:33:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.126+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb00067420 con 0x7fdb0015b120 2023-11-28T06:33:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.126+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fdaf404e450 con 0x7fdb0015b120 2023-11-28T06:33:08.130 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.128+0000 7fdafcff9640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdaec06b1c0 0x7fdaec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.128+0000 7fdafffff640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdaec06b1c0 0x7fdaec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.128+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdaf402e070 con 0x7fdb0015b120 2023-11-28T06:33:08.131 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.129+0000 7fdafffff640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdaec06b1c0 0x7fdaec06d680 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007fd0 tx=0x7fdaf0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:08.134 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.132+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fdaf4076db0 con 0x7fdb0015b120 2023-11-28T06:33:08.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.645+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb0015fb00 con 0x7fdaec06b1c0 2023-11-28T06:33:08.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.652+0000 7fdafcff9640 1 -- 172.21.15.154:0/2289037818 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49331 (secure 0 0 0) 0x7fdaf0004c70 con 0x7fdaec06b1c0 2023-11-28T06:33:08.655 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:33:08.656 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-28T06:33:08.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.656+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdaec06b1c0 msgr2=0x7fdaec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.662 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdaec06b1c0 0x7fdaec06d680 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0007fd0 tx=0x7fdaf0007de0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 msgr2=0x7fdb000ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 0x7fdb000ad7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40098f0 tx=0x7fdaf40046c0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 shutdown_connections 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fdaec06b1c0 0x7fdaec06d680 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb000b5060 0x7fdb000adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb0015b120 0x7fdb000ad7b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 --2- 172.21.15.154:0/2289037818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb000cda40 0x7fdb0014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 >> 172.21.15.154:0/2289037818 conn(0x7fdb00066270 msgr2=0x7fdb0015f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:08.663 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 shutdown_connections 2023-11-28T06:33:08.664 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:08.657+0000 7fdb066d3640 1 -- 172.21.15.154:0/2289037818 wait complete. 2023-11-28T06:33:08.687 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":14536,"stamp":"2023-11-28T06:33:08.082747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12376040,"kb_used_data":4520,"kb_used_omap":7985,"kb_used_meta":12363470,"kb_avail":742598680,"statfs":{"total":773094113280,"available":760421048320,"internally_reserved":0,"allocated":4628480,"data_stored":2543792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8177315,"internal_metadata":12660193629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003525"},"pg_stats":[{"pgid":"1.0","version":"34'161","reported_seq":474,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T06:32:46.561653+0000","last_change":"2023-11-27T22:29:28.251227+0000","last_active":"2023-11-28T06:32:46.561653+0000","last_peered":"2023-11-28T06:32:46.561653+0000","last_clean":"2023-11-28T06:32:46.561653+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-28T06:32:46.561653+0000","last_undegraded":"2023-11-28T06:32:46.561653+0000","last_fullsized":"2023-11-28T06:32:46.561653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T22:29:27.222857+0000","last_clean_scrub_stamp":"2023-11-27T22:29:27.222857+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T08:18:10.323916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580655,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1609136,"kb_used_data":1000,"kb_used_omap":582,"kb_used_meta":1607545,"kb_avail":92762704,"statfs":{"total":96636764160,"available":94989008896,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596775,"internal_metadata":1646126297},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.611,"15min":1.3600000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.36399999999999999},"max":{"1min":13.365,"5min":13.487,"15min":13.487},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.538,"15min":1.3420000000000001},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.46999999999999997},"max":{"1min":7.4039999999999999,"5min":13.518000000000001,"15min":13.518000000000001},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.0459999999999998,"15min":1.8029999999999999},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":31.065999999999999,"5min":31.065999999999999,"15min":31.065999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":3.1589999999999998,"5min":2.3730000000000002,"15min":1.8240000000000001},"min":{"1min":0.63700000000000001,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":27.765000000000001,"5min":27.765000000000001,"15min":27.765000000000001},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":1.794,"15min":1.458},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":15.462999999999999,"5min":15.462999999999999,"15min":15.462999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":2.7879999999999998,"5min":1.9590000000000001,"15min":1.6519999999999999},"min":{"1min":0.48599999999999999,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":23.225999999999999,"5min":23.225999999999999,"15min":23.225999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7070000000000001,"15min":1.7010000000000001},"min":{"1min":0.497,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":6.3869999999999996,"5min":10.574,"15min":11.516},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.929,"5min":2.4420000000000002,"15min":2.0070000000000001},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":13.446,"5min":13.446,"15min":18.081},"last":0.64700000000000002}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.499,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":10.872,"5min":10.872,"15min":10.872},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.51600000000000001,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.26300000000000001},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.9569999999999999},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":8.8109999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":1.669,"5min":0.66400000000000003,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.30399999999999999,"15min":0.26300000000000001},"max":{"1min":21.373000000000001,"5min":21.373000000000001,"15min":21.373000000000001},"last":0.49199999999999999}]},{"osd":6,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.52500000000000002,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":6.2009999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":6.7359999999999998,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834580655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1601644,"kb_used_data":420,"kb_used_omap":212,"kb_used_meta":1601003,"kb_avail":92770196,"statfs":{"total":96636764160,"available":94996680704,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217819,"internal_metadata":1639427365},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.5900000000000001,"15min":1.296},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":5.4939999999999998,"5min":24.896999999999998,"15min":24.896999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.0870000000000002,"15min":1.5760000000000001},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.39200000000000002},"max":{"1min":11.02,"5min":37.939,"15min":37.939},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.8100000000000001,"15min":1.645},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":10.977,"5min":10.977,"15min":11.359999999999999},"last":0.878},{"interface":"front","average":{"1min":4.3490000000000002,"5min":2.1859999999999999,"15min":1.796},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":37.594999999999999,"5min":37.594999999999999,"15min":37.594999999999999},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":1.742,"15min":1.599},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":15.630000000000001,"5min":15.630000000000001,"15min":15.630000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":2.75,"5min":1.9299999999999999,"15min":1.6100000000000001},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.42699999999999999},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.82599999999999996}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":1.9970000000000001,"15min":1.6699999999999999},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"max":{"1min":12.163,"5min":15.5,"15min":15.5},"last":0.66900000000000004},{"interface":"front","average":{"1min":2.488,"5min":2.8959999999999999,"15min":1.8839999999999999},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":13.254,"5min":50.070999999999998,"15min":50.070999999999998},"last":0.78400000000000003}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.68999999999999995,"15min":0.46100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.246},"max":{"1min":1.135,"5min":25.050999999999998,"15min":25.050999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.58599999999999997,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":12.782,"5min":12.782,"15min":12.782},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.998,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.75900000000000001,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.49399999999999999,"5min":24.937999999999999,"15min":24.937999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.627,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.49199999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834580655,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1766828,"kb_used_data":420,"kb_used_omap":725,"kb_used_meta":1765674,"kb_avail":92605012,"statfs":{"total":96636764160,"available":94827532288,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":742844,"internal_metadata":1808050756},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.446,"15min":1.22},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.38},"max":{"1min":11.928000000000001,"5min":11.928000000000001,"15min":11.928000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6970000000000001,"15min":1.373},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":14.013,"5min":14.013,"15min":14.013},"last":0.93400000000000005}]},{"osd":1,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":1.8220000000000001,"15min":1.6479999999999999},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.36799999999999999},"max":{"1min":19.408000000000001,"5min":19.408000000000001,"15min":19.408000000000001},"last":0.755},{"interface":"front","average":{"1min":1.861,"5min":1.6080000000000001,"15min":1.448},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.4390000000000001,"5min":9.9830000000000005,"15min":24.847999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":3.927,"5min":2.4119999999999999,"15min":1.8660000000000001},"min":{"1min":0.436,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":13.951000000000001,"5min":27.013999999999999,"15min":27.013999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":3.0720000000000001,"5min":2.04,"15min":1.4570000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":18.638000000000002,"5min":18.638000000000002,"15min":18.638000000000002},"last":0.68700000000000006}]},{"osd":3,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":4.5110000000000001,"5min":2.3210000000000002,"15min":1.9850000000000001},"min":{"1min":0.498,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":37.655000000000001,"5min":37.655000000000001,"15min":37.655000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":3.9239999999999999,"5min":2.359,"15min":1.9350000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":16.497,"5min":16.497,"15min":16.497},"last":0.54500000000000004}]},{"osd":4,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.47099999999999997,"15min":0.40000000000000002},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.24199999999999999},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.048,"5min":0.52000000000000002,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.25},"max":{"1min":14.074999999999999,"5min":14.074999999999999,"15min":14.074999999999999},"last":0.40500000000000003}]},{"osd":6,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40999999999999998},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":3.819,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.65700000000000003,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":5.657,"5min":14.951000000000001,"15min":14.951000000000001},"last":0.44900000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.58899999999999997,"15min":0.48399999999999999},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":14.045,"5min":14.045,"15min":14.045},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.008,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.50800000000000001}]}]},{"osd":4,"up_from":13,"seq":55834580653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1589932,"kb_used_data":420,"kb_used_omap":1298,"kb_used_meta":1588205,"kb_avail":92781908,"statfs":{"total":96636764160,"available":95008673792,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1330133,"internal_metadata":1626321963},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.3779999999999999,"15min":1.214},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":3.1080000000000001,"5min":10.359999999999999,"15min":10.542},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.46,"5min":1.5600000000000001,"15min":1.2310000000000001},"min":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.40899999999999997},"max":{"1min":11.694000000000001,"5min":12.416,"15min":12.416},"last":0.65800000000000003}]},{"osd":1,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":2.1960000000000002,"15min":1.7889999999999999},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":28.722999999999999,"5min":28.722999999999999,"15min":28.722999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":3.0539999999999998,"5min":2.016,"15min":1.671},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.40100000000000002},"max":{"1min":27.699000000000002,"5min":27.699000000000002,"15min":27.699000000000002},"last":0.74299999999999999}]},{"osd":2,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.5649999999999999,"15min":1.4350000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42499999999999999},"max":{"1min":13.481999999999999,"5min":13.481999999999999,"15min":13.481999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":2.2589999999999999,"5min":1.6619999999999999,"15min":1.4770000000000001},"min":{"1min":0.51500000000000001,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":7.992,"5min":9.9149999999999991,"15min":11.736000000000001},"last":0.71499999999999997}]},{"osd":3,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.8440000000000001,"15min":1.71},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.40100000000000002},"max":{"1min":11.721,"5min":12.382,"15min":12.382},"last":0.57399999999999995},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.2280000000000002,"15min":1.9259999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.39300000000000002},"max":{"1min":12.007999999999999,"5min":12.007999999999999,"15min":13.673999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.1359999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.621,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":11.664,"5min":12.446999999999999,"15min":12.446999999999999},"last":0.41999999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.51400000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":11.507999999999999,"5min":11.507999999999999,"15min":11.507999999999999},"last":0.442},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.53900000000000003,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70499999999999996,"15min":0.52900000000000003},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":11.629,"5min":12.336,"15min":12.336},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.56299999999999994,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":11.471,"5min":11.471,"15min":11.471},"last":0.501}]}]},{"osd":3,"up_from":13,"seq":55834580481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1768044,"kb_used_data":420,"kb_used_omap":1855,"kb_used_meta":1765760,"kb_avail":92603796,"statfs":{"total":96636764160,"available":94826287104,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1899643,"internal_metadata":1808139141},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":3.544,"15min":3.3690000000000002},"min":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54100000000000004},"max":{"1min":29.311,"5min":29.311,"15min":29.311},"last":1.014},{"interface":"front","average":{"1min":3.6379999999999999,"5min":3.5030000000000001,"15min":3.3599999999999999},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.56299999999999994},"max":{"1min":20.762,"5min":21.399999999999999,"15min":21.399999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.7090000000000001,"5min":4.0350000000000001,"15min":3.4969999999999999},"min":{"1min":0.625,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":11.140000000000001,"5min":20.879999999999999,"15min":20.879999999999999},"last":1.5209999999999999},{"interface":"front","average":{"1min":4.9059999999999997,"5min":5.3449999999999998,"15min":4.2279999999999998},"min":{"1min":0.70699999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":29.452999999999999,"5min":48.625999999999998,"15min":48.625999999999998},"last":1.1519999999999999}]},{"osd":2,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.859,"5min":4.306,"15min":3.7650000000000001},"min":{"1min":0.93899999999999995,"5min":0.75,"15min":0.66600000000000004},"max":{"1min":25.378,"5min":33.497999999999998,"15min":33.497999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.5259999999999998,"15min":3.4700000000000002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65100000000000002},"max":{"1min":11.054,"5min":21.193000000000001,"15min":21.193000000000001},"last":1.1830000000000001}]},{"osd":4,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.7949999999999999,"15min":2.7570000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55900000000000005},"max":{"1min":9.6820000000000004,"5min":21.931999999999999,"15min":21.931999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.544,"5min":3.2669999999999999,"15min":2.839},"min":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.60599999999999998},"max":{"1min":10.705,"5min":21.013999999999999,"15min":21.013999999999999},"last":1.429}]},{"osd":5,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":3.5209999999999999,"15min":3.0129999999999999},"min":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.69499999999999995},"max":{"1min":10.881,"5min":21.344000000000001,"15min":21.344000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":2.2389999999999999,"5min":2.9769999999999999,"15min":2.8319999999999999},"min":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":9.4179999999999993,"5min":21.631,"15min":21.631},"last":1.2969999999999999}]},{"osd":6,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":3.077,"15min":2.9769999999999999},"min":{"1min":0.84599999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":9.5670000000000002,"5min":21.792000000000002,"15min":21.792000000000002},"last":1.369},{"interface":"front","average":{"1min":2.452,"5min":2.9940000000000002,"15min":2.9790000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.72199999999999998},"max":{"1min":9.7729999999999997,"5min":21.838999999999999,"15min":21.838999999999999},"last":1.2410000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":3.1309999999999998,"15min":3.0899999999999999},"min":{"1min":0.91600000000000004,"5min":0.89300000000000002,"15min":0.79700000000000004},"max":{"1min":9.8710000000000004,"5min":25.337,"15min":25.337},"last":1.113},{"interface":"front","average":{"1min":2.8199999999999998,"5min":3.6779999999999999,"15min":3.246},"min":{"1min":0.94299999999999995,"5min":0.89200000000000002,"15min":0.80700000000000005},"max":{"1min":11.234,"5min":21.274000000000001,"15min":21.274000000000001},"last":1.9850000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1083692,"kb_used_data":420,"kb_used_omap":591,"kb_used_meta":1082672,"kb_avail":93288148,"statfs":{"total":96636764160,"available":95527063552,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":605891,"internal_metadata":1108656445},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":2.8530000000000002,"15min":2.8610000000000002},"min":{"1min":0.66200000000000003,"5min":0.58099999999999996,"15min":0.56200000000000006},"max":{"1min":7.4779999999999998,"5min":15.250999999999999,"15min":21.669},"last":0.57099999999999995},{"interface":"front","average":{"1min":4.1440000000000001,"5min":3.3460000000000001,"15min":3.1259999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":27.016999999999999,"5min":27.016999999999999,"15min":27.016999999999999},"last":0.97999999999999998}]},{"osd":1,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3449999999999998,"5min":3.786,"15min":3.3029999999999999},"min":{"1min":0.76900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":15.436999999999999,"5min":15.436999999999999,"15min":18.707000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":4.6319999999999997,"5min":3.98,"15min":3.4489999999999998},"min":{"1min":0.80400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"max":{"1min":22.309999999999999,"5min":22.309999999999999,"15min":22.309999999999999},"last":0.872}]},{"osd":3,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":3.2469999999999999,"15min":3.0299999999999998},"min":{"1min":1.149,"5min":0.71599999999999997,"15min":0.65800000000000003},"max":{"1min":13.811999999999999,"5min":16.957000000000001,"15min":17.643000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":5.327,"5min":4.1390000000000002,"15min":3.556},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82699999999999996},"max":{"1min":17.016999999999999,"5min":17.016999999999999,"15min":17.016999999999999},"last":0.92400000000000004}]},{"osd":4,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.5880000000000001,"15min":2.3719999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.59099999999999997},"max":{"1min":6.8479999999999999,"5min":11.452999999999999,"15min":13.121},"last":0.748},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.734,"15min":2.4510000000000001},"min":{"1min":0.66100000000000003,"5min":0.64000000000000001,"15min":0.58199999999999996},"max":{"1min":12.598000000000001,"5min":13.615,"15min":15.178000000000001},"last":1.0720000000000001}]},{"osd":5,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3730000000000002,"5min":2.3490000000000002,"15min":2.0619999999999998},"min":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.60399999999999998},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":1.109},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.7320000000000002,"15min":2.5219999999999998},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":7.2169999999999996,"5min":11.573,"15min":13.02},"last":1.024}]},{"osd":6,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":2.9249999999999998,"15min":2.6429999999999998},"min":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.68600000000000005},"max":{"1min":12.707000000000001,"5min":13.789999999999999,"15min":14.960000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":3.468,"5min":2.3940000000000001,"15min":2.2029999999999998},"min":{"1min":0.86099999999999999,"5min":0.745,"15min":0.71099999999999997},"max":{"1min":10.02,"5min":11.057,"15min":11.135},"last":1.2849999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.871,"5min":3.0019999999999998,"15min":2.7480000000000002},"min":{"1min":0.873,"5min":0.83699999999999997,"15min":0.78000000000000003},"max":{"1min":12.794,"5min":13.715999999999999,"15min":15.257999999999999},"last":1.24},{"interface":"front","average":{"1min":3.569,"5min":2.46,"15min":2.3570000000000002},"min":{"1min":0.98299999999999998,"5min":0.81699999999999995,"15min":0.78300000000000003},"max":{"1min":10.102,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.2}]}]},{"osd":1,"up_from":13,"seq":55834580534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1415788,"kb_used_data":420,"kb_used_omap":1951,"kb_used_meta":1413408,"kb_avail":92956052,"statfs":{"total":96636764160,"available":95186997248,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1997886,"internal_metadata":1447330754},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":5.7130000000000001,"5min":3.6629999999999998,"15min":2.9430000000000001},"min":{"1min":0.67000000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":27.271999999999998,"5min":27.271999999999998,"15min":27.271999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":5.0270000000000001,"5min":3.2719999999999998,"15min":3.0569999999999999},"min":{"1min":0.77300000000000002,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":33.43,"5min":33.43,"15min":33.43},"last":0.92800000000000005}]},{"osd":2,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.9930000000000003,"5min":3.9260000000000002,"15min":3.2650000000000001},"min":{"1min":0.89100000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":18.050999999999998,"5min":18.050999999999998,"15min":18.050999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":5.2759999999999998,"5min":4.2300000000000004,"15min":3.355},"min":{"1min":1.2749999999999999,"5min":0.73799999999999999,"15min":0.65300000000000002},"max":{"1min":26.978999999999999,"5min":26.978999999999999,"15min":26.978999999999999},"last":0.877}]},{"osd":3,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":4.5490000000000004,"5min":4.2370000000000001,"15min":3.5739999999999998},"min":{"1min":0.73899999999999999,"5min":0.71299999999999997,"15min":0.69299999999999995},"max":{"1min":11.843,"5min":11.843,"15min":16.558},"last":0.98299999999999998},{"interface":"front","average":{"1min":6.7859999999999996,"5min":4.726,"15min":3.9449999999999998},"min":{"1min":0.88100000000000001,"5min":0.73199999999999998,"15min":0.65100000000000002},"max":{"1min":33.329999999999998,"5min":33.329999999999998,"15min":33.329999999999998},"last":1.0229999999999999}]},{"osd":4,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.2029999999999998,"5min":2.673,"15min":2.2989999999999999},"min":{"1min":0.71599999999999997,"5min":0.67400000000000004,"15min":0.58099999999999996},"max":{"1min":13.111000000000001,"5min":13.278,"15min":13.278},"last":1.1040000000000001},{"interface":"front","average":{"1min":2.9780000000000002,"5min":2.8660000000000001,"15min":2.4660000000000002},"min":{"1min":0.64300000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":6.1710000000000003,"5min":10.628,"15min":12.055999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":2.7639999999999998,"15min":2.6200000000000001},"min":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.622},"max":{"1min":13.535,"5min":13.535,"15min":13.535},"last":1.1479999999999999},{"interface":"front","average":{"1min":3.7989999999999999,"5min":2.9340000000000002,"15min":2.4729999999999999},"min":{"1min":0.877,"5min":0.78100000000000003,"15min":0.71799999999999997},"max":{"1min":18.117000000000001,"5min":18.117000000000001,"15min":18.117000000000001},"last":1.2370000000000001}]},{"osd":6,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.4220000000000002,"5min":2.843,"15min":2.7450000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":9.9719999999999995,"5min":9.9719999999999995,"15min":12.875},"last":1.214},{"interface":"front","average":{"1min":4.1749999999999998,"5min":3.1099999999999999,"15min":2.645},"min":{"1min":1.0640000000000001,"5min":0.875,"15min":0.80500000000000005},"max":{"1min":27.998999999999999,"5min":27.998999999999999,"15min":27.998999999999999},"last":1.1919999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:17 2023","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":3.056,"15min":2.6739999999999999},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.76100000000000001},"max":{"1min":6.0789999999999997,"5min":10.736000000000001,"15min":12.144},"last":1.3160000000000001},{"interface":"front","average":{"1min":3.3679999999999999,"5min":2.8999999999999999,"15min":2.8679999999999999},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":10.055999999999999,"5min":10.055999999999999,"15min":12.952},"last":1.2629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834580620,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1540976,"kb_used_data":1000,"kb_used_omap":767,"kb_used_meta":1539200,"kb_avail":92830864,"statfs":{"total":96636764160,"available":95058804736,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786324,"internal_metadata":1576140908},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5230000000000001,"5min":3.1309999999999998,"15min":3.0510000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.4019999999999992,"5min":59.180999999999997,"15min":59.180999999999997},"last":1.044},{"interface":"front","average":{"1min":3.657,"5min":2.8799999999999999,"15min":2.9550000000000001},"min":{"1min":0.873,"5min":0.64500000000000002,"15min":0.54900000000000004},"max":{"1min":12.970000000000001,"5min":12.970000000000001,"15min":14.712999999999999},"last":0.93200000000000005}]},{"osd":2,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":3.6480000000000001,"15min":3.1459999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.55000000000000004},"max":{"1min":5.9009999999999998,"5min":80.992000000000004,"15min":80.992000000000004},"last":1.2050000000000001},{"interface":"front","average":{"1min":3.6339999999999999,"5min":3.5779999999999998,"15min":3.1389999999999998},"min":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.59299999999999997},"max":{"1min":12.484,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.82199999999999995}]},{"osd":3,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.9399999999999999,"5min":3.613,"15min":3.3540000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.5350000000000001,"5min":16.291,"15min":16.291},"last":1.246},{"interface":"front","average":{"1min":3.7050000000000001,"5min":5.0620000000000003,"15min":3.9990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":12.747999999999999,"5min":80.918000000000006,"15min":80.918000000000006},"last":1.325}]},{"osd":4,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.982,"15min":1.8380000000000001},"min":{"1min":0.67200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":12.039999999999999,"5min":14.657,"15min":14.657},"last":0.97499999999999998},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.8849999999999998,"15min":2.4710000000000001},"min":{"1min":0.82699999999999996,"5min":0.65600000000000003,"15min":0.61599999999999999},"max":{"1min":5.5949999999999998,"5min":80.745000000000005,"15min":80.745000000000005},"last":1.431}]},{"osd":5,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5150000000000001,"5min":2.5099999999999998,"15min":2.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.626},"max":{"1min":6.3369999999999997,"5min":15.202999999999999,"15min":15.202999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":2.415,"5min":2.1930000000000001,"15min":2.0419999999999998},"min":{"1min":0.93600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":11.775,"5min":14.800000000000001,"15min":14.800000000000001},"last":1.1539999999999999}]},{"osd":6,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.2829999999999999,"15min":2.149},"min":{"1min":1.0129999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":11.959,"5min":14.917,"15min":14.917},"last":1.3979999999999999},{"interface":"front","average":{"1min":2.177,"5min":3.0350000000000001,"15min":2.6930000000000001},"min":{"1min":1.0069999999999999,"5min":0.82199999999999995,"15min":0.72399999999999998},"max":{"1min":5.8090000000000002,"5min":80.840000000000003,"15min":80.840000000000003},"last":1.867}]},{"osd":7,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.657,"15min":2.4700000000000002},"min":{"1min":1.0740000000000001,"5min":0.90600000000000003,"15min":0.72099999999999997},"max":{"1min":6.444,"5min":15.118,"15min":15.118},"last":1.353},{"interface":"front","average":{"1min":2.5670000000000002,"5min":2.395,"15min":2.262},"min":{"1min":1.0549999999999999,"5min":0.88,"15min":0.88},"max":{"1min":11.880000000000001,"5min":15.396000000000001,"15min":15.396000000000001},"last":1.29}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T06:33:08.690 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-27T22:29:27.222857+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=27, tm_hour=22, tm_min=29, tm_sec=27, tm_wday=0, tm_yday=331, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=6, tm_min=32, tm_sec=56, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T06:33:08.691 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T06:33:28.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T06:33:28.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.980+0000 7f8ece2bc640 1 Processor -- start 2023-11-28T06:33:28.982 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.981+0000 7f8ece2bc640 1 -- start start 2023-11-28T06:33:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ece2bc640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8ec8157cc0 0x7f8ec80b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ece2bc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8071a90 0x7f8ec80cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ece2bc640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec80ceed0 con 0x7f8ec80b34b0 2023-11-28T06:33:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ece2bc640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec806e590 con 0x7f8ec8157cc0 2023-11-28T06:33:28.984 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ece2bc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec806e2b0 con 0x7f8ec8071a90 2023-11-28T06:33:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ec7fff640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8ec8157cc0 0x7f8ec80b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ec77fe640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8ec80b34b0 0x7f8ec8071380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:56072/0 (socket says 172.21.15.154:56072) 2023-11-28T06:33:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ecc859640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8071a90 0x7f8ec80cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:28.985 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.983+0000 7f8ec77fe640 1 -- 172.21.15.154:0/1090340912 learned_addr learned my addr 172.21.15.154:0/1090340912 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.984+0000 7f8ec7fff640 1 -- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8071a90 msgr2=0x7f8ec80cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.984+0000 7f8ec7fff640 1 --2- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8071a90 0x7f8ec80cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.984+0000 7f8ec7fff640 1 -- 172.21.15.154:0/1090340912 >> v1:172.21.15.194:6789/0 conn(0x7f8ec80b34b0 legacy=0x7f8ec8071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.984+0000 7f8ec6ffd640 1 -- 172.21.15.154:0/1090340912 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551404582 0 0) 0x7f8ec80ceed0 con 0x7f8ec80b34b0 2023-11-28T06:33:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.984+0000 7f8ec7fff640 1 -- 172.21.15.154:0/1090340912 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80ce880 con 0x7f8ec8157cc0 2023-11-28T06:33:28.986 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.984+0000 7f8ecc859640 1 --2- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8071a90 0x7f8ec80cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.986+0000 7f8ec7fff640 1 --2- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8157cc0 0x7f8ec80b2f70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80097a0 tx=0x7f8eb802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab757176a928d20 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:28.987 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.986+0000 7f8ec6ffd640 1 -- 172.21.15.154:0/1090340912 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8031830 con 0x7f8ec8157cc0 2023-11-28T06:33:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.986+0000 7f8ec6ffd640 1 -- 172.21.15.154:0/1090340912 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8031990 con 0x7f8ec8157cc0 2023-11-28T06:33:28.988 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.986+0000 7f8ec6ffd640 1 -- 172.21.15.154:0/1090340912 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8031d20 con 0x7f8ec8157cc0 2023-11-28T06:33:28.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 -- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8157cc0 msgr2=0x7f8ec80b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:28.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8157cc0 0x7f8ec80b2f70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80097a0 tx=0x7f8eb802b8d0 comp rx=0 tx=0).stop 2023-11-28T06:33:28.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 -- 172.21.15.154:0/1090340912 shutdown_connections 2023-11-28T06:33:28.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8071a90 0x7f8ec80cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:28.989 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/1090340912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8157cc0 0x7f8ec80b2f70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:28.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 -- 172.21.15.154:0/1090340912 >> 172.21.15.154:0/1090340912 conn(0x7f8ec806b5e0 msgr2=0x7f8ec806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:28.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 -- 172.21.15.154:0/1090340912 shutdown_connections 2023-11-28T06:33:28.990 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.988+0000 7f8ece2bc640 1 -- 172.21.15.154:0/1090340912 wait complete. 2023-11-28T06:33:28.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.991+0000 7f8ece2bc640 1 Processor -- start 2023-11-28T06:33:28.992 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.992+0000 7f8ece2bc640 1 -- start start 2023-11-28T06:33:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ece2bc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 0x7f8ec813fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ece2bc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec80b34b0 0x7f8ec81e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ece2bc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8157cc0 0x7f8ec815d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ece2bc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81e4ca0 con 0x7f8ec80b34b0 2023-11-28T06:33:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ece2bc640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81e3e30 con 0x7f8ec8071a90 2023-11-28T06:33:28.995 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ece2bc640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81e4020 con 0x7f8ec8157cc0 2023-11-28T06:33:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec80b34b0 0x7f8ec81e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:28.996 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 0x7f8ec813fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ecc859640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8157cc0 0x7f8ec815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ec7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 0x7f8ec813fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:49704/0 (socket says 172.21.15.154:49704) 2023-11-28T06:33:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.994+0000 7f8ec7fff640 1 -- 172.21.15.154:0/3394214815 learned_addr learned my addr 172.21.15.154:0/3394214815 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.995+0000 7f8ecc859640 1 -- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 msgr2=0x7f8ec813fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.995+0000 7f8ecc859640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 0x7f8ec813fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:28.997 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.995+0000 7f8ecc859640 1 -- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec80b34b0 msgr2=0x7f8ec81e38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:28.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.995+0000 7f8ecc859640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec80b34b0 0x7f8ec81e38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:28.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.995+0000 7f8ecc859640 1 -- 172.21.15.154:0/3394214815 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009a70 con 0x7f8ec8157cc0 2023-11-28T06:33:28.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.995+0000 7f8ec7fff640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 0x7f8ec813fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:28.998 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.996+0000 7f8ecc859640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8157cc0 0x7f8ec815d470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009db0 tx=0x7f8ec000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.996+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000cd30 con 0x7f8ec8157cc0 2023-11-28T06:33:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.996+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000f040 con 0x7f8ec8157cc0 2023-11-28T06:33:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.996+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0003bd0 con 0x7f8ec8157cc0 2023-11-28T06:33:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.996+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb8009400 con 0x7f8ec8157cc0 2023-11-28T06:33:28.999 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.996+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec81e45e0 con 0x7f8ec8157cc0 2023-11-28T06:33:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.999+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec8067420 con 0x7f8ec8157cc0 2023-11-28T06:33:29.000 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:28.999+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7f8ec0014480 con 0x7f8ec8157cc0 2023-11-28T06:33:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.000+0000 7f8ec4ff9640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ea806b1c0 0x7f8ea806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.001+0000 7f8ec7fff640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ea806b1c0 0x7f8ea806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.001 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.001+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8ec008a120 con 0x7f8ec8157cc0 2023-11-28T06:33:29.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.002+0000 7f8ec7fff640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ea806b1c0 0x7f8ea806d680 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8eb802b910 tx=0x7f8eb803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:29.006 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.005+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7f8ec0055200 con 0x7f8ec8157cc0 2023-11-28T06:33:29.524 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.522+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 --> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ec806ecc0 con 0x7f8ea806b1c0 2023-11-28T06:33:29.529 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.528+0000 7f8ec4ff9640 1 -- 172.21.15.154:0/3394214815 <== mgr.4104 v2:172.21.15.154:6832/359126469 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49272 (secure 0 0 0) 0x7f8ec806ecc0 con 0x7f8ea806b1c0 2023-11-28T06:33:29.530 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:33:29.530 INFO:teuthology.orchestra.run.smithi154.stderr:dumped all 2023-11-28T06:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ea806b1c0 msgr2=0x7f8ea806d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ea806b1c0 0x7f8ea806d680 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8eb802b910 tx=0x7f8eb803c040 comp rx=0 tx=0).stop 2023-11-28T06:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8157cc0 msgr2=0x7f8ec815d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8157cc0 0x7f8ec815d470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009db0 tx=0x7f8ec000c490 comp rx=0 tx=0).stop 2023-11-28T06:33:29.535 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 shutdown_connections 2023-11-28T06:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7f8ea806b1c0 0x7f8ea806d680 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.536 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8ec8157cc0 0x7f8ec815d470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ec80b34b0 0x7f8ec81e38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 --2- 172.21.15.154:0/3394214815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ec8071a90 0x7f8ec813fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 >> 172.21.15.154:0/3394214815 conn(0x7f8ec806b5e0 msgr2=0x7f8ec815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 shutdown_connections 2023-11-28T06:33:29.537 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.534+0000 7f8ece2bc640 1 -- 172.21.15.154:0/3394214815 wait complete. 2023-11-28T06:33:29.563 INFO:teuthology.orchestra.run.smithi154.stdout:{"pg_ready":true,"pg_map":{"version":14546,"stamp":"2023-11-28T06:33:28.088057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12376040,"kb_used_data":4520,"kb_used_omap":7985,"kb_used_meta":12363470,"kb_avail":742598680,"statfs":{"total":773094113280,"available":760421048320,"internally_reserved":0,"allocated":4628480,"data_stored":2543792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8177315,"internal_metadata":12660193629},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003098"},"pg_stats":[{"pgid":"1.0","version":"37'163","reported_seq":485,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-28T06:33:08.735855+0000","last_change":"2023-11-28T06:33:08.735885+0000","last_active":"2023-11-28T06:33:08.735855+0000","last_peered":"2023-11-28T06:33:08.735855+0000","last_clean":"2023-11-28T06:33:08.735855+0000","last_became_active":"2023-11-27T22:29:28.250351+0000","last_became_peered":"2023-11-27T22:29:28.250351+0000","last_unstale":"2023-11-28T06:33:08.735855+0000","last_undegraded":"2023-11-28T06:33:08.735855+0000","last_fullsized":"2023-11-28T06:33:08.735855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'163","last_scrub_stamp":"2023-11-28T06:33:08.735778+0000","last_deep_scrub":"37'163","last_deep_scrub_stamp":"2023-11-28T06:33:08.735778+0000","last_clean_scrub_stamp":"2023-11-28T06:33:08.735778+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:02.420929+0000","scrub_duration":0.27633326699999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580659,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1609136,"kb_used_data":1000,"kb_used_omap":582,"kb_used_meta":1607545,"kb_avail":92762704,"statfs":{"total":96636764160,"available":94989008896,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":596775,"internal_metadata":1646126297},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.611,"15min":1.3600000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.36399999999999999},"max":{"1min":13.365,"5min":13.487,"15min":13.487},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.538,"15min":1.3420000000000001},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.46999999999999997},"max":{"1min":7.4039999999999999,"5min":13.518000000000001,"15min":13.518000000000001},"last":0.78900000000000003}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.0459999999999998,"15min":1.8029999999999999},"min":{"1min":0.439,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":31.065999999999999,"5min":31.065999999999999,"15min":31.065999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":3.1589999999999998,"5min":2.3730000000000002,"15min":1.8240000000000001},"min":{"1min":0.63700000000000001,"5min":0.40799999999999997,"15min":0.39300000000000002},"max":{"1min":27.765000000000001,"5min":27.765000000000001,"15min":27.765000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.9690000000000001,"5min":1.794,"15min":1.458},"min":{"1min":0.44500000000000001,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":15.462999999999999,"5min":15.462999999999999,"15min":15.462999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":2.7879999999999998,"5min":1.9590000000000001,"15min":1.6519999999999999},"min":{"1min":0.48599999999999999,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":23.225999999999999,"5min":23.225999999999999,"15min":23.225999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.7070000000000001,"15min":1.7010000000000001},"min":{"1min":0.497,"5min":0.45700000000000002,"15min":0.432},"max":{"1min":6.3869999999999996,"5min":10.574,"15min":11.516},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.929,"5min":2.4420000000000002,"15min":2.0070000000000001},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":13.446,"5min":13.446,"15min":18.081},"last":0.75}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.499,"15min":0.435},"min":{"1min":0.26500000000000001,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":10.872,"5min":10.872,"15min":10.872},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.0369999999999999,"5min":0.51600000000000001,"15min":0.46899999999999997},"min":{"1min":0.29999999999999999,"5min":0.28399999999999997,"15min":0.26300000000000001},"max":{"1min":7.4429999999999996,"5min":7.4429999999999996,"15min":7.9569999999999999},"last":0.504}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.42099999999999999,"15min":0.44700000000000001},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":8.8109999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.669,"5min":0.66400000000000003,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.30399999999999999,"15min":0.26300000000000001},"max":{"1min":21.373000000000001,"5min":21.373000000000001,"15min":21.373000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.52500000000000002,"15min":0.496},"min":{"1min":0.35899999999999999,"5min":0.29799999999999999,"15min":0.29199999999999998},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":6.2009999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.52600000000000002,"15min":0.47499999999999998},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.317},"max":{"1min":6.7359999999999998,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834580659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1601644,"kb_used_data":420,"kb_used_omap":212,"kb_used_meta":1601003,"kb_avail":92770196,"statfs":{"total":96636764160,"available":94996680704,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217819,"internal_metadata":1639427365},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.5900000000000001,"15min":1.296},"min":{"1min":0.442,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":5.4939999999999998,"5min":24.896999999999998,"15min":24.896999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":2.0619999999999998,"5min":2.0870000000000002,"15min":1.5760000000000001},"min":{"1min":0.443,"5min":0.41699999999999998,"15min":0.39200000000000002},"max":{"1min":11.02,"5min":37.939,"15min":37.939},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.8100000000000001,"15min":1.645},"min":{"1min":0.46300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":10.977,"5min":10.977,"15min":11.359999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":4.3490000000000002,"5min":2.1859999999999999,"15min":1.796},"min":{"1min":0.46300000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":37.594999999999999,"5min":37.594999999999999,"15min":37.594999999999999},"last":0.67500000000000004}]},{"osd":2,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":1.742,"15min":1.599},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":15.630000000000001,"5min":15.630000000000001,"15min":15.630000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":2.75,"5min":1.9299999999999999,"15min":1.6100000000000001},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.42699999999999999},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.57599999999999996}]},{"osd":3,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":2.1880000000000002,"5min":1.9970000000000001,"15min":1.6699999999999999},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.432},"max":{"1min":12.163,"5min":15.5,"15min":15.5},"last":0.70399999999999996},{"interface":"front","average":{"1min":2.488,"5min":2.8959999999999999,"15min":1.8839999999999999},"min":{"1min":0.44900000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":13.254,"5min":50.070999999999998,"15min":50.070999999999998},"last":0.58999999999999997}]},{"osd":4,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.68999999999999995,"15min":0.46100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.246},"max":{"1min":1.135,"5min":25.050999999999998,"15min":25.050999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.58599999999999997,"15min":0.45100000000000001},"min":{"1min":0.29599999999999999,"5min":0.26400000000000001,"15min":0.255},"max":{"1min":12.782,"5min":12.782,"15min":12.782},"last":0.36299999999999999}]},{"osd":5,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.998,"5min":5.8049999999999997,"15min":5.8049999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.75900000000000001,"15min":0.52600000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.49399999999999999,"5min":24.937999999999999,"15min":24.937999999999999},"last":0.442}]},{"osd":7,"last update":"Tue Nov 28 06:32:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.627,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.28899999999999998,"15min":0.28199999999999997},"max":{"1min":0.49199999999999999,"5min":10.513999999999999,"15min":10.513999999999999},"last":0.38},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64400000000000002,"15min":0.51300000000000001},"min":{"1min":0.33000000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.56100000000000005,"5min":12.539999999999999,"15min":12.539999999999999},"last":0.46600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834580659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1766828,"kb_used_data":420,"kb_used_omap":725,"kb_used_meta":1765674,"kb_avail":92605012,"statfs":{"total":96636764160,"available":94827532288,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":742844,"internal_metadata":1808050756},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.446,"15min":1.22},"min":{"1min":0.40799999999999997,"5min":0.40200000000000002,"15min":0.38},"max":{"1min":11.928000000000001,"5min":11.928000000000001,"15min":11.928000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":3.4700000000000002,"5min":1.6970000000000001,"15min":1.373},"min":{"1min":0.41299999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":14.013,"5min":14.013,"15min":14.013},"last":0.70199999999999996}]},{"osd":1,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4079999999999999,"5min":1.8220000000000001,"15min":1.6479999999999999},"min":{"1min":0.44600000000000001,"5min":0.41899999999999998,"15min":0.36799999999999999},"max":{"1min":19.408000000000001,"5min":19.408000000000001,"15min":19.408000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.861,"5min":1.6080000000000001,"15min":1.448},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":6.4390000000000001,"5min":9.9830000000000005,"15min":24.847999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":3.927,"5min":2.4119999999999999,"15min":1.8660000000000001},"min":{"1min":0.436,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":13.951000000000001,"5min":27.013999999999999,"15min":27.013999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":3.0720000000000001,"5min":2.04,"15min":1.4570000000000001},"min":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":18.638000000000002,"5min":18.638000000000002,"15min":18.638000000000002},"last":0.78200000000000003}]},{"osd":3,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":4.5110000000000001,"5min":2.3210000000000002,"15min":1.9850000000000001},"min":{"1min":0.498,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":37.655000000000001,"5min":37.655000000000001,"15min":37.655000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":3.9239999999999999,"5min":2.359,"15min":1.9350000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"max":{"1min":16.497,"5min":16.497,"15min":16.497},"last":0.755}]},{"osd":4,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.47099999999999997,"15min":0.40000000000000002},"min":{"1min":0.25700000000000001,"5min":0.249,"15min":0.24199999999999999},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.048,"5min":0.52000000000000002,"15min":0.433},"min":{"1min":0.27300000000000002,"5min":0.25,"15min":0.25},"max":{"1min":14.074999999999999,"5min":14.074999999999999,"15min":14.074999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.45200000000000001,"15min":0.40999999999999998},"min":{"1min":0.27500000000000002,"5min":0.26500000000000001,"15min":0.251},"max":{"1min":3.819,"5min":4.1120000000000001,"15min":4.1120000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.65700000000000003,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26500000000000001},"max":{"1min":5.657,"5min":14.951000000000001,"15min":14.951000000000001},"last":0.45100000000000001}]},{"osd":7,"last update":"Tue Nov 28 06:32:53 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.58899999999999997,"15min":0.48399999999999999},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":14.045,"5min":14.045,"15min":14.045},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.48099999999999998,"15min":0.46300000000000002},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.008,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834580657,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1589932,"kb_used_data":420,"kb_used_omap":1298,"kb_used_meta":1588205,"kb_avail":92781908,"statfs":{"total":96636764160,"available":95008673792,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1330133,"internal_metadata":1626321963},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.3779999999999999,"15min":1.214},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":3.1080000000000001,"5min":10.359999999999999,"15min":10.542},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.46,"5min":1.5600000000000001,"15min":1.2310000000000001},"min":{"1min":0.45100000000000001,"5min":0.41599999999999998,"15min":0.40899999999999997},"max":{"1min":11.694000000000001,"5min":12.416,"15min":12.416},"last":0.72899999999999998}]},{"osd":1,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":2.1960000000000002,"15min":1.7889999999999999},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38500000000000001},"max":{"1min":28.722999999999999,"5min":28.722999999999999,"15min":28.722999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":3.0539999999999998,"5min":2.016,"15min":1.671},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.40100000000000002},"max":{"1min":27.699000000000002,"5min":27.699000000000002,"15min":27.699000000000002},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.5649999999999999,"15min":1.4350000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42499999999999999},"max":{"1min":13.481999999999999,"5min":13.481999999999999,"15min":13.481999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":2.2589999999999999,"5min":1.6619999999999999,"15min":1.4770000000000001},"min":{"1min":0.51500000000000001,"5min":0.44700000000000001,"15min":0.39600000000000002},"max":{"1min":7.992,"5min":9.9149999999999991,"15min":11.736000000000001},"last":0.63800000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":2.198,"5min":1.8440000000000001,"15min":1.71},"min":{"1min":0.50900000000000001,"5min":0.44,"15min":0.40100000000000002},"max":{"1min":11.721,"5min":12.382,"15min":12.382},"last":0.623},{"interface":"front","average":{"1min":3.1419999999999999,"5min":2.2280000000000002,"15min":1.9259999999999999},"min":{"1min":0.46100000000000002,"5min":0.44600000000000001,"15min":0.39300000000000002},"max":{"1min":12.007999999999999,"5min":12.007999999999999,"15min":13.673999999999999},"last":0.88700000000000001}]},{"osd":5,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.39200000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.1359999999999999,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.621,"15min":0.47399999999999998},"min":{"1min":0.29299999999999998,"5min":0.254,"15min":0.23899999999999999},"max":{"1min":11.664,"5min":12.446999999999999,"15min":12.446999999999999},"last":0.41399999999999998}]},{"osd":6,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.51400000000000001,"15min":0.45200000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":11.507999999999999,"5min":11.507999999999999,"15min":11.507999999999999},"last":0.436},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.53900000000000003,"15min":0.47999999999999998},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.29999999999999999},"max":{"1min":6.5119999999999996,"5min":6.5119999999999996,"15min":6.5119999999999996},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Nov 28 06:32:30 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.70499999999999996,"15min":0.52900000000000003},"min":{"1min":0.33600000000000002,"5min":0.314,"15min":0.27600000000000002},"max":{"1min":11.629,"5min":12.336,"15min":12.336},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.56299999999999994,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.312,"15min":0.28999999999999998},"max":{"1min":11.471,"5min":11.471,"15min":11.471},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834580485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1768044,"kb_used_data":420,"kb_used_omap":1855,"kb_used_meta":1765760,"kb_avail":92603796,"statfs":{"total":96636764160,"available":94826287104,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1899643,"internal_metadata":1808139141},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":3.544,"15min":3.3690000000000002},"min":{"1min":0.61099999999999999,"5min":0.56000000000000005,"15min":0.54100000000000004},"max":{"1min":29.311,"5min":29.311,"15min":29.311},"last":0.60799999999999998},{"interface":"front","average":{"1min":3.6379999999999999,"5min":3.5030000000000001,"15min":3.3599999999999999},"min":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.56299999999999994},"max":{"1min":20.762,"5min":21.399999999999999,"15min":21.399999999999999},"last":0.79500000000000004}]},{"osd":1,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.7090000000000001,"5min":4.0350000000000001,"15min":3.4969999999999999},"min":{"1min":0.625,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":11.140000000000001,"5min":20.879999999999999,"15min":20.879999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":4.9059999999999997,"5min":5.3449999999999998,"15min":4.2279999999999998},"min":{"1min":0.70699999999999996,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":29.452999999999999,"5min":48.625999999999998,"15min":48.625999999999998},"last":1.0980000000000001}]},{"osd":2,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":3.859,"5min":4.306,"15min":3.7650000000000001},"min":{"1min":0.93899999999999995,"5min":0.75,"15min":0.66600000000000004},"max":{"1min":25.378,"5min":33.497999999999998,"15min":33.497999999999998},"last":1.044},{"interface":"front","average":{"1min":3.3959999999999999,"5min":3.5259999999999998,"15min":3.4700000000000002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.65100000000000002},"max":{"1min":11.054,"5min":21.193000000000001,"15min":21.193000000000001},"last":1.147}]},{"osd":4,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.173,"5min":2.7949999999999999,"15min":2.7570000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.55900000000000005},"max":{"1min":9.6820000000000004,"5min":21.931999999999999,"15min":21.931999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":2.544,"5min":3.2669999999999999,"15min":2.839},"min":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.60599999999999998},"max":{"1min":10.705,"5min":21.013999999999999,"15min":21.013999999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.6560000000000001,"5min":3.5209999999999999,"15min":3.0129999999999999},"min":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.69499999999999995},"max":{"1min":10.881,"5min":21.344000000000001,"15min":21.344000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":2.2389999999999999,"5min":2.9769999999999999,"15min":2.8319999999999999},"min":{"1min":0.72799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":9.4179999999999993,"5min":21.631,"15min":21.631},"last":0.95699999999999996}]},{"osd":6,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":3.077,"15min":2.9769999999999999},"min":{"1min":0.84599999999999997,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":9.5670000000000002,"5min":21.792000000000002,"15min":21.792000000000002},"last":1.2250000000000001},{"interface":"front","average":{"1min":2.452,"5min":2.9940000000000002,"15min":2.9790000000000001},"min":{"1min":0.75,"5min":0.75,"15min":0.72199999999999998},"max":{"1min":9.7729999999999997,"5min":21.838999999999999,"15min":21.838999999999999},"last":1.2529999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:45 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":3.1309999999999998,"15min":3.0899999999999999},"min":{"1min":0.91600000000000004,"5min":0.89300000000000002,"15min":0.79700000000000004},"max":{"1min":9.8710000000000004,"5min":25.337,"15min":25.337},"last":1.3049999999999999},{"interface":"front","average":{"1min":2.8199999999999998,"5min":3.6779999999999999,"15min":3.246},"min":{"1min":0.94299999999999995,"5min":0.89200000000000002,"15min":0.80700000000000005},"max":{"1min":11.234,"5min":21.274000000000001,"15min":21.274000000000001},"last":1.278}]}]},{"osd":2,"up_from":13,"seq":55834580584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1083692,"kb_used_data":420,"kb_used_omap":591,"kb_used_meta":1082672,"kb_avail":93288148,"statfs":{"total":96636764160,"available":95527063552,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":605891,"internal_metadata":1108656445},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.6819999999999999,"5min":2.8530000000000002,"15min":2.8610000000000002},"min":{"1min":0.66200000000000003,"5min":0.58099999999999996,"15min":0.56200000000000006},"max":{"1min":7.4779999999999998,"5min":15.250999999999999,"15min":21.669},"last":0.69999999999999996},{"interface":"front","average":{"1min":4.1440000000000001,"5min":3.3460000000000001,"15min":3.1259999999999999},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":27.016999999999999,"5min":27.016999999999999,"15min":27.016999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3449999999999998,"5min":3.786,"15min":3.3029999999999999},"min":{"1min":0.76900000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":15.436999999999999,"5min":15.436999999999999,"15min":18.707000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":4.6319999999999997,"5min":3.98,"15min":3.4489999999999998},"min":{"1min":0.80400000000000005,"5min":0.64600000000000002,"15min":0.63400000000000001},"max":{"1min":22.309999999999999,"5min":22.309999999999999,"15min":22.309999999999999},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":3.2469999999999999,"15min":3.0299999999999998},"min":{"1min":1.149,"5min":0.71599999999999997,"15min":0.65800000000000003},"max":{"1min":13.811999999999999,"5min":16.957000000000001,"15min":17.643000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":5.327,"5min":4.1390000000000002,"15min":3.556},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82699999999999996},"max":{"1min":17.016999999999999,"5min":17.016999999999999,"15min":17.016999999999999},"last":1.0700000000000001}]},{"osd":4,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.431,"5min":2.5880000000000001,"15min":2.3719999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.59099999999999997},"max":{"1min":6.8479999999999999,"5min":11.452999999999999,"15min":13.121},"last":1.22},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.734,"15min":2.4510000000000001},"min":{"1min":0.66100000000000003,"5min":0.64000000000000001,"15min":0.58199999999999996},"max":{"1min":12.598000000000001,"5min":13.615,"15min":15.178000000000001},"last":1.101}]},{"osd":5,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3730000000000002,"5min":2.3490000000000002,"15min":2.0619999999999998},"min":{"1min":0.70999999999999996,"5min":0.65000000000000002,"15min":0.60399999999999998},"max":{"1min":21.841999999999999,"5min":21.841999999999999,"15min":21.841999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.7320000000000002,"15min":2.5219999999999998},"min":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":7.2169999999999996,"5min":11.573,"15min":13.02},"last":1.3400000000000001}]},{"osd":6,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":2.9249999999999998,"15min":2.6429999999999998},"min":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.68600000000000005},"max":{"1min":12.707000000000001,"5min":13.789999999999999,"15min":14.960000000000001},"last":0.998},{"interface":"front","average":{"1min":3.468,"5min":2.3940000000000001,"15min":2.2029999999999998},"min":{"1min":0.86099999999999999,"5min":0.745,"15min":0.71099999999999997},"max":{"1min":10.02,"5min":11.057,"15min":11.135},"last":1.3899999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:27 2023","interfaces":[{"interface":"back","average":{"1min":2.871,"5min":3.0019999999999998,"15min":2.7480000000000002},"min":{"1min":0.873,"5min":0.83699999999999997,"15min":0.78000000000000003},"max":{"1min":12.794,"5min":13.715999999999999,"15min":15.257999999999999},"last":1.262},{"interface":"front","average":{"1min":3.569,"5min":2.46,"15min":2.3570000000000002},"min":{"1min":0.98299999999999998,"5min":0.81699999999999995,"15min":0.78300000000000003},"max":{"1min":10.102,"5min":11.132999999999999,"15min":11.132999999999999},"last":1.2969999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1415788,"kb_used_data":420,"kb_used_omap":1951,"kb_used_meta":1413408,"kb_avail":92956052,"statfs":{"total":96636764160,"available":95186997248,"internally_reserved":0,"allocated":430080,"data_stored":170382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1997886,"internal_metadata":1447330754},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":3.1890000000000001,"15min":2.903},"min":{"1min":0.60899999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":6.6040000000000001,"5min":27.271999999999998,"15min":27.271999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":2.1499999999999999,"5min":3.3300000000000001,"15min":2.9409999999999998},"min":{"1min":0.68799999999999994,"5min":0.58299999999999996,"15min":0.53400000000000003},"max":{"1min":8.6950000000000003,"5min":33.43,"15min":33.43},"last":1.0940000000000001}]},{"osd":2,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":3.5939999999999999,"15min":3.2389999999999999},"min":{"1min":0.69199999999999995,"5min":0.66300000000000003,"15min":0.58599999999999997},"max":{"1min":14.554,"5min":18.050999999999998,"15min":18.050999999999998},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.607,"5min":3.9910000000000001,"15min":3.1760000000000002},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.65300000000000002},"max":{"1min":6.0149999999999997,"5min":26.978999999999999,"15min":26.978999999999999},"last":0.69499999999999995}]},{"osd":3,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":2.2610000000000001,"5min":4.0789999999999997,"15min":3.4020000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.69299999999999995},"max":{"1min":13.57,"5min":13.57,"15min":13.647},"last":0.94899999999999995},{"interface":"front","average":{"1min":2.2240000000000002,"5min":4.415,"15min":3.7080000000000002},"min":{"1min":0.83499999999999996,"5min":0.73199999999999998,"15min":0.65100000000000002},"max":{"1min":8.9710000000000001,"5min":33.329999999999998,"15min":33.329999999999998},"last":1.004}]},{"osd":4,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":1.9019999999999999,"5min":2.3929999999999998,"15min":2.25},"min":{"1min":0.76100000000000001,"5min":0.67700000000000005,"15min":0.58099999999999996},"max":{"1min":6.516,"5min":13.111000000000001,"15min":13.278},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.55,"5min":2.649,"15min":2.3740000000000001},"min":{"1min":0.69399999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":5.8330000000000002,"5min":10.628,"15min":12.055999999999999},"last":1.1499999999999999}]},{"osd":5,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":1.776,"5min":2.7410000000000001,"15min":2.5110000000000001},"min":{"1min":0.73299999999999998,"5min":0.68400000000000005,"15min":0.622},"max":{"1min":5.2880000000000003,"5min":13.535,"15min":13.535},"last":1.381},{"interface":"front","average":{"1min":2.0099999999999998,"5min":2.6280000000000001,"15min":2.423},"min":{"1min":0.93100000000000005,"5min":0.78500000000000003,"15min":0.71799999999999997},"max":{"1min":6.3479999999999999,"5min":18.117000000000001,"15min":18.117000000000001},"last":1.054}]},{"osd":6,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":1.879,"5min":2.8180000000000001,"15min":2.633},"min":{"1min":0.85399999999999998,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":5.3849999999999998,"5min":9.9719999999999995,"15min":9.9719999999999995},"last":1.4410000000000001},{"interface":"front","average":{"1min":2.1629999999999998,"5min":2.8079999999999998,"15min":2.6030000000000002},"min":{"1min":1.0369999999999999,"5min":0.875,"15min":0.80500000000000005},"max":{"1min":6.4429999999999996,"5min":27.998999999999999,"15min":27.998999999999999},"last":1.123}]},{"osd":7,"last update":"Tue Nov 28 06:33:20 2023","interfaces":[{"interface":"back","average":{"1min":1.8109999999999999,"5min":2.8490000000000002,"15min":2.5899999999999999},"min":{"1min":1.109,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":5.9359999999999999,"5min":10.736000000000001,"15min":12.144},"last":1.27},{"interface":"front","average":{"1min":1.986,"5min":2.8809999999999998,"15min":2.7570000000000001},"min":{"1min":0.92400000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":5.4640000000000004,"5min":10.055999999999999,"15min":10.077},"last":1.492}]}]},{"osd":0,"up_from":13,"seq":55834580624,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1540976,"kb_used_data":1000,"kb_used_omap":767,"kb_used_meta":1539200,"kb_avail":92830864,"statfs":{"total":96636764160,"available":95058804736,"internally_reserved":0,"allocated":1024000,"data_stored":760750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":786324,"internal_metadata":1576140908},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5230000000000001,"5min":3.1309999999999998,"15min":3.0510000000000002},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":9.4019999999999992,"5min":59.180999999999997,"15min":59.180999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":3.657,"5min":2.8799999999999999,"15min":2.9550000000000001},"min":{"1min":0.873,"5min":0.64500000000000002,"15min":0.54900000000000004},"max":{"1min":12.970000000000001,"5min":12.970000000000001,"15min":14.712999999999999},"last":0.98099999999999998}]},{"osd":2,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":3.6480000000000001,"15min":3.1459999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.55000000000000004},"max":{"1min":5.9009999999999998,"5min":80.992000000000004,"15min":80.992000000000004},"last":0.91600000000000004},{"interface":"front","average":{"1min":3.6339999999999999,"5min":3.5779999999999998,"15min":3.1389999999999998},"min":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.59299999999999997},"max":{"1min":12.484,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.75800000000000001}]},{"osd":3,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.9399999999999999,"5min":3.613,"15min":3.3540000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.5350000000000001,"5min":16.291,"15min":16.291},"last":1.1140000000000001},{"interface":"front","average":{"1min":3.7050000000000001,"5min":5.0620000000000003,"15min":3.9990000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":12.747999999999999,"5min":80.918000000000006,"15min":80.918000000000006},"last":1.1859999999999999}]},{"osd":4,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.218,"5min":1.982,"15min":1.8380000000000001},"min":{"1min":0.67200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":12.039999999999999,"5min":14.657,"15min":14.657},"last":0.879},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.8849999999999998,"15min":2.4710000000000001},"min":{"1min":0.82699999999999996,"5min":0.65600000000000003,"15min":0.61599999999999999},"max":{"1min":5.5949999999999998,"5min":80.745000000000005,"15min":80.745000000000005},"last":1.069}]},{"osd":5,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.5150000000000001,"5min":2.5099999999999998,"15min":2.2949999999999999},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.626},"max":{"1min":6.3369999999999997,"5min":15.202999999999999,"15min":15.202999999999999},"last":1.242},{"interface":"front","average":{"1min":2.415,"5min":2.1930000000000001,"15min":2.0419999999999998},"min":{"1min":0.93600000000000005,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":11.775,"5min":14.800000000000001,"15min":14.800000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.4849999999999999,"5min":2.2829999999999999,"15min":2.149},"min":{"1min":1.0129999999999999,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":11.959,"5min":14.917,"15min":14.917},"last":1.2869999999999999},{"interface":"front","average":{"1min":2.177,"5min":3.0350000000000001,"15min":2.6930000000000001},"min":{"1min":1.0069999999999999,"5min":0.82199999999999995,"15min":0.72399999999999998},"max":{"1min":5.8090000000000002,"5min":80.840000000000003,"15min":80.840000000000003},"last":1.5149999999999999}]},{"osd":7,"last update":"Tue Nov 28 06:32:46 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":2.657,"15min":2.4700000000000002},"min":{"1min":1.0740000000000001,"5min":0.90600000000000003,"15min":0.72099999999999997},"max":{"1min":6.444,"5min":15.118,"15min":15.118},"last":1.341},{"interface":"front","average":{"1min":2.5670000000000002,"5min":2.395,"15min":2.262},"min":{"1min":1.0549999999999999,"5min":0.88,"15min":0.88},"max":{"1min":11.880000000000001,"5min":15.396000000000001,"15min":15.396000000000001},"last":1.151}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T06:33:29.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T06:33:29.852 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.851+0000 7fb784256640 1 Processor -- start 2023-11-28T06:33:29.853 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.852+0000 7fb784256640 1 -- start start 2023-11-28T06:33:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb784256640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb77c15d2e0 0x7fb77c0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb784256640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb77c06bbd0 0x7fb77c0d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb784256640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c06ce00 con 0x7fb77c15d6c0 2023-11-28T06:33:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb784256640 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c06c1f0 con 0x7fb77c15d2e0 2023-11-28T06:33:29.855 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb784256640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c06c4d0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb781ff2640 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb77c15d2e0 0x7fb77c0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb7827f3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb77c06bbd0 0x7fb77c0d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.857 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb7817f1640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb77c15d6c0 0x7fb77c06b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:56078/0 (socket says 172.21.15.154:56078) 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb7827f3640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb77c06bbd0 0x7fb77c0d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:49718/0 (socket says 172.21.15.154:49718) 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.854+0000 7fb7817f1640 1 -- 172.21.15.154:0/1118833938 learned_addr learned my addr 172.21.15.154:0/1118833938 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.855+0000 7fb7827f3640 1 -- 172.21.15.154:0/1118833938 >> v2:172.21.15.154:3300/0 conn(0x7fb77c15d2e0 msgr2=0x7fb77c0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.855+0000 7fb7827f3640 1 --2- 172.21.15.154:0/1118833938 >> v2:172.21.15.154:3300/0 conn(0x7fb77c15d2e0 0x7fb77c0d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.855+0000 7fb7827f3640 1 -- 172.21.15.154:0/1118833938 >> v1:172.21.15.194:6789/0 conn(0x7fb77c15d6c0 legacy=0x7fb77c06b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.855+0000 7fb780ff0640 1 -- 172.21.15.154:0/1118833938 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030706191 0 0) 0x7fb77c06ce00 con 0x7fb77c15d6c0 2023-11-28T06:33:29.858 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.855+0000 7fb7827f3640 1 -- 172.21.15.154:0/1118833938 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c06c7b0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.858+0000 7fb7827f3640 1 --2- 172.21.15.154:0/1118833938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1b80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb77c06cd70 tx=0x7fb77402be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2032f18ae05455dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:29.859 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.858+0000 7fb780ff0640 1 -- 172.21.15.154:0/1118833938 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77402cbf0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.859+0000 7fb780ff0640 1 -- 172.21.15.154:0/1118833938 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77402cd50 con 0x7fb77c06bbd0 2023-11-28T06:33:29.860 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.859+0000 7fb780ff0640 1 -- 172.21.15.154:0/1118833938 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774034660 con 0x7fb77c06bbd0 2023-11-28T06:33:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 -- 172.21.15.154:0/1118833938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c06bbd0 msgr2=0x7fb77c0d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 --2- 172.21.15.154:0/1118833938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1b80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb77c06cd70 tx=0x7fb77402be40 comp rx=0 tx=0).stop 2023-11-28T06:33:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 -- 172.21.15.154:0/1118833938 shutdown_connections 2023-11-28T06:33:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 --2- 172.21.15.154:0/1118833938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1b80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.861 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 --2- 172.21.15.154:0/1118833938 >> v2:172.21.15.154:3300/0 conn(0x7fb77c15d2e0 0x7fb77c0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 -- 172.21.15.154:0/1118833938 >> 172.21.15.154:0/1118833938 conn(0x7fb77c09c580 msgr2=0x7fb77c0d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 -- 172.21.15.154:0/1118833938 shutdown_connections 2023-11-28T06:33:29.862 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.860+0000 7fb784256640 1 -- 172.21.15.154:0/1118833938 wait complete. 2023-11-28T06:33:29.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.864+0000 7fb784256640 1 Processor -- start 2023-11-28T06:33:29.866 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.864+0000 7fb784256640 1 -- start start 2023-11-28T06:33:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb784256640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb784256640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c15d2e0 0x7fb77c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.867 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb784256640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77c15d6c0 0x7fb77c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb784256640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0d1ff0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb784256640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0c62f0 con 0x7fb77c15d2e0 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb784256640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0c7100 con 0x7fb77c15d6c0 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb781ff2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb781ff2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37346/0 (socket says 172.21.15.154:37346) 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb781ff2640 1 -- 172.21.15.154:0/1967074786 learned_addr learned my addr 172.21.15.154:0/1967074786 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb7817f1640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c15d2e0 0x7fb77c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.868 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.866+0000 7fb7827f3640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77c15d6c0 0x7fb77c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb781ff2640 1 -- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77c15d6c0 msgr2=0x7fb77c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb781ff2640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77c15d6c0 0x7fb77c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb781ff2640 1 -- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c15d2e0 msgr2=0x7fb77c0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb781ff2640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c15d2e0 0x7fb77c0c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:29.870 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb781ff2640 1 -- 172.21.15.154:0/1967074786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009a70 con 0x7fb77c06bbd0 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb7827f3640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77c15d6c0 0x7fb77c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb7817f1640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c15d2e0 0x7fb77c0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.867+0000 7fb781ff2640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1ab0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e9b0 tx=0x7fb77800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.868+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778009670 con 0x7fb77c06bbd0 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.868+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800c9a0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.868+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800cd50 con 0x7fb77c06bbd0 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.868+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c0c73e0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.871 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.868+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c0c79a0 con 0x7fb77c06bbd0 2023-11-28T06:33:29.872 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.871+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c067420 con 0x7fb77c06bbd0 2023-11-28T06:33:29.873 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.872+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb778013470 con 0x7fb77c06bbd0 2023-11-28T06:33:29.874 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.873+0000 7fb7727fc640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb76006b1c0 0x7fb76006d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:29.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.874+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb778089890 con 0x7fb77c06bbd0 2023-11-28T06:33:29.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.874+0000 7fb7817f1640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb76006b1c0 0x7fb76006d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:29.875 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.875+0000 7fb7817f1640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb76006b1c0 0x7fb76006d680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb77c15b050 tx=0x7fb76c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:29.888 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:29.887+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb778054a00 con 0x7fb77c06bbd0 2023-11-28T06:33:30.412 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.411+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb77c0b5ad0 con 0x7fb77c06bbd0 2023-11-28T06:33:30.419 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.418+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb7780170c0 con 0x7fb77c06bbd0 2023-11-28T06:33:30.421 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.420+0000 7fb7727fc640 1 -- 172.21.15.154:0/1967074786 <== mon.0 v2:172.21.15.154:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb778054a00 con 0x7fb77c06bbd0 2023-11-28T06:33:30.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb76006b1c0 msgr2=0x7fb76006d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:30.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb76006b1c0 0x7fb76006d680 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb77c15b050 tx=0x7fb76c007de0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.424 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 msgr2=0x7fb77c0d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1ab0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e9b0 tx=0x7fb77800ee70 comp rx=0 tx=0).stop 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 shutdown_connections 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb77c15d2e0 0x7fb77c0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb76006b1c0 0x7fb76006d680 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77c15d6c0 0x7fb77c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 --2- 172.21.15.154:0/1967074786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb77c06bbd0 0x7fb77c0d1ab0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.425 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.423+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 >> 172.21.15.154:0/1967074786 conn(0x7fb77c09c580 msgr2=0x7fb77c0cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:30.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.424+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 shutdown_connections 2023-11-28T06:33:30.426 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.424+0000 7fb784256640 1 -- 172.21.15.154:0/1967074786 wait complete. 2023-11-28T06:33:30.452 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T06:33:30.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T06:33:30.740 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.739+0000 7fb91d92d640 1 Processor -- start 2023-11-28T06:33:30.741 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.740+0000 7fb91d92d640 1 -- start start 2023-11-28T06:33:30.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.743+0000 7fb91d92d640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb91815d330 0x7fb9180b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:30.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.743+0000 7fb91d92d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:30.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.743+0000 7fb91d92d640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9180b2b10 con 0x7fb9180d2910 2023-11-28T06:33:30.744 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.743+0000 7fb91d92d640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180d1590 con 0x7fb91815d330 2023-11-28T06:33:30.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.743+0000 7fb91d92d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180d1870 con 0x7fb9180d3900 2023-11-28T06:33:30.745 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9177fe640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb916ffd640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb91815d330 0x7fb9180b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9167fc640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fb9180d2910 0x7fb9180d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.154:56090/0 (socket says 172.21.15.154:56090) 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9167fc640 1 -- 172.21.15.154:0/245348437 learned_addr learned my addr 172.21.15.154:0/245348437 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb915ffb640 1 -- 172.21.15.154:0/245348437 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839413015 0 0) 0x7fb9180b2b10 con 0x7fb9180d2910 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9177fe640 1 -- 172.21.15.154:0/245348437 >> v2:172.21.15.194:3300/0 conn(0x7fb91815d330 msgr2=0x7fb9180b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9177fe640 1 --2- 172.21.15.154:0/245348437 >> v2:172.21.15.194:3300/0 conn(0x7fb91815d330 0x7fb9180b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9177fe640 1 -- 172.21.15.154:0/245348437 >> v1:172.21.15.194:6789/0 conn(0x7fb9180d2910 legacy=0x7fb9180d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb9177fe640 1 -- 172.21.15.154:0/245348437 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9180d1b50 con 0x7fb9180d3900 2023-11-28T06:33:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.744+0000 7fb916ffd640 1 --2- 172.21.15.154:0/245348437 >> v2:172.21.15.194:3300/0 conn(0x7fb91815d330 0x7fb9180b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:30.747 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.746+0000 7fb9177fe640 1 --2- 172.21.15.154:0/245348437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180b6390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb910009d90 tx=0x7fb91002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3148d44003aad05a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.747+0000 7fb915ffb640 1 -- 172.21.15.154:0/245348437 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91002cbd0 con 0x7fb9180d3900 2023-11-28T06:33:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.747+0000 7fb915ffb640 1 -- 172.21.15.154:0/245348437 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb91002cd30 con 0x7fb9180d3900 2023-11-28T06:33:30.748 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.747+0000 7fb915ffb640 1 -- 172.21.15.154:0/245348437 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91002cea0 con 0x7fb9180d3900 2023-11-28T06:33:30.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 -- 172.21.15.154:0/245348437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 msgr2=0x7fb9180b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:30.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 --2- 172.21.15.154:0/245348437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180b6390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb910009d90 tx=0x7fb91002be20 comp rx=0 tx=0).stop 2023-11-28T06:33:30.749 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 -- 172.21.15.154:0/245348437 shutdown_connections 2023-11-28T06:33:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 --2- 172.21.15.154:0/245348437 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180b6390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 --2- 172.21.15.154:0/245348437 >> v2:172.21.15.194:3300/0 conn(0x7fb91815d330 0x7fb9180b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 -- 172.21.15.154:0/245348437 >> 172.21.15.154:0/245348437 conn(0x7fb918072020 msgr2=0x7fb918072430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 -- 172.21.15.154:0/245348437 shutdown_connections 2023-11-28T06:33:30.750 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.748+0000 7fb91d92d640 1 -- 172.21.15.154:0/245348437 wait complete. 2023-11-28T06:33:30.752 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.752+0000 7fb91d92d640 1 Processor -- start 2023-11-28T06:33:30.753 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.752+0000 7fb91d92d640 1 -- start start 2023-11-28T06:33:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.754+0000 7fb91d92d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9180d2910 0x7fb9180c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.754+0000 7fb91d92d640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.754+0000 7fb91d92d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 0x7fb9181f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.754+0000 7fb91d92d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c7120 con 0x7fb9180d2910 2023-11-28T06:33:30.758 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.754+0000 7fb91d92d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c8c30 con 0x7fb91815d330 2023-11-28T06:33:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.754+0000 7fb91d92d640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9180c8f10 con 0x7fb9180d3900 2023-11-28T06:33:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb916ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9180d2910 0x7fb9180c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9167fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 0x7fb9181f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:30.759 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb916ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9180d2910 0x7fb9180c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:37348/0 (socket says 172.21.15.154:37348) 2023-11-28T06:33:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 0x7fb9181f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.154:49736/0 (socket says 172.21.15.154:49736) 2023-11-28T06:33:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb916ffd640 1 -- 172.21.15.154:0/2075679584 learned_addr learned my addr 172.21.15.154:0/2075679584 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-11-28T06:33:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9167fc640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.154:46548/0 (socket says 172.21.15.154:46548) 2023-11-28T06:33:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 -- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 msgr2=0x7fb9180c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:30.760 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 -- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9180d2910 msgr2=0x7fb9180c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9180d2910 0x7fb9180c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9177fe640 1 -- 172.21.15.154:0/2075679584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb908009400 con 0x7fb91815d330 2023-11-28T06:33:30.761 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.755+0000 7fb9167fc640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T06:33:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.756+0000 7fb9177fe640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 0x7fb9181f5820 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb910033000 tx=0x7fb910004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.756+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91002cea0 con 0x7fb91815d330 2023-11-28T06:33:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.756+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb910040650 con 0x7fb91815d330 2023-11-28T06:33:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.756+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910040a00 con 0x7fb91815d330 2023-11-28T06:33:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.756+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb910009a70 con 0x7fb91815d330 2023-11-28T06:33:30.762 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.756+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9180c94d0 con 0x7fb91815d330 2023-11-28T06:33:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.759+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918069400 con 0x7fb91815d330 2023-11-28T06:33:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.759+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89370+0+0 (secure 0 0 0) 0x7fb910040b60 con 0x7fb91815d330 2023-11-28T06:33:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.760+0000 7fb8fffff640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb90406b1c0 0x7fb90406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T06:33:30.763 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.760+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb9100ac2c0 con 0x7fb91815d330 2023-11-28T06:33:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.760+0000 7fb916ffd640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb90406b1c0 0x7fb90406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T06:33:30.764 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.761+0000 7fb916ffd640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb90406b1c0 0x7fb90406d680 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb908009d30 tx=0x7fb908009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T06:33:30.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:30.765+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179831 (secure 0 0 0) 0x7fb9100774b0 con 0x7fb91815d330 2023-11-28T06:33:31.401 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.400+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9181f5d60 con 0x7fb91815d330 2023-11-28T06:33:31.402 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.401+0000 7fb8fffff640 1 -- 172.21.15.154:0/2075679584 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fb91007aad0 con 0x7fb91815d330 2023-11-28T06:33:31.403 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-11-28T06:33:31.403 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3571748561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3571748561},{"type":"v1","addr":"172.21.15.194:6834","nonce":3571748561}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5062,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6836/3133142386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":3133142386},{"type":"v1","addr":"172.21.15.154:6836","nonce":3133142386}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/256186830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":256186830},{"type":"v1","addr":"172.21.15.194:6835","nonce":256186830}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":8989,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2417277555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6835","nonce":2417277555},{"type":"v1","addr":"172.21.15.154:6837","nonce":2417277555}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":14}],"filesystems":[]} 2023-11-28T06:33:31.403 INFO:teuthology.orchestra.run.smithi154.stderr:dumped fsmap epoch 15 2023-11-28T06:33:31.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb90406b1c0 msgr2=0x7fb90406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:31.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb90406b1c0 0x7fb90406d680 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb908009d30 tx=0x7fb908009190 comp rx=0 tx=0).stop 2023-11-28T06:33:31.408 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 msgr2=0x7fb9181f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 0x7fb9181f5820 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb910033000 tx=0x7fb910004a40 comp rx=0 tx=0).stop 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 shutdown_connections 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb91815d330 0x7fb9181f5820 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:6832/359126469,v1:172.21.15.154:6833/359126469] conn(0x7fb90406b1c0 0x7fb90406d680 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9180d3900 0x7fb9180c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 --2- 172.21.15.154:0/2075679584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9180d2910 0x7fb9180c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 >> 172.21.15.154:0/2075679584 conn(0x7fb918072020 msgr2=0x7fb9180d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T06:33:31.409 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 shutdown_connections 2023-11-28T06:33:31.410 INFO:teuthology.orchestra.run.smithi154.stderr:2023-11-28T06:33:31.407+0000 7fb91d92d640 1 -- 172.21.15.154:0/2075679584 wait complete. 2023-11-28T06:33:31.435 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T06:33:31.435 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T06:33:31.436 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T06:33:31.436 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:31.458 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T06:33:31.458 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T06:33:31.459 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:31.519 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T06:33:31.520 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T06:33:31.520 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:31.533 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T06:33:31.534 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T06:33:31.534 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:31.585 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T06:33:31.586 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T06:33:31.586 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T06:33:31.586 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:33.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-28T06:33:37.688 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T06:33:37.688 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T06:33:37.688 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:39.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-28T06:33:39.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-28T06:33:43.790 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T06:33:43.791 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T06:33:43.791 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:45.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-28T06:33:45.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-28T06:33:49.892 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T06:33:49.893 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T06:33:49.894 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:51.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-28T06:33:51.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-28T06:33:55.996 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T06:33:55.996 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T06:33:55.996 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:33:57.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-28T06:33:57.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-28T06:34:02.098 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T06:34:02.099 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T06:34:02.099 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:02.187 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T06:34:02.188 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T06:34:02.188 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:02.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-28T06:34:02.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-28T06:34:08.290 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T06:34:08.290 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T06:34:08.290 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:08.372 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T06:34:08.372 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T06:34:08.373 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T06:34:08.373 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:08.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2023-11-28T06:34:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-11-28T06:34:13.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-28T06:34:14.475 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T06:34:14.475 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T06:34:14.475 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:14.508 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T06:34:14.508 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T06:34:14.508 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T06:34:14.508 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:14.572 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T06:34:14.572 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T06:34:14.572 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:14.597 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T06:34:14.598 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T06:34:14.598 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T06:34:14.662 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T06:34:14.662 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T06:34:14.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-28T06:34:14.807 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T06:34:14.807 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T06:34:15.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T06:34:15.307 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T06:34:15.516 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T06:34:15.517 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T06:34:15.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T06:34:15.719 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T06:34:15.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T06:34:15.939 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T06:34:16.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T06:34:16.172 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T06:34:16.311 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T06:34:16.311 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T06:34:16.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T06:34:16.412 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T06:34:16.528 INFO:tasks.ceph:Archiving mon data... 2023-11-28T06:34:16.529 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/data/mon.a.tgz 2023-11-28T06:34:16.530 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-11-28T06:34:16.586 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.zUaMnQ5npi 2023-11-28T06:34:16.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zUaMnQ5npi 2023-11-28T06:34:16.910 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.zUaMnQ5npi 2023-11-28T06:34:17.049 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.zUaMnQ5npi is 550KB 2023-11-28T06:34:17.147 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.zUaMnQ5npi 2023-11-28T06:34:17.185 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/data/mon.b.tgz 2023-11-28T06:34:17.185 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-11-28T06:34:17.212 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.vjS26nC78c 2023-11-28T06:34:17.212 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vjS26nC78c 2023-11-28T06:34:17.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.vjS26nC78c 2023-11-28T06:34:17.472 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.vjS26nC78c is 556KB 2023-11-28T06:34:17.572 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.vjS26nC78c 2023-11-28T06:34:17.592 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/data/mon.c.tgz 2023-11-28T06:34:17.592 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2023-11-28T06:34:17.646 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Cei1qcf7ed 2023-11-28T06:34:17.646 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Cei1qcf7ed 2023-11-28T06:34:17.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Cei1qcf7ed 2023-11-28T06:34:17.876 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Cei1qcf7ed is 556KB 2023-11-28T06:34:17.976 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Cei1qcf7ed 2023-11-28T06:34:17.990 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T06:34:17.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T06:34:17.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T06:34:18.095 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T06:34:18.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T06:34:18.099 DEBUG:teuthology.orchestra.run.smithi194:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T06:34:18.136 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T06:34:18.175 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T06:34:18.187 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T06:34:18.189 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/remote/smithi154/crash 2023-11-28T06:34:18.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T06:34:18.260 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/remote/smithi194/crash 2023-11-28T06:34:18.261 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T06:34:18.288 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T06:34:18.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-11-28T06:35:32.547 INFO:teuthology.orchestra.run.smithi154.stderr:ceph-osd: no process found 2023-11-28T06:41:25.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T06:41:25.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T06:41:25.399 INFO:tasks.ceph:Compressing logs... 2023-11-28T06:41:25.400 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T06:41:25.403 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-28T06:41:25.442 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-28T06:41:25.442 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88796.log 2023-11-28T06:41:25.444 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89076.log 2023-11-28T06:41:25.444 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.88796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89036.log 2023-11-28T06:41:25.444 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.89076.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T06:41:25.448 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.89036.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-28T06:41:25.448 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95475.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.95923.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.1.95475.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.3.95923.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88876.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88956.log 2023-11-28T06:41:25.449 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.88876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88836.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.88956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88996.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.88836.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.88996.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88916.log 2023-11-28T06:41:25.450 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-28T06:41:25.467 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.88916.log: /var/log/ceph/ceph-mon.c.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88796.log.gz 2023-11-28T06:41:25.468 INFO:teuthology.orchestra.run.smithi194.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.88836.log.gz 2023-11-28T06:41:25.469 INFO:teuthology.orchestra.run.smithi194.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.88876.log.gz 2023-11-28T06:41:25.487 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504187.log 2023-11-28T06:41:25.488 INFO:teuthology.orchestra.run.smithi194.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.88916.log.gz 2023-11-28T06:41:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196560.log 2023-11-28T06:41:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248520.log 2023-11-28T06:41:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103124.log 2023-11-28T06:41:25.490 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211526.log 2023-11-28T06:41:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241321.log 2023-11-28T06:41:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578258.log 2023-11-28T06:41:25.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445291.log 2023-11-28T06:41:25.492 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169936.log 2023-11-28T06:41:25.493 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96549.log 2023-11-28T06:41:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279139.log 2023-11-28T06:41:25.494 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452672.log 2023-11-28T06:41:25.495 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473652.log 2023-11-28T06:41:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263626.log 2023-11-28T06:41:25.496 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508034.log 2023-11-28T06:41:25.497 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439419.log 2023-11-28T06:41:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580112.log 2023-11-28T06:41:25.498 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301765.log 2023-11-28T06:41:25.499 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481955.log 2023-11-28T06:41:25.500 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96901.log 2023-11-28T06:41:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196560.log: /var/log/ceph/ceph-client.admin.504187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666982.log 2023-11-28T06:41:25.501 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470140.log 2023-11-28T06:41:25.502 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187883.log 2023-11-28T06:41:25.503 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96230.log 2023-11-28T06:41:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213382.log 2023-11-28T06:41:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.578258.log: /var/log/ceph/ceph-client.admin.301765.log: /var/log/ceph/ceph-client.admin.580112.log: /var/log/ceph/ceph-client.admin.103124.log: /var/log/ceph/ceph-client.admin.169936.log: /var/log/ceph/ceph-client.admin.445291.log: /var/log/ceph/ceph-client.admin.481955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97183.log 2023-11-28T06:41:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.452672.log: /var/log/ceph/ceph-client.admin.96549.log: /var/log/ceph/ceph-client.admin.473652.log: /var/log/ceph/ceph-client.admin.439419.log: /var/log/ceph/ceph-client.admin.508034.log: /var/log/ceph/ceph-client.admin.263626.log: /var/log/ceph/ceph-client.admin.279139.log: /var/log/ceph/ceph-client.admin.187883.log: /var/log/ceph/ceph-client.admin.96230.log: /var/log/ceph/ceph-client.admin.666982.log: /var/log/ceph/ceph-client.admin.211526.log: /var/log/ceph/ceph-client.admin.241321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635843.log 2023-11-28T06:41:25.507 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.248520.log: /var/log/ceph/ceph-client.admin.470140.log: /var/log/ceph/ceph-client.admin.96901.log: /var/log/ceph/ceph-client.admin.213382.log: /var/log/ceph/ceph-client.admin.97183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635009.log 2023-11-28T06:41:25.508 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.666982.log.gz 2023-11-28T06:41:25.508 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.635843.log: /var/log/ceph/ceph-client.admin.467409.log 2023-11-28T06:41:25.509 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.635009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267898.log 2023-11-28T06:41:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306031.log 2023-11-28T06:41:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.267898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88655.log 2023-11-28T06:41:25.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474972.log 2023-11-28T06:41:25.511 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.88655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301348.log 2023-11-28T06:41:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163902.log 2023-11-28T06:41:25.512 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.301348.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.184125.log 2023-11-28T06:41:25.513 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474069.log 2023-11-28T06:41:25.514 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234981.log 2023-11-28T06:41:25.514 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483736.log 2023-11-28T06:41:25.515 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666856.log 2023-11-28T06:41:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234981.log: /var/log/ceph/ceph-client.admin.483736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306876.log 2023-11-28T06:41:25.516 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95313.log 2023-11-28T06:41:25.517 INFO:teuthology.orchestra.run.smithi194.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.3.95923.log.gz 2023-11-28T06:41:25.517 INFO:teuthology.orchestra.run.smithi194.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.1.95475.log.gz 2023-11-28T06:41:25.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306876.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-28T06:41:25.520 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.666856.log.gz 2023-11-28T06:41:25.521 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615121.log 2023-11-28T06:41:25.521 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.439419.log.gz 2023-11-28T06:41:25.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95313.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204159.log 2023-11-28T06:41:25.521 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.615121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319167.log 2023-11-28T06:41:25.522 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.204159.log: /var/log/ceph/ceph-client.admin.635426.log 2023-11-28T06:41:25.522 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.481955.log.gz 2023-11-28T06:41:25.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330426.log 2023-11-28T06:41:25.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.635426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571275.log 2023-11-28T06:41:25.524 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88956.log.gz 2023-11-28T06:41:25.524 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88996.log.gz 2023-11-28T06:41:25.524 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89036.log.gz 2023-11-28T06:41:25.524 INFO:teuthology.orchestra.run.smithi194.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89076.log.gz 2023-11-28T06:41:25.526 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188732.log 2023-11-28T06:41:25.527 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666010.log 2023-11-28T06:41:25.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.571275.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.306031.log.gz 2023-11-28T06:41:25.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499265.log 2023-11-28T06:41:25.527 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100652.log 2023-11-28T06:41:25.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196147.log 2023-11-28T06:41:25.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483727.log 2023-11-28T06:41:25.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95881.log 2023-11-28T06:41:25.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278687.log 2023-11-28T06:41:25.528 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305196.log 2023-11-28T06:41:25.530 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89029.log 2023-11-28T06:41:25.530 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660752.log 2023-11-28T06:41:25.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524329.log 2023-11-28T06:41:25.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644960.log 2023-11-28T06:41:25.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537553.log 2023-11-28T06:41:25.531 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468683.log 2023-11-28T06:41:25.532 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273147.log 2023-11-28T06:41:25.533 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580103.log 2023-11-28T06:41:25.533 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178588.log 2023-11-28T06:41:25.534 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441523.log 2023-11-28T06:41:25.534 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556792.log 2023-11-28T06:41:25.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303939.log 2023-11-28T06:41:25.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103378.log 2023-11-28T06:41:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649852.log 2023-11-28T06:41:25.536 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282510.log 2023-11-28T06:41:25.537 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261446.log 2023-11-28T06:41:25.538 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317886.log 2023-11-28T06:41:25.538 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665674.log 2023-11-28T06:41:25.539 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200325.log 2023-11-28T06:41:25.540 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502338.log 2023-11-28T06:41:25.540 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460260.log 2023-11-28T06:41:25.541 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195283.log 2023-11-28T06:41:25.542 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189567.log 2023-11-28T06:41:25.542 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182041.log 2023-11-28T06:41:25.548 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277247.log 2023-11-28T06:41:25.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.660752.log: /var/log/ceph/ceph-client.admin.195283.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.163902.log.gz 2023-11-28T06:41:25.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.524329.log: 87.9%/var/log/ceph/ceph-client.admin.644960.log: -- replaced with /var/log/ceph/ceph-client.admin.666010.log.gz 2023-11-28T06:41:25.549 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182041.log: /var/log/ceph/ceph-client.admin.537553.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.660752.log.gz 2023-11-28T06:41:25.549 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.445291.log.gz 2023-11-28T06:41:25.550 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.184125.log.gz/var/log/ceph/ceph-client.admin.556792.log: 2023-11-28T06:41:25.550 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% 80.4% -- replaced with /var/log/ceph/ceph-client.admin.644960.log.gz 2023-11-28T06:41:25.550 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.580103.log: gzip -5/var/log/ceph/ceph-client.admin.649852.log: --verbose -- /var/log/ceph/ceph-client.admin.513147.log 2023-11-28T06:41:25.550 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.306876.log.gz 2023-11-28T06:41:25.550 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.483736.log.gz 2023-11-28T06:41:25.551 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%/var/log/ceph/ceph-client.admin.665674.log: -- replaced with /var/log/ceph/ceph-client.admin.267898.log.gz 2023-11-28T06:41:25.551 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.187883.log.gz 2023-11-28T06:41:25.551 INFO:teuthology.orchestra.run.smithi154.stderr: 77.3% 81.3% -- replaced with /var/log/ceph/ceph-client.admin.649852.log.gz 2023-11-28T06:41:25.551 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.635843.log.gz 2023-11-28T06:41:25.551 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.578258.log.gz 2023-11-28T06:41:25.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.277247.log: gzip/var/log/ceph/ceph-client.admin.278687.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.242203.log 2023-11-28T06:41:25.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.282510.log: 89.6%/var/log/ceph/ceph-client.admin.499265.log: -- replaced with /var/log/ceph/ceph-client.admin.635426.log.gz 2023-11-28T06:41:25.552 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2%/var/log/ceph/ceph-client.admin.468683.log: /var/log/ceph/ceph-client.admin.100652.log: -- replaced with /var/log/ceph/ceph-client.admin.665674.log.gz 2023-11-28T06:41:25.552 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196147.log: /var/log/ceph/ceph-client.admin.95881.log: /var/log/ceph/ceph-client.admin.305196.log: /var/log/ceph/ceph-client.admin.483727.log: /var/log/ceph/ceph-client.admin.89029.log: /var/log/ceph/ceph-client.admin.273147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512721.log 2023-11-28T06:41:25.553 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583567.log 2023-11-28T06:41:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592949.log 2023-11-28T06:41:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102548.log 2023-11-28T06:41:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320871.log 2023-11-28T06:41:25.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575888.log 2023-11-28T06:41:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103588.log 2023-11-28T06:41:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573689.log 2023-11-28T06:41:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440675.log 2023-11-28T06:41:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256025.log 2023-11-28T06:41:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521404.log 2023-11-28T06:41:25.556 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554958.log 2023-11-28T06:41:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299648.log 2023-11-28T06:41:25.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517972.log 2023-11-28T06:41:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471927.log 2023-11-28T06:41:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566376.log 2023-11-28T06:41:25.559 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279974.log 2023-11-28T06:41:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632496.log 2023-11-28T06:41:25.560 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665800.log 2023-11-28T06:41:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285900.log 2023-11-28T06:41:25.561 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540103.log 2023-11-28T06:41:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641853.log 2023-11-28T06:41:25.562 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261028.log 2023-11-28T06:41:25.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205038.log 2023-11-28T06:41:25.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94791.log 2023-11-28T06:41:25.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315801.log 2023-11-28T06:41:25.565 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184551.log 2023-11-28T06:41:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96228.log 2023-11-28T06:41:25.566 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304352.log 2023-11-28T06:41:25.567 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571266.log 2023-11-28T06:41:25.568 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290387.log 2023-11-28T06:41:25.568 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259780.log 2023-11-28T06:41:25.569 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456846.log 2023-11-28T06:41:25.570 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441936.log 2023-11-28T06:41:25.570 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100238.log 2023-11-28T06:41:25.571 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657684.log 2023-11-28T06:41:25.572 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455587.log 2023-11-28T06:41:25.572 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483286.log 2023-11-28T06:41:25.573 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307284.log 2023-11-28T06:41:25.574 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444462.log 2023-11-28T06:41:25.574 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543284.log 2023-11-28T06:41:25.575 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99101.log 2023-11-28T06:41:25.575 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320880.log 2023-11-28T06:41:25.576 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500148.log 2023-11-28T06:41:25.577 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525176.log 2023-11-28T06:41:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522659.log 2023-11-28T06:41:25.578 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212520.log 2023-11-28T06:41:25.591 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-28T06:41:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629580.log 2023-11-28T06:41:25.593 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441523.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.635009.log.gz 2023-11-28T06:41:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303939.log: /var/log/ceph/ceph-client.admin.103378.log: /var/log/ceph/ceph-client.admin.261446.log: 81.2%/var/log/ceph/ceph-client.admin.317886.log: -- replaced with /var/log/ceph/ceph-client.admin.211526.log.gz 2023-11-28T06:41:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.200325.log: /var/log/ceph/ceph-client.admin.189567.log: /var/log/ceph/ceph-client.admin.460260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277686.log 2023-11-28T06:41:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.502338.log: /var/log/ceph/ceph-client.admin.290387.log: /var/log/ceph/ceph-client.admin.441936.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.188732.log.gz 2023-11-28T06:41:25.594 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456846.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.196560.log.gz 2023-11-28T06:41:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100238.log: /var/log/ceph/ceph-client.admin.455587.log: /var/log/ceph/ceph-client.admin.629580.log: /var/log/ceph/ceph-client.admin.583567.log: /var/log/ceph/ceph-client.admin.592949.log: /var/log/ceph/ceph-client.admin.575888.log: 90.0%/var/log/ceph/ceph-client.admin.573689.log: -- replaced with /var/log/ceph/ceph-client.admin.234981.log.gz 2023-11-28T06:41:25.595 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.241321.log.gz 2023-11-28T06:41:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.521404.log: /var/log/ceph/ceph-client.admin.554958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169519.log 2023-11-28T06:41:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.517972.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.467409.log.gz 2023-11-28T06:41:25.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.566376.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.470140.log.gz 2023-11-28T06:41:25.596 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.632496.log: /var/log/ceph/ceph-client.admin.665800.log: 77.2% 77.1% -- replaced with /var/log/ceph/ceph-client.admin.474972.log.gz 2023-11-28T06:41:25.596 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%/var/log/ceph/ceph-client.admin.540103.log: -- replaced with /var/log/ceph/ceph-client.admin.473652.log.gz 2023-11-28T06:41:25.596 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.468683.log.gz 2023-11-28T06:41:25.596 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.641853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307715.log 2023-11-28T06:41:25.597 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.571266.log: 81.1%/var/log/ceph/ceph-client.admin.657684.log: -- replaced with /var/log/ceph/ceph-client.admin.248520.log.gz 88.0% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.665800.log.gz -- replaced with /var/log/ceph/ceph-client.admin.88655.log.gz 2023-11-28T06:41:25.597 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.597 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.597 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169519.log: /var/log/ceph/ceph-client.admin.543284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240496.log 80.9% 2023-11-28T06:41:25.598 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.452672.log.gz 2023-11-28T06:41:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.525176.log: /var/log/ceph/ceph-client.admin.522659.log: /var/log/ceph/ceph-client.admin.513147.log: /var/log/ceph/ceph-client.admin.299648.log: /var/log/ceph/ceph-client.admin.307284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570281.log 2023-11-28T06:41:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96228.log: /var/log/ceph/ceph-client.admin.242203.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.182041.log.gz 2023-11-28T06:41:25.598 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.279974.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.641853.log.gz 2023-11-28T06:41:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.315801.log: /var/log/ceph/ceph-client.admin.483286.log: /var/log/ceph/ceph-client.admin.471927.log: /var/log/ceph/ceph-client.admin.320880.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.261446.log.gz/var/log/ceph/ceph-client.admin.212520.log: 2023-11-28T06:41:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652446.log 2023-11-28T06:41:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.240496.log: /var/log/ceph/ceph-client.admin.512721.log: /var/log/ceph/ceph-client.admin.444462.log: 80.0%/var/log/ceph/ceph-client.admin.205038.log: -- replaced with /var/log/ceph/ceph-client.admin.263626.log.gz 2023-11-28T06:41:25.599 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.259780.log: /var/log/ceph/ceph-client.admin.102548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590008.log 2023-11-28T06:41:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320871.log: /var/log/ceph/ceph-client.admin.570281.log: /var/log/ceph/ceph-client.admin.103588.log: /var/log/ceph/ceph-client.admin.99101.log: /var/log/ceph/ceph-client.admin.440675.log: /var/log/ceph/ceph-client.admin.500148.log: /var/log/ceph/ceph-client.admin.256025.log: /var/log/ceph/ceph-client.admin.261028.log: /var/log/ceph/ceph-client.admin.652446.log: /var/log/ceph/ceph-client.admin.285900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203324.log 2023-11-28T06:41:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184551.log: /var/log/ceph/ceph-client.admin.94791.log: /var/log/ceph/ceph-client.admin.304352.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.652446.log.gz 2023-11-28T06:41:25.600 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.307715.log: /var/log/ceph/ceph-client.admin.277686.log: /var/log/ceph/ceph-client.admin.590008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568952.log 2023-11-28T06:41:25.600 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.615121.log.gz 2023-11-28T06:41:25.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203324.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.305196.log.gz 2023-11-28T06:41:25.601 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202024.log 2023-11-28T06:41:25.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.568952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100364.log 2023-11-28T06:41:25.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274402.log 2023-11-28T06:41:25.601 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.100364.log: --verbose -- /var/log/ceph/ceph-client.admin.472354.log 2023-11-28T06:41:25.602 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.657684.log.gz 2023-11-28T06:41:25.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.274402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295121.log 2023-11-28T06:41:25.602 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.204159.log.gz 2023-11-28T06:41:25.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665926.log 2023-11-28T06:41:25.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441945.log 2023-11-28T06:41:25.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.665926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565063.log 2023-11-28T06:41:25.611 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164329.log 2023-11-28T06:41:25.611 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.665926.log.gz 2023-11-28T06:41:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.565063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497498.log 2023-11-28T06:41:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582259.log 2023-11-28T06:41:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585337.log 2023-11-28T06:41:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.497498.log: /var/log/ceph/ceph-client.admin.582259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505489.log 2023-11-28T06:41:25.612 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.585337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666730.log 2023-11-28T06:41:25.613 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103294.log 2023-11-28T06:41:25.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.505489.log: /var/log/ceph/ceph-client.admin.666730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314124.log 2023-11-28T06:41:25.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253443.log 2023-11-28T06:41:25.613 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.666730.log.gz 2023-11-28T06:41:25.614 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654582.log 2023-11-28T06:41:25.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314124.log: /var/log/ceph/ceph-client.admin.253443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558578.log 2023-11-28T06:41:25.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.654582.log: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.502338.log.gz 2023-11-28T06:41:25.614 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529437.log 2023-11-28T06:41:25.615 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.654582.log.gz 2023-11-28T06:41:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.558578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472762.log 2023-11-28T06:41:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.529437.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.462769.log 2023-11-28T06:41:25.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566385.log 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.504187.log.gz 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.462769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161159.log 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487186.log 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665884.log 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291776.log 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667318.log 2023-11-28T06:41:25.616 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461098.log 2023-11-28T06:41:25.617 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239533.log 2023-11-28T06:41:25.617 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196138.log 2023-11-28T06:41:25.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295562.log 2023-11-28T06:41:25.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556300.log 2023-11-28T06:41:25.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321777.log 2023-11-28T06:41:25.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443193.log 2023-11-28T06:41:25.626 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585745.log 2023-11-28T06:41:25.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566794.log 2023-11-28T06:41:25.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201166.log 2023-11-28T06:41:25.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167022.log 2023-11-28T06:41:25.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97393.log 2023-11-28T06:41:25.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529015.log 2023-11-28T06:41:25.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267064.log 2023-11-28T06:41:25.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538813.log 2023-11-28T06:41:25.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662519.log 2023-11-28T06:41:25.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562792.log 2023-11-28T06:41:25.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238519.log 2023-11-28T06:41:25.628 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232332.log 2023-11-28T06:41:25.629 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544126.log 2023-11-28T06:41:25.629 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95229.log 2023-11-28T06:41:25.629 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95102.log 2023-11-28T06:41:25.632 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177336.log 2023-11-28T06:41:25.632 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101288.log 2023-11-28T06:41:25.632 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497489.log 2023-11-28T06:41:25.632 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95271.log 2023-11-28T06:41:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298121.log 2023-11-28T06:41:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101246.log 2023-11-28T06:41:25.633 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599992.log 2023-11-28T06:41:25.634 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518403.log 2023-11-28T06:41:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552433.log 2023-11-28T06:41:25.637 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581423.log 2023-11-28T06:41:25.640 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316218.log 2023-11-28T06:41:25.640 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162499.log 2023-11-28T06:41:25.640 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542216.log 2023-11-28T06:41:25.641 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641844.log 2023-11-28T06:41:25.641 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237159.log 2023-11-28T06:41:25.641 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98865.log 2023-11-28T06:41:25.641 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575405.log 2023-11-28T06:41:25.642 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634583.log 2023-11-28T06:41:25.642 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503761.log 2023-11-28T06:41:25.643 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637930.log 2023-11-28T06:41:25.643 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600415.log 2023-11-28T06:41:25.643 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161150.log 2023-11-28T06:41:25.644 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263179.log 2023-11-28T06:41:25.645 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540094.log 2023-11-28T06:41:25.645 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606687.log 2023-11-28T06:41:25.646 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292185.log 2023-11-28T06:41:25.647 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101020.log 2023-11-28T06:41:25.647 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320044.log 2023-11-28T06:41:25.648 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177345.log 2023-11-28T06:41:25.650 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292637.log 2023-11-28T06:41:25.651 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598701.log 2023-11-28T06:41:25.651 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100012.log 2023-11-28T06:41:25.652 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436914.log 2023-11-28T06:41:25.653 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103630.log 2023-11-28T06:41:25.653 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295130.log 2023-11-28T06:41:25.654 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599129.log 2023-11-28T06:41:25.655 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499685.log 2023-11-28T06:41:25.655 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201603.log 2023-11-28T06:41:25.656 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666688.log 2023-11-28T06:41:25.656 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522668.log 2023-11-28T06:41:25.657 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211943.log 2023-11-28T06:41:25.658 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100694.log 2023-11-28T06:41:25.659 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659452.log 2023-11-28T06:41:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554101.log 2023-11-28T06:41:25.660 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318720.log 2023-11-28T06:41:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440258.log 2023-11-28T06:41:25.661 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587431.log 2023-11-28T06:41:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232807.log 2023-11-28T06:41:25.662 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199846.log 2023-11-28T06:41:25.664 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96902.log 2023-11-28T06:41:25.664 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173966.log 2023-11-28T06:41:25.665 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102007.log 2023-11-28T06:41:25.666 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238095.log 2023-11-28T06:41:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291349.log 2023-11-28T06:41:25.667 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182883.log 2023-11-28T06:41:25.668 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507156.log 2023-11-28T06:41:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456429.log 2023-11-28T06:41:25.669 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96049.log 2023-11-28T06:41:25.670 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244093.log 2023-11-28T06:41:25.671 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256859.log 2023-11-28T06:41:25.672 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97603.log 2023-11-28T06:41:25.672 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585328.log 2023-11-28T06:41:25.673 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541357.log 2023-11-28T06:41:25.674 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308124.log 2023-11-28T06:41:25.675 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188311.log 2023-11-28T06:41:25.675 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556783.log 2023-11-28T06:41:25.676 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504627.log 2023-11-28T06:41:25.677 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191383.log 2023-11-28T06:41:25.677 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240904.log 2023-11-28T06:41:25.678 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185793.log 2023-11-28T06:41:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565054.log 2023-11-28T06:41:25.679 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560286.log 2023-11-28T06:41:25.680 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579685.log 2023-11-28T06:41:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501848.log 2023-11-28T06:41:25.681 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467817.log 2023-11-28T06:41:25.682 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523076.log 2023-11-28T06:41:25.683 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658572.log 2023-11-28T06:41:25.684 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101534.log 2023-11-28T06:41:25.684 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260190.log 2023-11-28T06:41:25.685 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525167.log 2023-11-28T06:41:25.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639658.log 2023-11-28T06:41:25.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666239.log 2023-11-28T06:41:25.687 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300512.log 2023-11-28T06:41:25.688 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478771.log 2023-11-28T06:41:25.688 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443618.log 2023-11-28T06:41:25.689 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205961.log 2023-11-28T06:41:25.690 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99287.log 2023-11-28T06:41:25.690 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229336.log 2023-11-28T06:41:25.691 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636253.log 2023-11-28T06:41:25.692 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437326.log 2023-11-28T06:41:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648772.log 2023-11-28T06:41:25.693 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599983.log 2023-11-28T06:41:25.694 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629154.log 2023-11-28T06:41:25.694 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254349.log 2023-11-28T06:41:25.695 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655914.log 2023-11-28T06:41:25.696 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312046.log 2023-11-28T06:41:25.696 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97832.log 2023-11-28T06:41:25.697 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452246.log 2023-11-28T06:41:25.698 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663901.log 2023-11-28T06:41:25.698 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569381.log 2023-11-28T06:41:25.699 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574954.log 2023-11-28T06:41:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505897.log 2023-11-28T06:41:25.700 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519703.log 2023-11-28T06:41:25.701 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256016.log 2023-11-28T06:41:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577698.log 2023-11-28T06:41:25.702 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278678.log 2023-11-28T06:41:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475824.log 2023-11-28T06:41:25.703 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190038.log 2023-11-28T06:41:25.704 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177754.log 2023-11-28T06:41:25.705 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249858.log 2023-11-28T06:41:25.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656353.log 2023-11-28T06:41:25.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95629.log 2023-11-28T06:41:25.707 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516277.log 2023-11-28T06:41:25.708 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665195.log 2023-11-28T06:41:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665716.log 2023-11-28T06:41:25.709 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646335.log 2023-11-28T06:41:25.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464033.log 2023-11-28T06:41:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665842.log 2023-11-28T06:41:25.711 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561126.log 2023-11-28T06:41:25.712 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596384.log 2023-11-28T06:41:25.713 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634166.log 2023-11-28T06:41:25.713 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267472.log 2023-11-28T06:41:25.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659002.log 2023-11-28T06:41:25.715 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309399.log 2023-11-28T06:41:25.716 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592958.log 2023-11-28T06:41:25.716 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248529.log 2023-11-28T06:41:25.717 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236282.log 2023-11-28T06:41:25.718 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273564.log 2023-11-28T06:41:25.718 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296014.log 2023-11-28T06:41:25.719 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517534.log 2023-11-28T06:41:25.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261455.log 2023-11-28T06:41:25.720 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271887.log 2023-11-28T06:41:25.721 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647602.log 2023-11-28T06:41:25.722 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489099.log 2023-11-28T06:41:25.722 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279983.log 2023-11-28T06:41:25.723 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629988.log 2023-11-28T06:41:25.724 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508460.log 2023-11-28T06:41:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497979.log 2023-11-28T06:41:25.725 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576796.log 2023-11-28T06:41:25.726 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271000.log 2023-11-28T06:41:25.727 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568045.log 2023-11-28T06:41:25.727 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450550.log 2023-11-28T06:41:25.728 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99749.log 2023-11-28T06:41:25.729 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510077.log 2023-11-28T06:41:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165760.log 2023-11-28T06:41:25.730 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179843.log 2023-11-28T06:41:25.731 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101871.log 2023-11-28T06:41:25.732 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449202.log 2023-11-28T06:41:25.732 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475833.log 2023-11-28T06:41:25.733 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520542.log 2023-11-28T06:41:25.734 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179430.log 2023-11-28T06:41:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265397.log 2023-11-28T06:41:25.735 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539226.log 2023-11-28T06:41:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519278.log 2023-11-28T06:41:25.736 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557692.log 2023-11-28T06:41:25.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661639.log 2023-11-28T06:41:25.738 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252996.log 2023-11-28T06:41:25.739 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266222.log 2023-11-28T06:41:25.739 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99371.log 2023-11-28T06:41:25.740 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194785.log 2023-11-28T06:41:25.740 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654591.log 2023-11-28T06:41:25.741 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102260.log 2023-11-28T06:41:25.742 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485225.log 2023-11-28T06:41:25.743 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237150.log 2023-11-28T06:41:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286736.log 2023-11-28T06:41:25.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309821.log 2023-11-28T06:41:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652030.log 2023-11-28T06:41:25.745 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591692.log 2023-11-28T06:41:25.746 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463195.log 2023-11-28T06:41:25.746 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186627.log 2023-11-28T06:41:25.747 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102466.log 2023-11-28T06:41:25.748 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296436.log 2023-11-28T06:41:25.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482373.log 2023-11-28T06:41:25.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471510.log 2023-11-28T06:41:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555388.log 2023-11-28T06:41:25.750 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507589.log 2023-11-28T06:41:25.751 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169093.log 2023-11-28T06:41:25.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268746.log 2023-11-28T06:41:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245872.log 2023-11-28T06:41:25.753 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581851.log 2023-11-28T06:41:25.754 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540525.log 2023-11-28T06:41:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531949.log 2023-11-28T06:41:25.755 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275303.log 2023-11-28T06:41:25.756 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663444.log 2023-11-28T06:41:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176039.log 2023-11-28T06:41:25.757 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659882.log 2023-11-28T06:41:25.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185802.log 2023-11-28T06:41:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302256.log 2023-11-28T06:41:25.759 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617821.log 2023-11-28T06:41:25.760 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653716.log 2023-11-28T06:41:25.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558569.log 2023-11-28T06:41:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489090.log 2023-11-28T06:41:25.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554110.log 2023-11-28T06:41:25.763 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259771.log 2023-11-28T06:41:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553693.log 2023-11-28T06:41:25.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479687.log 2023-11-28T06:41:25.765 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570783.log 2023-11-28T06:41:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185376.log 2023-11-28T06:41:25.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630831.log 2023-11-28T06:41:25.767 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506330.log 2023-11-28T06:41:25.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316636.log 2023-11-28T06:41:25.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633748.log 2023-11-28T06:41:25.769 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280809.log 2023-11-28T06:41:25.770 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586586.log 2023-11-28T06:41:25.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190921.log 2023-11-28T06:41:25.771 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531541.log 2023-11-28T06:41:25.772 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278159.log 2023-11-28T06:41:25.773 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446561.log 2023-11-28T06:41:25.774 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578267.log 2023-11-28T06:41:25.774 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100484.log 2023-11-28T06:41:25.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317478.log 2023-11-28T06:41:25.775 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666094.log 2023-11-28T06:41:25.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263635.log 2023-11-28T06:41:25.777 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96900.log 2023-11-28T06:41:25.777 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484725.log 2023-11-28T06:41:25.778 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329158.log 2023-11-28T06:41:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645414.log 2023-11-28T06:41:25.779 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246327.log 2023-11-28T06:41:25.780 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565504.log 2023-11-28T06:41:25.781 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190029.log 2023-11-28T06:41:25.781 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643596.log 2023-11-28T06:41:25.782 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644504.log 2023-11-28T06:41:25.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583985.log 2023-11-28T06:41:25.783 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536132.log 2023-11-28T06:41:25.784 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99059.log 2023-11-28T06:41:25.785 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96893.log 2023-11-28T06:41:25.786 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299027.log 2023-11-28T06:41:25.787 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97687.log 2023-11-28T06:41:25.787 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518394.log 2023-11-28T06:41:25.788 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453506.log 2023-11-28T06:41:25.789 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167272.log 2023-11-28T06:41:25.790 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587022.log 2023-11-28T06:41:25.790 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632087.log 2023-11-28T06:41:25.791 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635834.log 2023-11-28T06:41:25.792 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574536.log 2023-11-28T06:41:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525606.log 2023-11-28T06:41:25.793 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101618.log 2023-11-28T06:41:25.794 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187892.log 2023-11-28T06:41:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600854.log 2023-11-28T06:41:25.795 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639213.log 2023-11-28T06:41:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194794.log 2023-11-28T06:41:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628770.log 2023-11-28T06:41:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187465.log 2023-11-28T06:41:25.798 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309390.log 2023-11-28T06:41:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447920.log 2023-11-28T06:41:25.799 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287145.log 2023-11-28T06:41:25.800 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99665.log 2023-11-28T06:41:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97267.log 2023-11-28T06:41:25.801 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286309.log 2023-11-28T06:41:25.802 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560709.log 2023-11-28T06:41:25.803 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542086.log 2023-11-28T06:41:25.804 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573253.log 2023-11-28T06:41:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579694.log 2023-11-28T06:41:25.805 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500992.log 2023-11-28T06:41:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274819.log 2023-11-28T06:41:25.806 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101660.log 2023-11-28T06:41:25.807 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597874.log 2023-11-28T06:41:25.808 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457671.log 2023-11-28T06:41:25.809 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636670.log 2023-11-28T06:41:25.809 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514263.log 2023-11-28T06:41:25.810 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464876.log 2023-11-28T06:41:25.810 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179421.log 2023-11-28T06:41:25.811 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315792.log 2023-11-28T06:41:25.812 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283345.log 2023-11-28T06:41:25.812 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301339.log 2023-11-28T06:41:25.813 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633340.log 2023-11-28T06:41:25.814 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306458.log 2023-11-28T06:41:25.814 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512276.log 2023-11-28T06:41:25.815 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444031.log 2023-11-28T06:41:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266231.log 2023-11-28T06:41:25.816 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458088.log 2023-11-28T06:41:25.818 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460251.log 2023-11-28T06:41:25.819 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593421.log 2023-11-28T06:41:25.819 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96560.log 2023-11-28T06:41:25.819 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578859.log 2023-11-28T06:41:25.820 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510086.log 2023-11-28T06:41:25.820 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576787.log 2023-11-28T06:41:25.821 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500983.log 2023-11-28T06:41:25.822 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654166.log 2023-11-28T06:41:25.822 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480156.log 2023-11-28T06:41:25.823 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514360.log 2023-11-28T06:41:25.824 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567637.log 2023-11-28T06:41:25.824 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570792.log 2023-11-28T06:41:25.825 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203733.log 2023-11-28T06:41:25.826 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526441.log 2023-11-28T06:41:25.826 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652455.log 2023-11-28T06:41:25.827 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516268.log 2023-11-28T06:41:25.828 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453090.log 2023-11-28T06:41:25.828 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239542.log 2023-11-28T06:41:25.829 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541801.log 2023-11-28T06:41:25.830 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279557.log 2023-11-28T06:41:25.830 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264522.log 2023-11-28T06:41:25.831 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96559.log 2023-11-28T06:41:25.832 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500565.log 2023-11-28T06:41:25.832 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182874.log 2023-11-28T06:41:25.833 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477925.log 2023-11-28T06:41:25.834 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196569.log 2023-11-28T06:41:25.834 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599120.log 2023-11-28T06:41:25.835 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513138.log 2023-11-28T06:41:25.836 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283752.log 2023-11-28T06:41:25.836 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210701.log 2023-11-28T06:41:25.837 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274393.log 2023-11-28T06:41:25.838 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609429.log 2023-11-28T06:41:25.839 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233660.log 2023-11-28T06:41:25.839 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623391.log 2023-11-28T06:41:25.840 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257267.log 2023-11-28T06:41:25.842 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653725.log 2023-11-28T06:41:25.842 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314958.log 2023-11-28T06:41:25.842 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523502.log 2023-11-28T06:41:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.98743.log 2023-11-28T06:41:25.844 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318729.log 2023-11-28T06:41:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447929.log 2023-11-28T06:41:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667108.log 2023-11-28T06:41:25.848 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169102.log 2023-11-28T06:41:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249422.log 2023-11-28T06:41:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296855.log 2023-11-28T06:41:25.849 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566803.log 2023-11-28T06:41:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597040.log 2023-11-28T06:41:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456012.log 2023-11-28T06:41:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631249.log 2023-11-28T06:41:25.851 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231886.log 2023-11-28T06:41:25.852 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327723.log 2023-11-28T06:41:25.852 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529446.log 2023-11-28T06:41:25.852 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537971.log 2023-11-28T06:41:25.853 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257693.log 2023-11-28T06:41:25.854 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589174.log 2023-11-28T06:41:25.854 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445300.log 2023-11-28T06:41:25.855 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298112.log 2023-11-28T06:41:25.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100568.log 2023-11-28T06:41:25.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272304.log 2023-11-28T06:41:25.857 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631240.log 2023-11-28T06:41:25.858 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523920.log 2023-11-28T06:41:25.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205047.log 2023-11-28T06:41:25.859 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284169.log 2023-11-28T06:41:25.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588754.log 2023-11-28T06:41:25.860 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235836.log 2023-11-28T06:41:25.861 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524760.log 2023-11-28T06:41:25.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100406.log 2023-11-28T06:41:25.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229345.log 2023-11-28T06:41:25.863 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592540.log 2023-11-28T06:41:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310656.log 2023-11-28T06:41:25.864 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209218.log 2023-11-28T06:41:25.865 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462359.log 2023-11-28T06:41:25.866 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247191.log 2023-11-28T06:41:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95461.log 2023-11-28T06:41:25.867 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100862.log 2023-11-28T06:41:25.868 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307706.log 2023-11-28T06:41:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667066.log 2023-11-28T06:41:25.869 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212247.log 2023-11-28T06:41:25.870 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102758.log 2023-11-28T06:41:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437335.log 2023-11-28T06:41:25.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239038.log 2023-11-28T06:41:25.873 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514312.log 2023-11-28T06:41:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180308.log 2023-11-28T06:41:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320462.log 2023-11-28T06:41:25.874 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560277.log 2023-11-28T06:41:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446974.log 2023-11-28T06:41:25.875 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200334.log 2023-11-28T06:41:25.876 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316209.log 2023-11-28T06:41:25.877 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195292.log 2023-11-28T06:41:25.877 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194368.log 2023-11-28T06:41:25.878 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102344.log 2023-11-28T06:41:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96229.log 2023-11-28T06:41:25.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164338.log 2023-11-28T06:41:25.880 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588763.log 2023-11-28T06:41:25.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173957.log 2023-11-28T06:41:25.881 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564183.log 2023-11-28T06:41:25.882 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664347.log 2023-11-28T06:41:25.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646770.log 2023-11-28T06:41:25.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95923.log 2023-11-28T06:41:25.884 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647183.log 2023-11-28T06:41:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305609.log 2023-11-28T06:41:25.885 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666940.log 2023-11-28T06:41:25.886 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243227.log 2023-11-28T06:41:25.887 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288467.log 2023-11-28T06:41:25.888 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667276.log 2023-11-28T06:41:25.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312455.log 2023-11-28T06:41:25.889 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246318.log 2023-11-28T06:41:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563333.log 2023-11-28T06:41:25.890 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598282.log 2023-11-28T06:41:25.891 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179005.log 2023-11-28T06:41:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572232.log 2023-11-28T06:41:25.892 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164786.log 2023-11-28T06:41:25.893 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169510.log 2023-11-28T06:41:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184134.log 2023-11-28T06:41:25.894 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230184.log 2023-11-28T06:41:25.895 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260609.log 2023-11-28T06:41:25.896 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524751.log 2023-11-28T06:41:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314550.log 2023-11-28T06:41:25.897 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453923.log 2023-11-28T06:41:25.898 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666197.log 2023-11-28T06:41:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98248.log 2023-11-28T06:41:25.899 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-28T06:41:25.900 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513561.log 2023-11-28T06:41:25.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245435.log 2023-11-28T06:41:25.901 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317895.log 2023-11-28T06:41:25.902 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211109.log 2023-11-28T06:41:25.903 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96563.log 2023-11-28T06:41:25.903 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517543.log 2023-11-28T06:41:25.904 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231033.log 2023-11-28T06:41:25.905 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289922.log 2023-11-28T06:41:25.908 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.566385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102176.log 2023-11-28T06:41:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102758.log: /var/log/ceph/ceph-client.admin.665884.log: /var/log/ceph/ceph-client.admin.239038.log: /var/log/ceph/ceph-client.admin.100406.log: /var/log/ceph/ceph-client.admin.235836.log: /var/log/ceph/ceph-client.admin.667318.log: /var/log/ceph/ceph-client.admin.556300.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.319167.log.gz 2023-11-28T06:41:25.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452255.log 2023-11-28T06:41:25.913 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.585745.log: 88.1%/var/log/ceph/ceph-client.admin.566794.log: -- replaced with /var/log/ceph/ceph-client.admin.665884.log.gz 2023-11-28T06:41:25.913 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.667318.log.gz 2023-11-28T06:41:25.913 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.556792.log.gz 2023-11-28T06:41:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.529015.log: /var/log/ceph/ceph-client.admin.538813.log: /var/log/ceph/ceph-client.admin.662519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248083.log 2023-11-28T06:41:25.914 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103124.log.gz 2023-11-28T06:41:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.562792.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95313.log.gz 2023-11-28T06:41:25.914 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.544126.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.184551.log.gz 2023-11-28T06:41:25.915 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100652.log.gz 2023-11-28T06:41:25.915 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.483727.log.gz 2023-11-28T06:41:25.915 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.483286.log.gz 2023-11-28T06:41:25.915 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.282510.log.gz 2023-11-28T06:41:25.916 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272313.log 2023-11-28T06:41:25.916 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.517972.log.gz 2023-11-28T06:41:25.926 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.599992.log: /var/log/ceph/ceph-client.admin.518403.log: 80.6%/var/log/ceph/ceph-client.admin.552433.log: /var/log/ceph/ceph-client.admin.581423.log: -- replaced with /var/log/ceph/ceph-client.admin.529437.log.gz 2023-11-28T06:41:25.926 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100406.log.gz 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.301348.log.gz 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.542216.log: gzip -5/var/log/ceph/ceph-client.admin.641844.log: --verbose -- /var/log/ceph/ceph-client.admin.472345.log 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.537553.log.gz 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.575405.log: /var/log/ceph/ceph-client.admin.634583.log: -- replaced with /var/log/ceph/ceph-client.admin.566376.log.gz 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5%/var/log/ceph/ceph-client.admin.637930.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.641844.log.gz -- replaced with /var/log/ceph/ceph-client.admin.592949.log.gz 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.927 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.600415.log: /var/log/ceph/ceph-client.admin.272313.log: -5 85.3% -- replaced with /var/log/ceph/ceph-client.admin.571266.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.532398.log 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.540094.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.571275.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.606687.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.508034.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.471927.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0%/var/log/ceph/ceph-client.admin.598701.log: /var/log/ceph/ceph-client.admin.599129.log: -- replaced with /var/log/ceph/ceph-client.admin.196147.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666688.log: /var/log/ceph/ceph-client.admin.522668.log: /var/log/ceph/ceph-client.admin.659452.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.273147.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.455587.log.gz 2023-11-28T06:41:25.928 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.554101.log: gzip/var/log/ceph/ceph-client.admin.587431.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.656792.log 90.1% -- replaced with /var/log/ceph/ceph-client.admin.456846.log.gz 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.666688.log.gz 82.1% -- replaced with /var/log/ceph/ceph-client.admin.441936.log.gz 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.532398.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.460260.log.gz 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657242.log 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 78.8% -- replaced with /var/log/ceph/ceph-client.admin.521404.log.gz 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.585328.log: -- replaced with /var/log/ceph/ceph-client.admin.441523.log.gz 2023-11-28T06:41:25.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.541357.log: /var/log/ceph/ceph-client.admin.656792.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.524329.log.gz 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96007.log 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.556783.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.317886.log.gz 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.102758.log.gz 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.303939.log.gz 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.657242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162998.log 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3%/var/log/ceph/ceph-client.admin.565054.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.662519.log.gz 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 90.0% -- replaced with /var/log/ceph/ceph-client.admin.203324.log.gz 2023-11-28T06:41:25.930 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.529015.log.gz 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.470131.log 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.562792.log.gz 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95545.log 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.560286.log: /var/log/ceph/ceph-client.admin.579685.log: 89.9%/var/log/ceph/ceph-client.admin.523076.log: -- replaced with /var/log/ceph/ceph-client.admin.169519.log.gz 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.599992.log.gz 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96549.log.gz 2023-11-28T06:41:25.931 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306449.log 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.658572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617812.log 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% 92.0% -- replaced with /var/log/ceph/ceph-client.admin.659452.log.gz 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.581423.log.gz/var/log/ceph/ceph-client.admin.95545.log: 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99581.log 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96901.log.gz 81.0% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97183.log.gz 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96230.log.gz 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.525167.log: /var/log/ceph/ceph-client.admin.639658.log: 2023-11-28T06:41:25.932 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.634583.log.gz 2023-11-28T06:41:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666239.log: 81.3%/var/log/ceph/ceph-client.admin.617812.log: /var/log/ceph/ceph-client.admin.636253.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.598701.log.gz 2023-11-28T06:41:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.648772.log: -- replaced with /var/log/ceph/ceph-client.admin.189567.log.gz 2023-11-28T06:41:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228914.log 2023-11-28T06:41:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.599983.log: 78.5%/var/log/ceph/ceph-client.admin.629154.log: -- replaced with /var/log/ceph/ceph-client.admin.556783.log.gz 2023-11-28T06:41:25.942 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.655914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502928.log 2023-11-28T06:41:25.942 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.655914.log.gz 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.663901.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.657242.log.gz 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%/var/log/ceph/ceph-client.admin.228914.log: -- replaced with /var/log/ceph/ceph-client.admin.599129.log.gz 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.552433.log.gz 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.522668.log.gz 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.554101.log.gz 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96561.log 2023-11-28T06:41:25.943 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.523076.log.gz 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.569381.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.200325.log.gz 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.205038.log.gz 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303508.log 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.574954.log: /var/log/ceph/ceph-client.admin.519703.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.579685.log.gz 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.577698.log: /var/log/ceph/ceph-client.admin.656353.log: /var/log/ceph/ceph-client.admin.96561.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95881.log.gz 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96228.log.gz 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.516277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446123.log 2023-11-28T06:41:25.944 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1%/var/log/ceph/ceph-client.admin.665195.log: -- replaced with /var/log/ceph/ceph-client.admin.554958.log.gz 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.665716.log: /var/log/ceph/ceph-client.admin.646335.log: /var/log/ceph/ceph-client.admin.303508.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.543284.log.gz 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3%/var/log/ceph/ceph-client.admin.665842.log: -- replaced with /var/log/ceph/ceph-client.admin.665195.log.gz/var/log/ceph/ceph-client.admin.561126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233651.log 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.665716.log.gz 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.658572.log.gz 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.596384.log: /var/log/ceph/ceph-client.admin.634166.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.560286.log.gz 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.659002.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.585745.log.gz 2023-11-28T06:41:25.945 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.665842.log.gz 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.659002.log.gz 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503770.log 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.585328.log.gz/var/log/ceph/ceph-client.admin.592958.log: 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.299648.log.gz 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.525167.log.gz 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.261028.log.gz 2023-11-28T06:41:25.946 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9%/var/log/ceph/ceph-client.admin.517534.log: /var/log/ceph/ceph-client.admin.233651.log: -- replaced with /var/log/ceph/ceph-client.admin.94791.log.gz 81.8% -- replaced with /var/log/ceph/ceph-client.admin.573689.log.gz 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.575888.log.gz 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.636253.log.gz 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.647602.log: /var/log/ceph/ceph-client.admin.629988.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.440675.log.gz 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8%/var/log/ceph/ceph-client.admin.576796.log: -- replaced with /var/log/ceph/ceph-client.admin.558578.log.gz 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.647602.log.gz 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5%/var/log/ceph/ceph-client.admin.568045.log: -- replaced with /var/log/ceph/ceph-client.admin.522659.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632078.log 2023-11-28T06:41:25.947 INFO:teuthology.orchestra.run.smithi154.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.195283.log.gz 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.315801.log.gz 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103588.log.gz 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1%/var/log/ceph/ceph-client.admin.520542.log: -- replaced with /var/log/ceph/ceph-client.admin.580103.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.admin.580112.log.gz 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.587431.log.gz 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7%/var/log/ceph/ceph-client.admin.539226.log: -- replaced with /var/log/ceph/ceph-client.admin.582259.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95545.log.gz 2023-11-28T06:41:25.948 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.583567.log.gz 2023-11-28T06:41:25.949 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.961 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.503770.log: /var/log/ceph/ceph-client.admin.519278.log: /var/log/ceph/ceph-client.admin.557692.log: /var/log/ceph/ceph-client.admin.661639.log: 90.0% 85.2%/var/log/ceph/ceph-client.admin.654591.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.577698.log.gz 2023-11-28T06:41:25.961 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.320871.log.gz/var/log/ceph/ceph-client.admin.632078.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.500148.log.gz 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.540094.log.gz 90.0% 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.538813.log.gz 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96561.log.gz 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 90.1% -- replaced with /var/log/ceph/ceph-client.admin.497498.log.gz 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr: -5 85.3% -- replaced with /var/log/ceph/ceph-client.admin.164329.log.gz 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.652030.log: --verbose -- /var/log/ceph/ceph-client.admin.559855.log 2023-11-28T06:41:25.962 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.591692.log: -- replaced with /var/log/ceph/ceph-client.admin.525176.log.gz 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650702.log 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.559855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95839.log 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.652030.log.gz 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.555388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480147.log 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.581851.log: /var/log/ceph/ceph-client.admin.650702.log: /var/log/ceph/ceph-client.admin.540525.log: /var/log/ceph/ceph-client.admin.531949.log: 90.1%/var/log/ceph/ceph-client.admin.663444.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.650702.log.gz 2023-11-28T06:41:25.963 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.659882.log: 89.8% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.307284.log.gz 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.240496.log.gz 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.617821.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.659882.log.gz 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.653716.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.307715.log.gz 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.558569.log: -- replaced with /var/log/ceph/ceph-client.admin.505489.log.gz 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480147.log: 80.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.653716.log.gz -5 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95145.log 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.512721.log.gz/var/log/ceph/ceph-client.admin.554110.log: 93.3% 2023-11-28T06:41:25.964 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.474069.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.513147.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.553693.log: 79.7%/var/log/ceph/ceph-client.admin.570783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101408.log 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.630831.log: -- replaced with /var/log/ceph/ceph-client.admin.462769.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.285900.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.633748.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.663901.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.472762.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.472354.log.gz 2023-11-28T06:41:25.965 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.586586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103546.log 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.274402.log.gz 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.531541.log: 78.6%/var/log/ceph/ceph-client.admin.95145.log: /var/log/ceph/ceph-client.admin.578267.log: -- replaced with /var/log/ceph/ceph-client.admin.295121.log.gz 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.539226.log.gz 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89029.log.gz 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666094.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.242203.log.gz 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.645414.log: 90.1% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.561126.log.gz 2023-11-28T06:41:25.966 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.666094.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.599983.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.575405.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.444462.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.565504.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.314124.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.643596.log: gzip -5 --verbose 81.0% -- replaced with /var/log/ceph/ceph-client.admin.645414.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.644504.log: -- /var/log/ceph/ceph-client.admin.587013.log 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.583985.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.661639.log.gz 2023-11-28T06:41:25.967 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 79.5% -- replaced with /var/log/ceph/ceph-client.admin.644504.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6%/var/log/ceph/ceph-client.admin.536132.log: -- replaced with /var/log/ceph/ceph-client.admin.279139.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.517534.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.279974.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.304352.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.320880.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.277686.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.516277.log.gz 2023-11-28T06:41:25.968 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.518394.log: -- replaced with /var/log/ceph/ceph-client.admin.441945.log.gz 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103546.log: 81.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265388.log 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.587022.log: /var/log/ceph/ceph-client.admin.632087.log: /var/log/ceph/ceph-client.admin.635834.log: gzip/var/log/ceph/ceph-client.admin.574536.log: /var/log/ceph/ceph-client.admin.587013.log: -5 -- replaced with /var/log/ceph/ceph-client.admin.178588.log.gz 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259780.log.gz 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.184542.log 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.480147.log.gz 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.525606.log: /var/log/ceph/ceph-client.admin.265388.log: /var/log/ceph/ceph-client.admin.600854.log: /var/log/ceph/ceph-client.admin.639213.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.585337.log.gz 2023-11-28T06:41:25.969 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.628770.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.565063.log.gz 2023-11-28T06:41:25.980 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.560709.log: gzip 80.5% -- replaced with /var/log/ceph/ceph-client.admin.531949.log.gz 2023-11-28T06:41:25.980 INFO:teuthology.orchestra.run.smithi154.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.499265.log.gz 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: -5 79.8% -- replaced with /var/log/ceph/ceph-client.admin.532398.log.gz 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.266638.log/var/log/ceph/ceph-client.admin.542086.log: 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.643596.log.gz 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.573253.log: /var/log/ceph/ceph-client.admin.184542.log: /var/log/ceph/ceph-client.admin.579694.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103378.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100238.log.gz 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581015.log 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.531541.log.gz 2023-11-28T06:41:25.981 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100364.log.gz 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.597874.log: /var/log/ceph/ceph-client.admin.636670.log: 90.0%/var/log/ceph/ceph-client.admin.633340.log: -- replaced with /var/log/ceph/ceph-client.admin.570281.log.gz/var/log/ceph/ceph-client.admin.593421.log: 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.553693.log.gz 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.578859.log: /var/log/ceph/ceph-client.admin.266638.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102548.log.gz 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.596384.log.gz 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.576787.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103294.log.gz 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288013.log 2023-11-28T06:41:25.982 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.663444.log.gz 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.654166.log: /var/log/ceph/ceph-client.admin.567637.log: /var/log/ceph/ceph-client.admin.570792.log: /var/log/ceph/ceph-client.admin.526441.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.202024.log.gz 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.652455.log: /var/log/ceph/ceph-client.admin.581015.log: /var/log/ceph/ceph-client.admin.516268.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.654166.log.gz 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99101.log.gz 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290911.log 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.541801.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.590008.log.gz 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.599120.log: 90.2%/var/log/ceph/ceph-client.admin.609429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562378.log 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.623391.log: -- replaced with /var/log/ceph/ceph-client.admin.212520.log.gz 2023-11-28T06:41:25.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.653725.log: 90.0%/var/log/ceph/ceph-client.admin.523502.log: 89.4%/var/log/ceph/ceph-client.admin.667108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591268.log 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.253443.log.gz 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.256025.log.gz 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.652455.log.gz 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.566803.log: /var/log/ceph/ceph-client.admin.597040.log: /var/log/ceph/ceph-client.admin.631249.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.667108.log.gz 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.529446.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.540103.log.gz 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.562378.log: -- replaced with /var/log/ceph/ceph-client.admin.330426.log.gz 2023-11-28T06:41:25.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.537971.log: /var/log/ceph/ceph-client.admin.589174.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.568952.log.gz 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.631240.log: gzip 85.3% -- replaced with /var/log/ceph/ceph-client.admin.591692.log.gz 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.444453.log 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.523920.log: /var/log/ceph/ceph-client.admin.588754.log: 90.1%/var/log/ceph/ceph-client.admin.524760.log: -- replaced with /var/log/ceph/ceph-client.admin.520542.log.gz 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.592540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450124.log 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258518.log 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641003.log 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308968.log 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0%/var/log/ceph/ceph-client.admin.667066.log: -- replaced with /var/log/ceph/ceph-client.admin.587022.log.gz 2023-11-28T06:41:25.985 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.641003.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.560277.log: /var/log/ceph/ceph-client.admin.612253.log/var/log/ceph/ceph-client.admin.588763.log: 2023-11-28T06:41:25.986 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8%/var/log/ceph/ceph-client.admin.564183.log: -- replaced with /var/log/ceph/ceph-client.admin.566385.log.gz 2023-11-28T06:41:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.664347.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.570783.log.gz/var/log/ceph/ceph-client.admin.646770.log: 2023-11-28T06:41:25.986 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.569381.log.gz 2023-11-28T06:41:25.986 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.277247.log.gz 2023-11-28T06:41:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.647183.log: /var/log/ceph/ceph-client.admin.666940.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.641003.log.gz 2023-11-28T06:41:25.986 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667276.log: /var/log/ceph/ceph-client.admin.563333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176030.log 2023-11-28T06:41:25.987 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.631240.log.gz 2023-11-28T06:41:25.997 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.667276.log.gz 2023-11-28T06:41:25.997 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.646770.log.gz 2023-11-28T06:41:25.997 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.612253.log: /var/log/ceph/ceph-client.admin.598282.log: -- replaced with /var/log/ceph/ceph-client.admin.664347.log.gz 2023-11-28T06:41:25.997 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.572232.log: /var/log/ceph/ceph-client.admin.524751.log: /var/log/ceph/ceph-client.admin.308968.log: /var/log/ceph/ceph-client.admin.446123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448368.log 2023-11-28T06:41:25.997 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666197.log: /var/log/ceph/ceph-client.admin.176030.log: gzip/var/log/ceph/ceph.audit.log: -5 88.3% -- replaced with /var/log/ceph/ceph-client.admin.666197.log.gz 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose --/var/log/ceph/ceph-client.admin.517543.log: /var/log/ceph/ceph-client.admin.498814.log/var/log/ceph/ceph-client.admin.461098.log: 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295562.log: /var/log/ceph/ceph-client.admin.291776.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.272313.log.gz 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487186.log: /var/log/ceph/ceph-client.admin.161159.log: /var/log/ceph/ceph-client.admin.298121.log: /var/log/ceph/ceph-client.admin.316218.log: /var/log/ceph/ceph-client.admin.232332.log: /var/log/ceph/ceph-client.admin.292637.log: /var/log/ceph/ceph-client.admin.497489.log: /var/log/ceph/ceph-client.admin.201166.log: /var/log/ceph/ceph-client.admin.292185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537562.log 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98865.log: /var/log/ceph/ceph-client.admin.436914.log: /var/log/ceph/ceph-client.admin.101246.log: /var/log/ceph/ceph-client.admin.95229.log: /var/log/ceph/ceph-client.admin.236282.log: /var/log/ceph/ceph-client.admin.95271.log: /var/log/ceph/ceph-client.admin.101020.log: /var/log/ceph/ceph-client.admin.201603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478762.log 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320044.log: /var/log/ceph/ceph-client.admin.97603.log: /var/log/ceph/ceph-client.admin.475833.log: /var/log/ceph/ceph-client.admin.261455.log: /var/log/ceph/ceph-client.admin.162499.log: /var/log/ceph/ceph-client.admin.291349.log: /var/log/ceph/ceph-client.admin.177345.log: /var/log/ceph/ceph-client.admin.537562.log: gzip/var/log/ceph/ceph-client.admin.185793.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.482869.log 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.508460.log: /var/log/ceph/ceph-client.admin.280809.log: /var/log/ceph/ceph-client.admin.489099.log: /var/log/ceph/ceph-client.admin.263179.log: /var/log/ceph/ceph-client.admin.507156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660322.log 2023-11-28T06:41:25.998 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478771.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.633748.log.gz 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478762.log: /var/log/ceph/ceph-client.admin.440258.log: /var/log/ceph/ceph-client.admin.317478.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.634166.log.gz 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211118.log/var/log/ceph/ceph-client.admin.485225.log: 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103630.log: /var/log/ceph/ceph-client.admin.450550.log: /var/log/ceph/ceph-client.admin.244093.log: /var/log/ceph/ceph-client.admin.296014.log: /var/log/ceph/ceph-client.admin.446561.log: /var/log/ceph/ceph-client.admin.263635.log: /var/log/ceph/ceph-client.admin.232807.log: /var/log/ceph/ceph-client.admin.660322.log: /var/log/ceph/ceph-client.admin.499685.log: /var/log/ceph/ceph-client.admin.237150.log: /var/log/ceph/ceph-client.admin.96902.log: /var/log/ceph/ceph-client.admin.205961.log: /var/log/ceph/ceph-client.admin.497979.log: /var/log/ceph/ceph-client.admin.99059.log: /var/log/ceph/ceph-client.admin.318720.log: /var/log/ceph/ceph-client.admin.169093.log: /var/log/ceph/ceph-client.admin.229336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644513.log 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.452246.log: /var/log/ceph/ceph-client.admin.245872.log: /var/log/ceph/ceph-client.admin.99749.log: /var/log/ceph/ceph-client.admin.199846.log: /var/log/ceph/ceph-client.admin.211118.log: /var/log/ceph/ceph-client.admin.447920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482382.log 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.660322.log.gz 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.617812.log.gz 2023-11-28T06:41:25.999 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167272.log: /var/log/ceph/ceph-client.admin.437326.log: /var/log/ceph/ceph-client.admin.309399.log: /var/log/ceph/ceph-client.admin.275303.log: /var/log/ceph/ceph-client.admin.173966.log: /var/log/ceph/ceph-client.admin.179430.log: /var/log/ceph/ceph-client.admin.239533.log: /var/log/ceph/ceph-client.admin.231886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228089.log 2023-11-28T06:41:26.000 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99665.log: /var/log/ceph/ceph-client.admin.254349.log: /var/log/ceph/ceph-client.admin.644513.log: /var/log/ceph/ceph-client.admin.248529.log: /var/log/ceph/ceph-client.admin.238095.log: /var/log/ceph/ceph-client.admin.176039.log: /var/log/ceph/ceph-client.admin.102466.log: gzip/var/log/ceph/ceph-client.admin.286309.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.486705.log 2023-11-28T06:41:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196138.log: /var/log/ceph/ceph-client.admin.305609.log: /var/log/ceph/ceph-client.admin.273564.log: /var/log/ceph/ceph-client.admin.312046.log: /var/log/ceph/ceph-client.admin.182883.log: /var/log/ceph/ceph-client.admin.185802.log: /var/log/ceph/ceph-client.admin.316636.log: /var/log/ceph/ceph-client.admin.243227.log: /var/log/ceph/ceph-client.admin.101660.log: /var/log/ceph/ceph-client.admin.321777.log: /var/log/ceph/ceph-client.admin.228089.log: /var/log/ceph/ceph-client.admin.482382.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.565054.log.gz 2023-11-28T06:41:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177754.log: /var/log/ceph/ceph-client.admin.271887.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.542216.log.gz 2023-11-28T06:41:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303086.log 2023-11-28T06:41:26.005 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190921.log: /var/log/ceph/ceph-client.admin.96049.log: /var/log/ceph/ceph-client.admin.453506.log: /var/log/ceph/ceph-client.admin.257693.log: /var/log/ceph/ceph-client.admin.246318.log: /var/log/ceph/ceph-client.admin.443193.log: /var/log/ceph/ceph-client.admin.271000.log: /var/log/ceph/ceph-client.admin.279983.log: /var/log/ceph/ceph-client.admin.327723.log: /var/log/ceph/ceph-client.admin.188311.log: /var/log/ceph/ceph-client.admin.486705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661630.log 2023-11-28T06:41:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97687.log: /var/log/ceph/ceph-client.admin.101618.log: /var/log/ceph/ceph-client.admin.445300.log: /var/log/ceph/ceph-client.admin.167022.log: /var/log/ceph/ceph-client.admin.507589.log: /var/log/ceph/ceph-client.admin.510077.log: /var/log/ceph/ceph-client.admin.504627.log: /var/log/ceph/ceph-client.admin.288467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561117.log 2023-11-28T06:41:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194794.log: /var/log/ceph/ceph-client.admin.100568.log: /var/log/ceph/ceph-client.admin.205047.log: /var/log/ceph/ceph-client.admin.303086.log: /var/log/ceph/ceph-client.admin.97393.log: /var/log/ceph/ceph-client.admin.274393.log: gzip -5/var/log/ceph/ceph-client.admin.101871.log: /var/log/ceph/ceph-client.admin.661630.log: --verbose -- /var/log/ceph/ceph-client.admin.100054.log 2023-11-28T06:41:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.240904.log: /var/log/ceph/ceph-client.admin.312455.log: /var/log/ceph/ceph-client.admin.561117.log: /var/log/ceph/ceph-client.admin.187465.log: /var/log/ceph/ceph-client.admin.229345.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.661630.log.gz 2023-11-28T06:41:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310656.log: gzip/var/log/ceph/ceph-client.admin.267064.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.247182.log 2023-11-28T06:41:26.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467817.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.574954.log.gz 2023-11-28T06:41:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456012.log: /var/log/ceph/ceph-client.admin.179005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659891.log 81.6% 2023-11-28T06:41:26.007 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.560277.log.gz 2023-11-28T06:41:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.274819.log: /var/log/ceph/ceph-client.admin.180308.log: /var/log/ceph/ceph-client.admin.200334.log: /var/log/ceph/ceph-client.admin.100054.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.559855.log.gz 2023-11-28T06:41:26.007 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.252996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484716.log 2023-11-28T06:41:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.238519.log: /var/log/ceph/ceph-client.admin.99371.log: /var/log/ceph/ceph-client.admin.95923.log: /var/log/ceph/ceph-client.admin.101534.log: /var/log/ceph/ceph-client.admin.457671.log: /var/log/ceph/ceph-client.admin.247182.log: /var/log/ceph/ceph-client.admin.95102.log: /var/log/ceph/ceph-client.admin.195292.log: /var/log/ceph/ceph-client.admin.659891.log: /var/log/ceph/ceph-client.admin.102344.log: /var/log/ceph/ceph-client.admin.186627.log: gzip/var/log/ceph/ceph-client.admin.296436.log: /var/log/ceph/ceph-client.admin.484716.log: -5 --verbose --/var/log/ceph/ceph-client.admin.300512.log: /var/log/ceph/ceph-client.admin.300921.log 2023-11-28T06:41:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464876.log: /var/log/ceph/ceph-client.admin.177336.log: /var/log/ceph/ceph-client.admin.173957.log: /var/log/ceph/ceph-client.admin.164338.log: /var/log/ceph/ceph-client.admin.471510.log: /var/log/ceph/ceph-client.admin.268746.log: /var/log/ceph/ceph-client.admin.484725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553267.log 2023-11-28T06:41:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443618.log: /var/log/ceph/ceph-client.admin.315792.log: /var/log/ceph/ceph-client.admin.101288.log: /var/log/ceph/ceph-client.admin.237159.log: /var/log/ceph/ceph-client.admin.479687.log: /var/log/ceph/ceph-client.admin.300921.log: /var/log/ceph/ceph-client.admin.259771.log: /var/log/ceph/ceph-client.admin.99287.log: 78.1%/var/log/ceph/ceph-client.admin.301339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160546.log 2023-11-28T06:41:26.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.503761.log: -- replaced with /var/log/ceph/ceph-client.admin.235836.log.gz 2023-11-28T06:41:26.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97832.log: /var/log/ceph/ceph-client.admin.505897.log: /var/log/ceph/ceph-client.admin.185376.log: /var/log/ceph/ceph-client.admin.506330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103504.log 2023-11-28T06:41:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.553267.log: /var/log/ceph/ceph-client.admin.161150.log: /var/log/ceph/ceph-client.admin.306458.log: /var/log/ceph/ceph-client.admin.256016.log: /var/log/ceph/ceph-client.admin.278678.log: /var/log/ceph/ceph-client.admin.190038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161996.log 2023-11-28T06:41:26.013 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160546.log: /var/log/ceph/ceph-client.admin.96900.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.228914.log.gz 2023-11-28T06:41:26.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329158.log: /var/log/ceph/ceph-client.admin.100012.log: /var/log/ceph/ceph-client.admin.444031.log: /var/log/ceph/ceph-client.admin.249858.log: gzip/var/log/ceph/ceph-client.admin.464033.log: /var/log/ceph/ceph-client.admin.95629.log: /var/log/ceph/ceph-client.admin.246327.log: /var/log/ceph/ceph-client.admin.161996.log: 78.8%/var/log/ceph/ceph-client.admin.190029.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.209736.log 2023-11-28T06:41:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295130.log: /var/log/ceph/ceph-client.admin.103504.log: /var/log/ceph/ceph-client.admin.458088.log: -- replaced with /var/log/ceph/ceph-client.admin.503761.log.gz 2023-11-28T06:41:26.016 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165760.log: /var/log/ceph/ceph-client.admin.265397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603946.log 2023-11-28T06:41:26.016 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.503770.log.gz 2023-11-28T06:41:26.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96893.log: /var/log/ceph/ceph-client.admin.299027.log: /var/log/ceph/ceph-client.admin.514360.log: /var/log/ceph/ceph-client.admin.211943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529024.log 2023-11-28T06:41:26.019 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102260.log: /var/log/ceph/ceph-client.admin.187892.log: /var/log/ceph/ceph-client.admin.209736.log: /var/log/ceph/ceph-client.admin.309390.log: /var/log/ceph/ceph-client.admin.603946.log: /var/log/ceph/ceph-client.admin.309821.log: gzip -5/var/log/ceph/ceph-client.admin.482373.log: /var/log/ceph/ceph-client.admin.266222.log: --verbose -- /var/log/ceph/ceph-client.admin.102944.log/var/log/ceph/ceph-client.admin.239542.log: 2023-11-28T06:41:26.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100694.log: /var/log/ceph/ceph-client.admin.489090.log: /var/log/ceph/ceph-client.admin.529024.log: /var/log/ceph/ceph-client.admin.97267.log: /var/log/ceph/ceph-client.admin.287145.log: /var/log/ceph/ceph-client.admin.102007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252550.log 2023-11-28T06:41:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.513138.log: /var/log/ceph/ceph-client.admin.96559.log: /var/log/ceph/ceph-client.admin.279557.log: /var/log/ceph/ceph-client.admin.182874.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.586586.log.gz 2023-11-28T06:41:26.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.500992.log: /var/log/ceph/ceph-client.admin.456429.log: /var/log/ceph/ceph-client.admin.318729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474514.log 2023-11-28T06:41:26.023 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.587013.log.gz 2023-11-28T06:41:26.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.196569.log: /var/log/ceph/ceph-client.admin.257267.log: /var/log/ceph/ceph-client.admin.179421.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.303508.log.gz 2023-11-28T06:41:26.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.283345.log: 90.0%/var/log/ceph/ceph-client.admin.256859.log: /var/log/ceph/ceph-client.admin.191383.log: -- replaced with /var/log/ceph/ceph-client.admin.579694.log.gz 2023-11-28T06:41:26.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.210701.log: /var/log/ceph/ceph-client.admin.308124.log: /var/log/ceph/ceph-client.admin.514263.log: /var/log/ceph/ceph-client.admin.314958.log: /var/log/ceph/ceph-client.admin.512276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258527.log 2023-11-28T06:41:26.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.266231.log: /var/log/ceph/ceph-client.admin.501848.log: /var/log/ceph/ceph-client.admin.260190.log: 77.9%/var/log/ceph/ceph-client.admin.475824.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.555388.log.gz 2023-11-28T06:41:26.025 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.581851.log.gz/var/log/ceph/ceph-client.2.98743.log: 2023-11-28T06:41:26.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460251.log: /var/log/ceph/ceph-client.admin.96560.log: /var/log/ceph/ceph-client.admin.267472.log: /var/log/ceph/ceph-client.admin.449202.log: /var/log/ceph/ceph-client.admin.179843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467400.log 2023-11-28T06:41:26.026 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447929.log: /var/log/ceph/ceph-client.admin.500983.log: /var/log/ceph/ceph-client.admin.480156.log: /var/log/ceph/ceph-client.admin.258527.log: /var/log/ceph/ceph-client.admin.194785.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.554110.log.gz 2023-11-28T06:41:26.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463195.log: /var/log/ceph/ceph-client.admin.286736.log: gzip/var/log/ceph/ceph-client.admin.169102.log: -5 --verbose --/var/log/ceph/ceph-client.admin.453090.log: /var/log/ceph/ceph-client.admin.103714.log 2023-11-28T06:41:26.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203733.log: /var/log/ceph/ceph-client.admin.467400.log: /var/log/ceph/ceph-client.admin.278159.log: /var/log/ceph/ceph-client.admin.302256.log: /var/log/ceph/ceph-client.admin.462359.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.557692.log.gz 2023-11-28T06:41:26.030 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296855.log: /var/log/ceph/ceph-client.admin.264522.log: /var/log/ceph/ceph-client.admin.95461.log: /var/log/ceph/ceph-client.admin.500565.log: /var/log/ceph/ceph-client.admin.100484.log: /var/log/ceph/ceph-client.admin.510086.log: /var/log/ceph/ceph-client.admin.477925.log: /var/log/ceph/ceph-client.admin.307706.log: /var/log/ceph/ceph-client.admin.212247.log: /var/log/ceph/ceph-client.admin.283752.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.583985.log.gz 2023-11-28T06:41:26.030 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95713.log 2023-11-28T06:41:26.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437335.log: /var/log/ceph/ceph-client.admin.249422.log: /var/log/ceph/ceph-client.admin.209218.log: /var/log/ceph/ceph-client.admin.233660.log: /var/log/ceph/ceph-client.admin.298112.log: gzip/var/log/ceph/ceph-client.admin.320462.log: /var/log/ceph/ceph-client.admin.514312.log: -5 --verbose/var/log/ceph/ceph-client.admin.446974.log: --/var/log/ceph/ceph-client.admin.247191.log: /var/log/ceph/ceph-client.admin.571749.log 2023-11-28T06:41:26.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100862.log: /var/log/ceph/ceph-client.admin.103714.log: /var/log/ceph/ceph-client.admin.284169.log: /var/log/ceph/ceph-client.admin.95713.log: /var/log/ceph/ceph-client.admin.272304.log: /var/log/ceph/ceph-client.admin.194368.log: /var/log/ceph/ceph-client.admin.316209.log: /var/log/ceph/ceph-client.admin.96229.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.656792.log.gz 2023-11-28T06:41:26.032 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.556300.log.gz 2023-11-28T06:41:26.033 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96223.log 2023-11-28T06:41:26.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162998.log: 85.3% 87.8%/var/log/ceph/ceph-client.admin.99581.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.606687.log.gz -- replaced with /var/log/ceph/ceph-client.admin.518403.log.gz 2023-11-28T06:41:26.034 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103166.log 2023-11-28T06:41:26.034 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.666239.log.gz 2023-11-28T06:41:26.034 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.034 INFO:teuthology.orchestra.run.smithi154.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.656353.log.gz 2023-11-28T06:41:26.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.571749.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.646335.log.gz 2023-11-28T06:41:26.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96223.log: gzip/var/log/ceph/ceph-client.admin.290911.log: -5 90.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.519703.log.gz 2023-11-28T06:41:26.037 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.103030.log 2023-11-28T06:41:26.037 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.591268.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.566794.log.gz 2023-11-28T06:41:26.037 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.568045.log.gz 2023-11-28T06:41:26.037 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.667066.log.gz 2023-11-28T06:41:26.038 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.630831.log.gz 2023-11-28T06:41:26.038 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.444453.log.gz 2023-11-28T06:41:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101408.log: /var/log/ceph/ceph-client.admin.184134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302664.log 2023-11-28T06:41:26.038 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164786.log: /var/log/ceph/ceph-client.admin.230184.log: /var/log/ceph/ceph-client.admin.453923.log: /var/log/ceph/ceph-client.admin.258518.log: /var/log/ceph/ceph-client.admin.103030.log: /var/log/ceph/ceph-client.admin.260609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641416.log 2023-11-28T06:41:26.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450124.log: /var/log/ceph/ceph-client.admin.452255.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.542086.log.gz 2023-11-28T06:41:26.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169510.log: /var/log/ceph/ceph-client.admin.314550.log: /var/log/ceph/ceph-client.admin.302664.log: gzip/var/log/ceph/ceph-client.0.98248.log: -5 --verbose --/var/log/ceph/ceph-client.admin.245435.log: /var/log/ceph/ceph-client.admin.635000.log 2023-11-28T06:41:26.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.513561.log: /var/log/ceph/ceph-client.admin.641416.log: /var/log/ceph/ceph-client.admin.317895.log: /var/log/ceph/ceph-client.admin.211109.log: /var/log/ceph/ceph-client.admin.289922.log: /var/log/ceph/ceph-client.admin.96563.log: 81.6%/var/log/ceph/ceph-client.admin.231033.log: -- replaced with /var/log/ceph/ceph-client.admin.641416.log.gz 2023-11-28T06:41:26.045 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.472345.log: -5 --verbose --/var/log/ceph/ceph-client.admin.102176.log: /var/log/ceph/ceph-client.admin.497074.log 2023-11-28T06:41:26.045 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.248083.log: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.654591.log.gz 2023-11-28T06:41:26.046 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%/var/log/ceph/ceph-client.admin.635000.log: /var/log/ceph/ceph-client.admin.96007.log: -- replaced with /var/log/ceph/ceph-client.admin.564183.log.gz 2023-11-28T06:41:26.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288013.log: 90.1% 87.7%/var/log/ceph/ceph-client.admin.470131.log: -- replaced with /var/log/ceph/ceph-client.admin.666940.log.gz 2023-11-28T06:41:26.046 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.565504.log.gz 2023-11-28T06:41:26.046 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240487.log 2023-11-28T06:41:26.046 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.558569.log.gz -- replaced with /var/log/ceph/ceph-client.admin.647183.log.gz 2023-11-28T06:41:26.046 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.502928.log: /var/log/ceph/ceph-client.admin.95839.log: /var/log/ceph/ceph-client.admin.306449.log: /var/log/ceph/ceph-client.admin.102944.log: /var/log/ceph/ceph-client.admin.252550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451794.log 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8%/var/log/ceph/ceph-client.admin.474514.log: -- replaced with /var/log/ceph/ceph-client.admin.659891.log.gz 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103166.log: /var/log/ceph/ceph-client.admin.498814.log: /var/log/ceph/ceph-client.admin.497074.log: gzip/var/log/ceph/ceph-client.admin.448368.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.184959.log 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.482869.log: 86.0%/var/log/ceph/ceph-client.admin.240487.log: -- replaced with /var/log/ceph/ceph-client.admin.561117.log.gz 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.451794.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.563333.log.gz 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.560709.log.gz 2023-11-28T06:41:26.050 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317045.log 2023-11-28T06:41:26.051 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.305609.log.gz 2023-11-28T06:41:26.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264939.log 2023-11-28T06:41:26.051 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.482373.log.gz/var/log/ceph/ceph-client.admin.317045.log: 2023-11-28T06:41:26.051 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526028.log 2023-11-28T06:41:26.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.264939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99161.log 2023-11-28T06:41:26.051 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.516268.log.gz 2023-11-28T06:41:26.052 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.526028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481061.log 2023-11-28T06:41:26.052 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.576787.log.gz 2023-11-28T06:41:26.053 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.576796.log.gz 2023-11-28T06:41:26.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99875.log 2023-11-28T06:41:26.053 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.518394.log.gz 2023-11-28T06:41:26.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461089.log 2023-11-28T06:41:26.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439850.log 2023-11-28T06:41:26.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481061.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.529446.log.gz 2023-11-28T06:41:26.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231895.log 2023-11-28T06:41:26.055 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.566803.log.gz/var/log/ceph/ceph-client.admin.439850.log: 2023-11-28T06:41:26.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183291.log 2023-11-28T06:41:26.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.570792.log.gz 2023-11-28T06:41:26.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.567637.log.gz 2023-11-28T06:41:26.056 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299639.log 2023-11-28T06:41:26.056 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231895.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.631249.log.gz 2023-11-28T06:41:26.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509571.log 2023-11-28T06:41:26.058 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183291.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.589174.log.gz 2023-11-28T06:41:26.058 INFO:teuthology.orchestra.run.smithi154.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.252550.log.gz 2023-11-28T06:41:26.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634175.log 2023-11-28T06:41:26.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.509571.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.588763.log.gz 2023-11-28T06:41:26.059 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631660.log 2023-11-28T06:41:26.060 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.634175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179014.log 2023-11-28T06:41:26.061 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.631660.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.574536.log.gz 2023-11-28T06:41:26.061 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.653725.log.gz 2023-11-28T06:41:26.062 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305618.log 2023-11-28T06:41:26.063 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236709.log 2023-11-28T06:41:26.063 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.467817.log.gz 2023-11-28T06:41:26.064 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.305618.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.228089.log.gz 2023-11-28T06:41:26.064 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312464.log 2023-11-28T06:41:26.065 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.236709.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.632078.log.gz 2023-11-28T06:41:26.065 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 79.4% /var/log/ceph/ceph-client.admin.551977.log -- replaced with /var/log/ceph/ceph-client.admin.183291.log.gz 2023-11-28T06:41:26.065 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.066 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.184542.log.gz 2023-11-28T06:41:26.066 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.312464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441514.log 2023-11-28T06:41:26.067 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.632087.log.gz 2023-11-28T06:41:26.067 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.551977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641425.log 2023-11-28T06:41:26.067 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.184134.log.gz 2023-11-28T06:41:26.068 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282928.log 2023-11-28T06:41:26.068 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.641425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594291.log 2023-11-28T06:41:26.070 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.282928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100096.log 2023-11-28T06:41:26.070 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.594291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665968.log 2023-11-28T06:41:26.071 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532407.log 2023-11-28T06:41:26.071 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.310656.log.gz 2023-11-28T06:41:26.072 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251668.log 2023-11-28T06:41:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.665968.log: /var/log/ceph/ceph-client.admin.532407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243673.log 2023-11-28T06:41:26.074 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.665968.log.gz 2023-11-28T06:41:26.074 INFO:teuthology.orchestra.run.smithi154.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.296436.log.gz 2023-11-28T06:41:26.074 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593884.log 2023-11-28T06:41:26.075 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.251668.log: /var/log/ceph/ceph-client.admin.243673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203315.log 2023-11-28T06:41:26.076 INFO:teuthology.orchestra.run.smithi154.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.641425.log.gz 2023-11-28T06:41:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.593884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511858.log 2023-11-28T06:41:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517121.log 2023-11-28T06:41:26.077 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203315.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.316218.log.gz 2023-11-28T06:41:26.078 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.511858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444875.log 2023-11-28T06:41:26.079 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.517121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615130.log 2023-11-28T06:41:26.080 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6%/var/log/ceph/ceph-client.admin.444875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439002.log 2023-11-28T06:41:26.080 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.637930.log.gz 80.4% -- replaced with /var/log/ceph/ceph-client.admin.648772.log.gz 2023-11-28T06:41:26.080 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.081 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.615130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451386.log 2023-11-28T06:41:26.082 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639222.log 2023-11-28T06:41:26.082 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439002.log: /var/log/ceph/ceph-client.admin.451386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481529.log 2023-11-28T06:41:26.083 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.639222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210177.log 2023-11-28T06:41:26.084 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237609.log 2023-11-28T06:41:26.085 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.210177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99917.log 2023-11-28T06:41:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.237609.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.453090.log.gz 2023-11-28T06:41:26.086 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593430.log 2023-11-28T06:41:26.087 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.99917.log: --verbose -- /var/log/ceph/ceph-client.admin.510964.log 2023-11-28T06:41:26.088 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.593430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666814.log 2023-11-28T06:41:26.089 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.510964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577278.log 2023-11-28T06:41:26.090 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277238.log 2023-11-28T06:41:26.091 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2%/var/log/ceph/ceph-client.admin.577278.log: -- replaced with /var/log/ceph/ceph-client.admin.666814.log.gz 2023-11-28T06:41:26.091 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.179005.log.gz 2023-11-28T06:41:26.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643179.log 2023-11-28T06:41:26.092 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.303086.log.gz 2023-11-28T06:41:26.092 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.277238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97729.log 2023-11-28T06:41:26.093 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.643179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319626.log 2023-11-28T06:41:26.094 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.97729.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.190451.log 2023-11-28T06:41:26.094 INFO:teuthology.orchestra.run.smithi154.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.233651.log.gz 2023-11-28T06:41:26.095 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486218.log 2023-11-28T06:41:26.095 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.643179.log.gz 2023-11-28T06:41:26.096 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637096.log 2023-11-28T06:41:26.097 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.486218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101204.log 2023-11-28T06:41:26.097 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.562378.log.gz 2023-11-28T06:41:26.098 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.637096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94883.log 2023-11-28T06:41:26.098 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.305618.log.gz 2023-11-28T06:41:26.098 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95419.log/var/log/ceph/ceph-client.admin.101204.log: 2023-11-28T06:41:26.099 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101492.log 2023-11-28T06:41:26.100 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453932.log 2023-11-28T06:41:26.103 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98371.log 2023-11-28T06:41:26.103 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.453932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595124.log 2023-11-28T06:41:26.104 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.264939.log.gz 2023-11-28T06:41:26.104 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595678.log 2023-11-28T06:41:26.104 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.319626.log.gz 2023-11-28T06:41:26.106 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.595124.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.497489.log.gz 2023-11-28T06:41:26.106 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 90.1% -- replaced with /var/log/ceph/ceph-client.admin.265397.log.gz 2023-11-28T06:41:26.106 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.666562.log 2023-11-28T06:41:26.107 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.595678.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.266231.log.gz 2023-11-28T06:41:26.107 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558987.log 2023-11-28T06:41:26.108 INFO:teuthology.orchestra.run.smithi154.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.317045.log.gz/var/log/ceph/ceph-client.admin.666562.log: 2023-11-28T06:41:26.108 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.524760.log.gz 2023-11-28T06:41:26.108 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512267.log 2023-11-28T06:41:26.109 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0%/var/log/ceph/ceph-client.admin.558987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509580.log 2023-11-28T06:41:26.109 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.666562.log.gz 2023-11-28T06:41:26.109 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.312464.log.gz 2023-11-28T06:41:26.110 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.512267.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.482869.log.gz 2023-11-28T06:41:26.110 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504618.log 2023-11-28T06:41:26.110 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.517121.log.gz 2023-11-28T06:41:26.111 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.509580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454755.log 2023-11-28T06:41:26.111 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.532407.log.gz 2023-11-28T06:41:26.112 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.540525.log.gz 2023-11-28T06:41:26.112 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.504618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190460.log 2023-11-28T06:41:26.113 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204150.log 2023-11-28T06:41:26.114 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95587.log 2023-11-28T06:41:26.114 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.461089.log.gz 2023-11-28T06:41:26.115 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100280.log 2023-11-28T06:41:26.116 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189145.log 2023-11-28T06:41:26.117 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564174.log 2023-11-28T06:41:26.117 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.598282.log.gz 2023-11-28T06:41:26.118 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189145.log: gzip 84.3%/var/log/ceph/ceph-client.admin.564174.log: -- replaced with /var/log/ceph/ceph-client.admin.600854.log.gz 2023-11-28T06:41:26.118 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.597874.log.gz 2023-11-28T06:41:26.119 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.568535.log 2023-11-28T06:41:26.119 INFO:teuthology.orchestra.run.smithi154.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.631660.log.gz 2023-11-28T06:41:26.120 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326404.log 2023-11-28T06:41:26.120 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.600415.log.gz 2023-11-28T06:41:26.121 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.568535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210186.log 2023-11-28T06:41:26.121 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667234.log 2023-11-28T06:41:26.122 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.210186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525597.log 2023-11-28T06:41:26.123 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.179014.log.gz 2023-11-28T06:41:26.124 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667234.log: /var/log/ceph/ceph-client.admin.525597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100978.log 2023-11-28T06:41:26.124 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.667234.log.gz 2023-11-28T06:41:26.125 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.201166.log.gz 2023-11-28T06:41:26.125 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561952.log 2023-11-28T06:41:26.125 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.634175.log.gz 2023-11-28T06:41:26.125 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.277238.log.gz 2023-11-28T06:41:26.126 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97519.log 2023-11-28T06:41:26.127 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.561952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212937.log 2023-11-28T06:41:26.127 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480628.log 2023-11-28T06:41:26.128 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97519.log: /var/log/ceph/ceph-client.admin.212937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103420.log 2023-11-28T06:41:26.129 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.639222.log.gz 2023-11-28T06:41:26.130 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480628.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.95145.log.gz -5 2023-11-28T06:41:26.130 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.457254.log 2023-11-28T06:41:26.131 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103420.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95102.log.gz 2023-11-28T06:41:26.131 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.306449.log.gz 2023-11-28T06:41:26.132 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95419.log.gz 2023-11-28T06:41:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569372.log 2023-11-28T06:41:26.132 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520125.log 2023-11-28T06:41:26.132 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.306458.log.gz 2023-11-28T06:41:26.133 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.569372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520956.log 2023-11-28T06:41:26.134 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.520125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437753.log 2023-11-28T06:41:26.136 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.520956.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.282928.log.gz 2023-11-28T06:41:26.137 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192672.log 2023-11-28T06:41:26.138 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96560.log.gz 2023-11-28T06:41:26.138 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96559.log.gz 2023-11-28T06:41:26.139 INFO:teuthology.orchestra.run.smithi154.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.236282.log.gz 2023-11-28T06:41:26.139 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452681.log 2023-11-28T06:41:26.140 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96893.log.gz 2023-11-28T06:41:26.142 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449211.log 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.211109.log.gz 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527313.log 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.452681.log: /var/log/ceph/ceph-client.admin.449211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584847.log 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.527313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660331.log 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.444875.log.gz 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.584847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96227.log 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.660331.log: gzip 78.3% -- replaced with /var/log/ceph/ceph-client.admin.258518.log.gz 2023-11-28T06:41:26.143 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.446983.log 2023-11-28T06:41:26.144 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204572.log 2023-11-28T06:41:26.145 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.446983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244989.log 2023-11-28T06:41:26.145 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499256.log 2023-11-28T06:41:26.145 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97519.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97603.log.gz 2023-11-28T06:41:26.146 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.146 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586595.log 2023-11-28T06:41:26.147 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98865.log.gz 2023-11-28T06:41:26.147 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98371.log.gz 2023-11-28T06:41:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.499256.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99161.log.gz 2023-11-28T06:41:26.147 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231440.log 2023-11-28T06:41:26.148 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.586595.log: 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.99749.log.gz 2023-11-28T06:41:26.149 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.291767.log 2023-11-28T06:41:26.149 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99875.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99917.log.gz 2023-11-28T06:41:26.149 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231440.log: 89.6% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100096.log.gz -- replaced with /var/log/ceph/ceph-client.admin.100280.log.gz 2023-11-28T06:41:26.150 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.150 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210692.log 2023-11-28T06:41:26.150 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.189145.log.gz 2023-11-28T06:41:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542095.log 2023-11-28T06:41:26.151 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.210692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538804.log 2023-11-28T06:41:26.152 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588272.log 2023-11-28T06:41:26.153 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.542095.log: /var/log/ceph/ceph-client.admin.538804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506321.log 2023-11-28T06:41:26.153 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.660331.log.gz 2023-11-28T06:41:26.154 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.588272.log: -- /var/log/ceph/ceph-client.admin.502937.log 2023-11-28T06:41:26.155 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.506321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648519.log 2023-11-28T06:41:26.155 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173484.log 2023-11-28T06:41:26.156 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.502937.log: /var/log/ceph/ceph-client.admin.648519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101450.log 2023-11-28T06:41:26.157 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250320.log 2023-11-28T06:41:26.158 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173484.log: /var/log/ceph/ceph-client.admin.101450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234526.log 2023-11-28T06:41:26.158 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.250320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468692.log 2023-11-28T06:41:26.160 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234526.log: gzip -5 --verbose 91.9% -- replaced with /var/log/ceph/ceph-client.admin.478771.log.gz 2023-11-28T06:41:26.160 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.437326.log.gz 2023-11-28T06:41:26.161 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.328706.log 2023-11-28T06:41:26.161 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.468692.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.648519.log.gz 2023-11-28T06:41:26.161 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520965.log 2023-11-28T06:41:26.162 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291358.log 2023-11-28T06:41:26.163 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.520965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506747.log 2023-11-28T06:41:26.164 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.291358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271470.log 2023-11-28T06:41:26.164 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.506747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234972.log 2023-11-28T06:41:26.165 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186210.log 2023-11-28T06:41:26.166 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.271470.log: /var/log/ceph/ceph-client.admin.234972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100610.log 2023-11-28T06:41:26.167 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595133.log 2023-11-28T06:41:26.168 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186210.log: /var/log/ceph/ceph-client.admin.100610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199837.log 2023-11-28T06:41:26.170 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.595133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662977.log 2023-11-28T06:41:26.170 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.199837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202890.log 2023-11-28T06:41:26.171 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.662977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633757.log 2023-11-28T06:41:26.171 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.662977.log.gz 2023-11-28T06:41:26.171 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162508.log 2023-11-28T06:41:26.172 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.633757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297287.log 2023-11-28T06:41:26.173 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180775.log 2023-11-28T06:41:26.174 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461925.log 2023-11-28T06:41:26.175 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297287.log: /var/log/ceph/ceph-client.admin.180775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666772.log 2023-11-28T06:41:26.176 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590843.log 2023-11-28T06:41:26.177 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252559.log 2023-11-28T06:41:26.178 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.666772.log.gz 2023-11-28T06:41:26.178 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.590843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520116.log 2023-11-28T06:41:26.179 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.252559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540516.log 2023-11-28T06:41:26.180 INFO:teuthology.orchestra.run.smithi154.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.204572.log.gz 2023-11-28T06:41:26.180 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.520116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99203.log 2023-11-28T06:41:26.181 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.540516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594300.log 2023-11-28T06:41:26.182 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.99203.log: --verbose -- /var/log/ceph/ceph-client.admin.508451.log 2023-11-28T06:41:26.183 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.594300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282084.log 2023-11-28T06:41:26.184 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.508451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290941.log 2023-11-28T06:41:26.185 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.282084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584403.log 2023-11-28T06:41:26.187 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.290941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262296.log 2023-11-28T06:41:26.187 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.584403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554518.log 2023-11-28T06:41:26.188 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.262296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592115.log 2023-11-28T06:41:26.188 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.554518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590852.log 2023-11-28T06:41:26.189 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.261455.log.gz 2023-11-28T06:41:26.189 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.592115.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.314133.log 2023-11-28T06:41:26.191 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.590852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581432.log 2023-11-28T06:41:26.191 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251222.log 2023-11-28T06:41:26.192 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314133.log: /var/log/ceph/ceph-client.admin.581432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176475.log 2023-11-28T06:41:26.193 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.251222.log: -5 81.2% -- replaced with /var/log/ceph/ceph-client.admin.594291.log.gz 2023-11-28T06:41:26.193 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.245426.log 2023-11-28T06:41:26.194 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176475.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.595124.log.gz 2023-11-28T06:41:26.194 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161576.log 2023-11-28T06:41:26.195 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.593884.log.gz 2023-11-28T06:41:26.195 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250331.log 2023-11-28T06:41:26.196 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.245426.log: /var/log/ceph/ceph-client.admin.161576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99623.log 2023-11-28T06:41:26.197 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.250331.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.516699.log 2023-11-28T06:41:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445707.log 2023-11-28T06:41:26.198 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303930.log 2023-11-28T06:41:26.199 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.516699.log: /var/log/ceph/ceph-client.admin.445707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558114.log 2023-11-28T06:41:26.200 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630405.log 2023-11-28T06:41:26.201 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303930.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.558987.log.gz 2023-11-28T06:41:26.201 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.558114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642751.log 2023-11-28T06:41:26.202 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.291767.log.gz 2023-11-28T06:41:26.202 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.630405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576369.log 2023-11-28T06:41:26.204 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.642751.log: gzip -5 --verbose -- 90.0% -- replaced with /var/log/ceph/ceph-client.admin.291358.log.gz 2023-11-28T06:41:26.204 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.178180.log 80.3% -- replaced with /var/log/ceph/ceph-client.admin.642751.log.gz 2023-11-28T06:41:26.204 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.206 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.576369.log: gzip -5 --verbose 85.3% -- replaced with /var/log/ceph/ceph-client.admin.561952.log.gz 2023-11-28T06:41:26.206 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.96564.log 2023-11-28T06:41:26.206 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% 84.2% -- replaced with /var/log/ceph/ceph-client.admin.499685.log.gz 2023-11-28T06:41:26.206 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.499256.log.gz 2023-11-28T06:41:26.207 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178180.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.504618.log.gz 2023-11-28T06:41:26.208 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.457254.log.gz 2023-11-28T06:41:26.208 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% 93.9% -- replaced with /var/log/ceph/ceph-client.admin.236709.log.gz 2023-11-28T06:41:26.208 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.520956.log.gz 2023-11-28T06:41:26.208 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.564174.log.gz 2023-11-28T06:41:26.208 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.527313.log.gz 2023-11-28T06:41:26.209 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666136.log 2023-11-28T06:41:26.209 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.320044.log.gz 2023-11-28T06:41:26.209 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.520116.log.gz 2023-11-28T06:41:26.210 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.569372.log.gz 2023-11-28T06:41:26.210 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290378.log 2023-11-28T06:41:26.211 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.568535.log.gz 2023-11-28T06:41:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632913.log 2023-11-28T06:41:26.211 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.666136.log.gz 2023-11-28T06:41:26.211 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.290378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276351.log 2023-11-28T06:41:26.212 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.632913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244084.log 2023-11-28T06:41:26.213 INFO:teuthology.orchestra.run.smithi154.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.512267.log.gz 2023-11-28T06:41:26.213 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.276351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264072.log 2023-11-28T06:41:26.214 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576378.log 2023-11-28T06:41:26.215 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.264072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191802.log 2023-11-28T06:41:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326413.log 2023-11-28T06:41:26.216 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.576378.log: /var/log/ceph/ceph-client.admin.191802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267055.log 2023-11-28T06:41:26.217 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447415.log 2023-11-28T06:41:26.219 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.635834.log.gz 2023-11-28T06:41:26.219 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.267055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582268.log 2023-11-28T06:41:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470612.log 2023-11-28T06:41:26.221 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447415.log: /var/log/ceph/ceph-client.admin.582268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103672.log 2023-11-28T06:41:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.470612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450133.log 2023-11-28T06:41:26.222 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646344.log 2023-11-28T06:41:26.223 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103672.log: /var/log/ceph/ceph-client.admin.450133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96897.log 2023-11-28T06:41:26.223 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.178180.log.gz 2023-11-28T06:41:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.646344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237600.log 2023-11-28T06:41:26.226 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.453506.log.gz 2023-11-28T06:41:26.226 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474523.log 2023-11-28T06:41:26.227 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.237600.log: 90.0% 84.5% -- replaced with /var/log/ceph/ceph-client.admin.299639.log.gz 2023-11-28T06:41:26.228 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.646344.log.gz 2023-11-28T06:41:26.228 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453099.log 2023-11-28T06:41:26.228 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474523.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.308968.log.gz 2023-11-28T06:41:26.229 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250767.log 2023-11-28T06:41:26.229 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.453099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506738.log 2023-11-28T06:41:26.230 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.250767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500574.log 2023-11-28T06:41:26.230 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.190451.log.gz 2023-11-28T06:41:26.231 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.506738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577707.log 2023-11-28T06:41:26.231 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.192672.log.gz 2023-11-28T06:41:26.232 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.500574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528166.log 2023-11-28T06:41:26.233 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.577707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174429.log 2023-11-28T06:41:26.234 INFO:teuthology.orchestra.run.smithi194.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T06:41:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.528166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487658.log 2023-11-28T06:41:26.235 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.454755.log.gz 2023-11-28T06:41:26.235 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311082.log/var/log/ceph/ceph-client.admin.174429.log: 2023-11-28T06:41:26.236 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.234972.log.gz 2023-11-28T06:41:26.236 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.234526.log.gz 2023-11-28T06:41:26.236 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258110.log 2023-11-28T06:41:26.237 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643170.log 2023-11-28T06:41:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311082.log: /var/log/ceph/ceph-client.admin.258110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309812.log 2023-11-28T06:41:26.238 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.643170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304769.log 2023-11-28T06:41:26.240 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6%/var/log/ceph/ceph-client.admin.309812.log: -- replaced with /var/log/ceph/ceph-client.admin.643170.log.gzgzip 2023-11-28T06:41:26.240 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.526028.log.gz 2023-11-28T06:41:26.240 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.553684.log 2023-11-28T06:41:26.241 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241747.log 2023-11-28T06:41:26.242 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.553684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587857.log 2023-11-28T06:41:26.243 INFO:teuthology.orchestra.run.smithi154.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.250320.log.gz 2023-11-28T06:41:26.243 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.250767.log.gz 2023-11-28T06:41:26.243 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564600.log 2023-11-28T06:41:26.244 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.587857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581006.log 2023-11-28T06:41:26.245 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.564600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436905.log 2023-11-28T06:41:26.246 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.581006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503354.log 2023-11-28T06:41:26.247 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569791.log 2023-11-28T06:41:26.250 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103504.log.gz 2023-11-28T06:41:26.250 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103546.log.gz 2023-11-28T06:41:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.503354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101828.log 2023-11-28T06:41:26.250 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.569791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102632.log 2023-11-28T06:41:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102218.log 2023-11-28T06:41:26.251 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476666.log 2023-11-28T06:41:26.252 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518826.log 2023-11-28T06:41:26.252 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102218.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101492.log.gz 2023-11-28T06:41:26.253 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202466.log 2023-11-28T06:41:26.254 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596608.log/var/log/ceph/ceph-client.admin.518826.log: 2023-11-28T06:41:26.255 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243218.log 2023-11-28T06:41:26.255 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168203.log 2023-11-28T06:41:26.257 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.596608.log: /var/log/ceph/ceph-client.admin.243218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248074.log 2023-11-28T06:41:26.257 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.231440.log.gz 2023-11-28T06:41:26.257 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.231886.log.gz 2023-11-28T06:41:26.257 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178171.log 2023-11-28T06:41:26.258 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.232807.log.gz 2023-11-28T06:41:26.259 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.248074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661191.log 2023-11-28T06:41:26.259 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521825.log 2023-11-28T06:41:26.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.661191.log: gzip 77.8% -- replaced with /var/log/ceph/ceph-client.admin.237150.log.gz -5 2023-11-28T06:41:26.261 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.275868.log 2023-11-28T06:41:26.261 INFO:teuthology.orchestra.run.smithi154.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.237600.log.gz 2023-11-28T06:41:26.262 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.661191.log.gz 2023-11-28T06:41:26.262 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.521825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533241.log 2023-11-28T06:41:26.262 INFO:teuthology.orchestra.run.smithi154.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.246318.log.gz 2023-11-28T06:41:26.263 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.275868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300094.log 2023-11-28T06:41:26.263 INFO:teuthology.orchestra.run.smithi154.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.252996.log.gz 2023-11-28T06:41:26.263 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.533241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228080.log 2023-11-28T06:41:26.264 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.300094.log: --verbose -- /var/log/ceph/ceph-client.admin.514400.log 2023-11-28T06:41:26.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514411.log 2023-11-28T06:41:26.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.514400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94979.log 2023-11-28T06:41:26.268 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.257693.log.gz 2023-11-28T06:41:26.268 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103420.log.gz 2023-11-28T06:41:26.268 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.514411.log: gzip 90.1% -- replaced with /var/log/ceph/ceph-client.admin.258110.log.gz 2023-11-28T06:41:26.268 INFO:teuthology.orchestra.run.smithi154.stderr: -5 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96227.log.gz 2023-11-28T06:41:26.268 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.287572.log 2023-11-28T06:41:26.269 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.94979.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96564.log.gz 2023-11-28T06:41:26.269 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96897.log.gz 2023-11-28T06:41:26.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234535.log 2023-11-28T06:41:26.271 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99371.log.gz 2023-11-28T06:41:26.271 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.436905.log.gz/var/log/ceph/ceph-client.admin.287572.log: 2023-11-28T06:41:26.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205501.log 2023-11-28T06:41:26.271 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.185802.log.gz 2023-11-28T06:41:26.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561961.log 2023-11-28T06:41:26.272 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99017.log 2023-11-28T06:41:26.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.561961.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.576369.log.gz 2023-11-28T06:41:26.275 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193094.log 2023-11-28T06:41:26.275 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.576378.log.gz 2023-11-28T06:41:26.275 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448377.log 2023-11-28T06:41:26.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542862.log 2023-11-28T06:41:26.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.448377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179852.log 2023-11-28T06:41:26.279 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.542862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642270.log 2023-11-28T06:41:26.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.179852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242620.log 2023-11-28T06:41:26.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.642270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280818.log 2023-11-28T06:41:26.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462778.log 2023-11-28T06:41:26.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.280818.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.237609.log.gz 2023-11-28T06:41:26.285 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646761.log 2023-11-28T06:41:26.286 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.462778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444884.log 2023-11-28T06:41:26.287 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.646761.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.264072.log.gz 2023-11-28T06:41:26.287 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 81.2% -- replaced with /var/log/ceph/ceph-client.admin.646761.log.gz 2023-11-28T06:41:26.288 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.464463.log 2023-11-28T06:41:26.288 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444884.log: 81.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.303930.log.gz 2023-11-28T06:41:26.289 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.568054.log 2023-11-28T06:41:26.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654175.log 2023-11-28T06:41:26.291 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.290378.log.gz 2023-11-28T06:41:26.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.568054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437744.log 2023-11-28T06:41:26.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.654175.log: gzip -5 --verbose -- 81.0% -- replaced with /var/log/ceph/ceph-client.admin.304769.log.gz 2023-11-28T06:41:26.293 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.655482.log 2023-11-28T06:41:26.293 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.314133.log.gz 2023-11-28T06:41:26.294 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.437744.log: gzip -5 --verbose -- 89.7% -- replaced with /var/log/ceph/ceph-client.admin.654175.log.gz 2023-11-28T06:41:26.294 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.123965.log 2023-11-28T06:41:26.295 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.655482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571758.log 2023-11-28T06:41:26.295 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.282084.log.gz 2023-11-28T06:41:26.297 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.506738.log.gz 2023-11-28T06:41:26.297 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.205501.log.gz 2023-11-28T06:41:26.297 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.642270.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589183.log 2023-11-28T06:41:26.297 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.297 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.561961.log.gz 2023-11-28T06:41:26.298 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123965.log: 81.2% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.312046.log.gz 2023-11-28T06:41:26.298 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.327723.log.gz 2023-11-28T06:41:26.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.571758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476258.log 2023-11-28T06:41:26.299 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.446123.log.gz 2023-11-28T06:41:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514253.log 2023-11-28T06:41:26.300 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.589183.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.447920.log.gz 2023-11-28T06:41:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476258.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.521825.log.gz 2023-11-28T06:41:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321317.log 2023-11-28T06:41:26.301 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.514253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439841.log 2023-11-28T06:41:26.303 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321317.log: gzip 93.3% -- replaced with /var/log/ceph/ceph-client.admin.262296.log.gz 2023-11-28T06:41:26.303 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.457680.log 2023-11-28T06:41:26.303 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.533241.log.gz 2023-11-28T06:41:26.303 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439841.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.571758.log.gz 2023-11-28T06:41:26.304 INFO:teuthology.orchestra.run.smithi154.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.210692.log.gz 2023-11-28T06:41:26.304 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99329.log 2023-11-28T06:41:26.305 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209227.log 2023-11-28T06:41:26.306 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88905.log 2023-11-28T06:41:26.307 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.209227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666052.log 2023-11-28T06:41:26.307 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.655482.log.gz 2023-11-28T06:41:26.308 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.326404.log.gz 2023-11-28T06:41:26.308 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.88905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440684.log 2023-11-28T06:41:26.309 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327732.log 89.6% 2023-11-28T06:41:26.309 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.326413.log.gz 2023-11-28T06:41:26.310 INFO:teuthology.orchestra.run.smithi154.stderr: 87.2%/var/log/ceph/ceph-client.admin.440684.log: -- replaced with /var/log/ceph/ceph-client.admin.666052.log.gz 2023-11-28T06:41:26.310 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642760.log 2023-11-28T06:41:26.311 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.327732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307293.log 2023-11-28T06:41:26.311 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.500574.log.gz 2023-11-28T06:41:26.312 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.642760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462350.log 2023-11-28T06:41:26.312 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.443193.log.gz 2023-11-28T06:41:26.313 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.307293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96763.log 2023-11-28T06:41:26.314 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.462350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629571.log 2023-11-28T06:41:26.314 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.642760.log.gz 2023-11-28T06:41:26.315 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438162.log 2023-11-28T06:41:26.316 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.629571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227666.log 2023-11-28T06:41:26.317 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167794.log 2023-11-28T06:41:26.317 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.227666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315375.log 2023-11-28T06:41:26.319 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497065.log 2023-11-28T06:41:26.320 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167794.log: /var/log/ceph/ceph-client.admin.315375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658131.log 2023-11-28T06:41:26.321 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.497065.log: gzip 80.7% -- replaced with /var/log/ceph/ceph-client.admin.274393.log.gz 2023-11-28T06:41:26.321 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.330843.log 2023-11-28T06:41:26.322 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.658131.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.444884.log.gz 2023-11-28T06:41:26.323 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 90.1% -- replaced with /var/log/ceph/ceph-client.admin.445300.log.gz 2023-11-28T06:41:26.323 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95503.log 2023-11-28T06:41:26.324 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205510.log 2023-11-28T06:41:26.326 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95503.log: gzip -5 81.9% --verbose -- /var/log/ceph/ceph-client.admin.284638.log 2023-11-28T06:41:26.327 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.586595.log.gz 2023-11-28T06:41:26.327 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.243218.log.gz 2023-11-28T06:41:26.328 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205510.log: -- replaced with /var/log/ceph/ceph-client.admin.240904.log.gz 2023-11-28T06:41:26.328 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.228080.log.gz 2023-11-28T06:41:26.328 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329994.log 2023-11-28T06:41:26.329 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659011.log 2023-11-28T06:41:26.329 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.321317.log.gz 2023-11-28T06:41:26.329 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261874.log 2023-11-28T06:41:26.330 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329994.log: /var/log/ceph/ceph-client.admin.659011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519694.log 2023-11-28T06:41:26.331 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.658131.log.gz 2023-11-28T06:41:26.331 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.261874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596131.log 2023-11-28T06:41:26.332 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.519694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565924.log 2023-11-28T06:41:26.333 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.275868.log.gz 2023-11-28T06:41:26.333 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.596131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236700.log 2023-11-28T06:41:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.565924.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.315792.log.gz 2023-11-28T06:41:26.334 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82593.log 2023-11-28T06:41:26.335 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.236700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99245.log 2023-11-28T06:41:26.336 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.tmp-client.admin.82593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160555.log 2023-11-28T06:41:26.336 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82593.log.gz 2023-11-28T06:41:26.337 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651123.log 2023-11-28T06:41:26.338 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.160555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523085.log 2023-11-28T06:41:26.339 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.651123.log: gzip 92.0% -- replaced with /var/log/ceph/ceph-client.admin.659011.log.gz 2023-11-28T06:41:26.339 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.651123.log.gz 2023-11-28T06:41:26.340 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.523085.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.563766.log 2023-11-28T06:41:26.340 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101660.log.gz 2023-11-28T06:41:26.341 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567211.log 2023-11-28T06:41:26.342 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.563766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183717.log 2023-11-28T06:41:26.343 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.567211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630414.log 2023-11-28T06:41:26.343 INFO:teuthology.orchestra.run.smithi154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95923.log.gz 2023-11-28T06:41:26.344 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270175.log 2023-11-28T06:41:26.344 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186627.log.gz -- replaced with /var/log/ceph/ceph-client.admin.96900.log.gz 2023-11-28T06:41:26.344 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.345 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.630414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187474.log 2023-11-28T06:41:26.346 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102218.log.gz 2023-11-28T06:41:26.346 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.187465.log.gz 2023-11-28T06:41:26.346 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.270175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662079.log 2023-11-28T06:41:26.347 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202899.log 2023-11-28T06:41:26.348 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.662079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456003.log 2023-11-28T06:41:26.348 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.484716.log.gz 2023-11-28T06:41:26.349 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202899.log: gzip 93.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.244989.log.gz -- 2023-11-28T06:41:26.349 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.572658.log 2023-11-28T06:41:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456003.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.437744.log.gz 2023-11-28T06:41:26.350 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282501.log 2023-11-28T06:41:26.351 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.200334.log.gz 2023-11-28T06:41:26.351 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.572658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597457.log 2023-11-28T06:41:26.351 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.307293.log.gz 2023-11-28T06:41:26.352 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.282501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310243.log 2023-11-28T06:41:26.353 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.597457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644969.log 2023-11-28T06:41:26.354 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562801.log 2023-11-28T06:41:26.355 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.644969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202475.log 2023-11-28T06:41:26.356 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.662079.log.gz 2023-11-28T06:41:26.356 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.562801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555826.log 2023-11-28T06:41:26.357 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.202475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311073.log 2023-11-28T06:41:26.358 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.555826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303095.log 2023-11-28T06:41:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97225.log 2023-11-28T06:41:26.363 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303095.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.514400.log.gz 2023-11-28T06:41:26.364 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 90.0% /var/log/ceph/ceph-client.admin.450541.log 2023-11-28T06:41:26.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97225.log: -- replaced with /var/log/ceph/ceph-client.admin.464463.log.gz 2023-11-28T06:41:26.364 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308133.log 2023-11-28T06:41:26.364 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485725.log 2023-11-28T06:41:26.364 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.267055.log.gz 2023-11-28T06:41:26.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663892.log 2023-11-28T06:41:26.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.485725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258944.log 2023-11-28T06:41:26.366 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.663892.log: gzip -5 79.6% -- replaced with /var/log/ceph/ceph-client.admin.663892.log.gz 2023-11-28T06:41:26.366 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.666898.log 2023-11-28T06:41:26.368 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.258944.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.266222.log.gz 2023-11-28T06:41:26.368 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565915.log 2023-11-28T06:41:26.368 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.270175.log.gz/var/log/ceph/ceph-client.admin.666898.log: 2023-11-28T06:41:26.368 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.497065.log.gz 2023-11-28T06:41:26.370 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.303095.log.gz 2023-11-28T06:41:26.370 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.329994.log.gz 2023-11-28T06:41:26.370 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.666898.log.gz 2023-11-28T06:41:26.370 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.565915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230606.log 90.0% -- replaced with /var/log/ceph/ceph-client.admin.330843.log.gz 2023-11-28T06:41:26.371 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.439841.log.gz 2023-11-28T06:41:26.371 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.372 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253899.log 2023-11-28T06:41:26.373 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6%/var/log/ceph/ceph-client.admin.230606.log: -- replaced with /var/log/ceph/ceph-client.admin.161996.log.gz 2023-11-28T06:41:26.373 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.276351.log.gz 2023-11-28T06:41:26.373 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563342.log 2023-11-28T06:41:26.374 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.440684.log.gz 2023-11-28T06:41:26.375 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.464876.log.gz 81.5% 2023-11-28T06:41:26.377 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.489090.log.gz 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.211535.log 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.513138.log.gz 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.523085.log.gz 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.519694.log.gz 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.563342.log: /var/log/ceph/ceph-client.admin.253899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649014.log 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.514253.log.gz 2023-11-28T06:41:26.378 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.555826.log.gz/var/log/ceph/ceph-client.admin.211535.log: 2023-11-28T06:41:26.379 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.563766.log.gz 2023-11-28T06:41:26.379 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188723.log 2023-11-28T06:41:26.379 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.649014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543293.log 2023-11-28T06:41:26.380 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232816.log 2023-11-28T06:41:26.380 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.543293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580586.log 2023-11-28T06:41:26.380 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.649014.log.gz 2023-11-28T06:41:26.380 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255182.log 2023-11-28T06:41:26.381 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.565915.log.gz 2023-11-28T06:41:26.381 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.580586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317054.log 2023-11-28T06:41:26.383 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.317054.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.573253.log.gz 2023-11-28T06:41:26.385 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.211943.log.gz 2023-11-28T06:41:26.386 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.255182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557266.log 2023-11-28T06:41:26.387 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 83.8% -- replaced with /var/log/ceph/ceph-client.admin.249858.log.gz 2023-11-28T06:41:26.387 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.250331.log.gz 2023-11-28T06:41:26.387 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.211535.log.gz 2023-11-28T06:41:26.387 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.256016.log.gz 2023-11-28T06:41:26.387 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544117.log 2023-11-28T06:41:26.388 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.329158.log.gz 2023-11-28T06:41:26.388 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.557266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559445.log 2023-11-28T06:41:26.389 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.544117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203742.log 2023-11-28T06:41:26.390 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.559445.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.193094.log.gz 2023-11-28T06:41:26.391 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499694.log 2023-11-28T06:41:26.392 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.203742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327268.log 2023-11-28T06:41:26.393 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.499694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308546.log 2023-11-28T06:41:26.394 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276799.log 2023-11-28T06:41:26.395 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.327268.log: /var/log/ceph/ceph-client.admin.308546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664777.log 2023-11-28T06:41:26.396 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.276799.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.531958.log 2023-11-28T06:41:26.397 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.664777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609420.log 2023-11-28T06:41:26.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.531958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209727.log 2023-11-28T06:41:26.399 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.664777.log.gz 2023-11-28T06:41:26.399 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.609420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665758.log 2023-11-28T06:41:26.401 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.209727.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.308977.log 2023-11-28T06:41:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.665758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635417.log 2023-11-28T06:41:26.403 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.475824.log.gz 2023-11-28T06:41:26.403 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.665758.log.gz 2023-11-28T06:41:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308977.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.485725.log.gz 2023-11-28T06:41:26.403 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649861.log 2023-11-28T06:41:26.404 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.635417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311529.log 2023-11-28T06:41:26.405 INFO:teuthology.orchestra.run.smithi154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88905.log.gz 2023-11-28T06:41:26.406 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.649861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95755.log 2023-11-28T06:41:26.407 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620523.log 2023-11-28T06:41:26.408 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244534.log 2023-11-28T06:41:26.409 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.620523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241330.log 2023-11-28T06:41:26.411 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460680.log 2023-11-28T06:41:26.412 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240913.log 2023-11-28T06:41:26.413 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505480.log 92.2% -- replaced with /var/log/ceph/ceph-client.admin.649861.log.gz 2023-11-28T06:41:26.413 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.240913.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.123965.log.gz 2023-11-28T06:41:26.414 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321326.log 2023-11-28T06:41:26.415 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.505480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539648.log 2023-11-28T06:41:26.416 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95060.log 2023-11-28T06:41:26.417 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.259771.log.gz/var/log/ceph/ceph-client.admin.539648.log: 2023-11-28T06:41:26.417 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471102.log 2023-11-28T06:41:26.418 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558105.log 2023-11-28T06:41:26.418 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95755.log.gz 2023-11-28T06:41:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471102.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95503.log.gz 2023-11-28T06:41:26.419 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477101.log 2023-11-28T06:41:26.420 INFO:teuthology.orchestra.run.smithi154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.2.98743.log.gz 2023-11-28T06:41:26.420 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.558105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592124.log 2023-11-28T06:41:26.421 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.258944.log.gz 2023-11-28T06:41:26.421 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584394.log 2023-11-28T06:41:26.422 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.592124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649427.log 2023-11-28T06:41:26.423 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.584394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572649.log 2023-11-28T06:41:26.424 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97225.log.gz 2023-11-28T06:41:26.424 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97267.log.gz 2023-11-28T06:41:26.424 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211952.log 2023-11-28T06:41:26.424 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.230606.log.gz 2023-11-28T06:41:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.649427.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.182874.log.gz 2023-11-28T06:41:26.425 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 84.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.649427.log.gz 2023-11-28T06:41:26.426 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.629163.log 2023-11-28T06:41:26.426 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.572649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281667.log 2023-11-28T06:41:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.211952.log: 81.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260618.log 2023-11-28T06:41:26.428 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.450541.log.gz 2023-11-28T06:41:26.428 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.629163.log: 81.6% 78.2% -- replaced with /var/log/ceph/ceph-client.admin.176030.log.gz 2023-11-28T06:41:26.428 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188723.log.gz 2023-11-28T06:41:26.429 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.308124.log.gz 2023-11-28T06:41:26.429 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.281667.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.311073.log.gz 2023-11-28T06:41:26.429 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.183717.log.gz 2023-11-28T06:41:26.430 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.202899.log.gz 2023-11-28T06:41:26.431 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450960.log 2023-11-28T06:41:26.431 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.187474.log.gz 2023-11-28T06:41:26.431 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.310243.log.gz 2023-11-28T06:41:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.260618.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.187892.log.gz 2023-11-28T06:41:26.432 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667400.log 2023-11-28T06:41:26.433 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271896.log 2023-11-28T06:41:26.434 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664338.log 2023-11-28T06:41:26.435 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4%/var/log/ceph/ceph-client.admin.271896.log: -- replaced with /var/log/ceph/ceph-client.admin.667400.log.gz 2023-11-28T06:41:26.435 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.96566.log 2023-11-28T06:41:26.436 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101288.log.gz 2023-11-28T06:41:26.437 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.664338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102590.log 2023-11-28T06:41:26.437 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.664338.log.gz 2023-11-28T06:41:26.438 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96566.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-28T06:41:26.440 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583102.log 2023-11-28T06:41:26.440 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94979.log.gz 2023-11-28T06:41:26.441 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591277.log 2023-11-28T06:41:26.442 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.583102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631669.log 2023-11-28T06:41:26.443 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.591277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97435.log 2023-11-28T06:41:26.445 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.631669.log: gzip -5 90.1% -- replaced with /var/log/ceph/ceph-client.admin.260618.log.gz 2023-11-28T06:41:26.445 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.265388.log.gz 2023-11-28T06:41:26.446 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.256850.log 2023-11-28T06:41:26.446 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481964.log 2023-11-28T06:41:26.448 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.501848.log.gz 2023-11-28T06:41:26.448 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 85.2% -- replaced with /var/log/ceph/ceph-client.admin.558105.log.gz 2023-11-28T06:41:26.448 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.195700.log 2023-11-28T06:41:26.448 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.256850.log: /var/log/ceph/ceph-client.admin.481964.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.559445.log.gz 2023-11-28T06:41:26.450 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.195700.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.189576.log 2023-11-28T06:41:26.451 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.580586.log.gz 81.8% -- replaced with /var/log/ceph/ceph-client.admin.584394.log.gz 2023-11-28T06:41:26.453 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.455 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.317054.log.gz 2023-11-28T06:41:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651541.log 2023-11-28T06:41:26.455 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652878.log 2023-11-28T06:41:26.455 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.309390.log.gz 2023-11-28T06:41:26.456 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.651541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101162.log 2023-11-28T06:41:26.456 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.651541.log.gz 2023-11-28T06:41:26.456 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.308977.log.gz 2023-11-28T06:41:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.652878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235399.log 2023-11-28T06:41:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167263.log 2023-11-28T06:41:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522242.log 2023-11-28T06:41:26.460 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.652878.log.gz 2023-11-28T06:41:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167263.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.539648.log.gz 2023-11-28T06:41:26.460 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459839.log 2023-11-28T06:41:26.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.522242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267889.log 2023-11-28T06:41:26.462 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454764.log 2023-11-28T06:41:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.267889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459830.log 2023-11-28T06:41:26.464 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540941.log 2023-11-28T06:41:26.465 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248975.log 2023-11-28T06:41:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.540941.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.572649.log.gz 2023-11-28T06:41:26.466 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308555.log 2023-11-28T06:41:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.248975.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.557266.log.gz 2023-11-28T06:41:26.467 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329576.log 2023-11-28T06:41:26.468 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.597040.log.gz 2023-11-28T06:41:26.468 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.308555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168685.log 2023-11-28T06:41:26.469 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511385.log 2023-11-28T06:41:26.470 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.591277.log.gz 2023-11-28T06:41:26.470 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484208.log 2023-11-28T06:41:26.471 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.487186.log.gz 2023-11-28T06:41:26.471 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168685.log: /var/log/ceph/ceph-client.admin.511385.log: gzip -5 --verbose -- 93.3% /var/log/ceph/ceph-client.admin.655033.log -- replaced with /var/log/ceph/ceph-client.admin.234535.log.gz 2023-11-28T06:41:26.471 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.472 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.481964.log.gz 2023-11-28T06:41:26.472 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279148.log 2023-11-28T06:41:26.473 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.655033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191793.log 2023-11-28T06:41:26.475 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.655033.log.gz 2023-11-28T06:41:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.279148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228497.log 2023-11-28T06:41:26.475 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637513.log 2023-11-28T06:41:26.476 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.271896.log.gz 2023-11-28T06:41:26.477 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.191793.log: /var/log/ceph/ceph-client.admin.228497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501439.log 2023-11-28T06:41:26.478 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.637513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269758.log 2023-11-28T06:41:26.479 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.501439.log: gzip -5 --verbose -- 77.9% /var/log/ceph/ceph-client.admin.529859.log 2023-11-28T06:41:26.479 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.179843.log.gz 2023-11-28T06:41:26.480 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7%/var/log/ceph/ceph-client.admin.269758.log: -- replaced with /var/log/ceph/ceph-client.admin.631669.log.gz 2023-11-28T06:41:26.481 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250776.log 2023-11-28T06:41:26.481 INFO:teuthology.orchestra.run.smithi154.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.167263.log.gz 2023-11-28T06:41:26.482 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.529859.log: gzip/var/log/ceph/ceph-client.admin.250776.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.195700.log.gz 2023-11-28T06:41:26.483 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.502347.log 2023-11-28T06:41:26.483 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.446974.log.gz 2023-11-28T06:41:26.483 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.449202.log.gz 2023-11-28T06:41:26.485 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% 78.9% -- replaced with /var/log/ceph/ceph-client.admin.279557.log.gz 2023-11-28T06:41:26.485 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.450960.log.gz 2023-11-28T06:41:26.485 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.463195.log.gz 2023-11-28T06:41:26.486 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533232.log 2023-11-28T06:41:26.486 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.281667.log.gz 2023-11-28T06:41:26.487 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.502347.log: gzip 89.9% -- replaced with /var/log/ceph/ceph-client.admin.279148.log.gz 2023-11-28T06:41:26.487 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.469654.log 2023-11-28T06:41:26.488 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.533232.log: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.209727.log.gz 2023-11-28T06:41:26.488 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.256850.log.gz 2023-11-28T06:41:26.488 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.257267.log.gz 2023-11-28T06:41:26.488 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320035.log 2023-11-28T06:41:26.489 INFO:teuthology.orchestra.run.smithi154.stderr: 79.0%/var/log/ceph/ceph-client.admin.469654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123923.log 2023-11-28T06:41:26.489 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.228497.log.gz 2023-11-28T06:41:26.489 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.467400.log.gz 90.0% 2023-11-28T06:41:26.489 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.240913.log.gz 2023-11-28T06:41:26.491 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288875.log 2023-11-28T06:41:26.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320035.log: gzip -5 90.0% -- replaced with /var/log/ceph/ceph-client.admin.471102.log.gz 2023-11-28T06:41:26.491 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.254340.log 2023-11-28T06:41:26.491 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.123923.log: /var/log/ceph/ceph-client.admin.288875.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.278159.log.gz 2023-11-28T06:41:26.492 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599545.log 2023-11-28T06:41:26.493 INFO:teuthology.orchestra.run.smithi154.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.284638.log.gz/var/log/ceph/ceph-client.admin.254340.log: 2023-11-28T06:41:26.493 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667442.log 2023-11-28T06:41:26.493 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.599545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102986.log 2023-11-28T06:41:26.494 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.287145.log.gz 2023-11-28T06:41:26.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449618.log 2023-11-28T06:41:26.495 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4%/var/log/ceph/ceph-client.admin.102986.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.667442.log.gz 2023-11-28T06:41:26.496 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.235845.log 2023-11-28T06:41:26.497 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.449618.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.278678.log.gz 2023-11-28T06:41:26.497 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 81.0% -- replaced with /var/log/ceph/ceph-client.admin.302664.log.gz 2023-11-28T06:41:26.497 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.442363.log 2023-11-28T06:41:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235845.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95060.log.gz 2023-11-28T06:41:26.499 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475398.log 89.8% -- replaced with /var/log/ceph/ceph-client.admin.302256.log.gz 2023-11-28T06:41:26.499 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.499 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95461.log.gz 2023-11-28T06:41:26.500 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442363.log: gzip 89.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.102134.log 2023-11-28T06:41:26.500 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97435.log.gz 2023-11-28T06:41:26.501 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101162.log.gz/var/log/ceph/ceph-client.admin.475398.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.191793.log.gz 2023-11-28T06:41:26.501 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 2023-11-28T06:41:26.501 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.518817.log 2023-11-28T06:41:26.502 INFO:teuthology.orchestra.run.smithi154.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.194785.log.gz 2023-11-28T06:41:26.502 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.507589.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.0.98248.log.gz 2023-11-28T06:41:26.503 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.503 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612243.log 2023-11-28T06:41:26.503 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.191383.log.gz 2023-11-28T06:41:26.504 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.308555.log.gz 2023-11-28T06:41:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.518817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103252.log 2023-11-28T06:41:26.504 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.612243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579267.log 2023-11-28T06:41:26.505 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100936.log 2023-11-28T06:41:26.506 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.579267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284178.log 2023-11-28T06:41:26.507 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231024.log 2023-11-28T06:41:26.508 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563757.log 2023-11-28T06:41:26.509 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638793.log 2023-11-28T06:41:26.510 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.161159.log.gz 2023-11-28T06:41:26.510 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.563757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527746.log 2023-11-28T06:41:26.511 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.638793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249867.log 2023-11-28T06:41:26.512 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.527746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552850.log 2023-11-28T06:41:26.513 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.249867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328715.log 2023-11-28T06:41:26.514 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.552850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639649.log 2023-11-28T06:41:26.515 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328715.log: gzip 89.9% -- replaced with /var/log/ceph/ceph-client.admin.168685.log.gz 2023-11-28T06:41:26.516 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.594716.log 2023-11-28T06:41:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.639649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666604.log 2023-11-28T06:41:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.594716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236291.log 2023-11-28T06:41:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666604.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.267889.log.gz 2023-11-28T06:41:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600863.log 2023-11-28T06:41:26.519 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.666604.log.gz 2023-11-28T06:41:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.236291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477509.log 2023-11-28T06:41:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.600863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269341.log 2023-11-28T06:41:26.522 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477509.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.498814.log.gz 80.8% 2023-11-28T06:41:26.522 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.500565.log.gz 2023-11-28T06:41:26.522 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572241.log 2023-11-28T06:41:26.523 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.269341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455171.log 2023-11-28T06:41:26.524 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.572241.log: gzip -5 --verbose -- 84.2% -- replaced with /var/log/ceph/ceph-client.admin.272304.log.gz 2023-11-28T06:41:26.524 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.96903.log 2023-11-28T06:41:26.526 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574111.log 2023-11-28T06:41:26.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649436.log 2023-11-28T06:41:26.527 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.329576.log.gz 2023-11-28T06:41:26.528 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.518817.log.gz 2023-11-28T06:41:26.528 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.574111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98907.log 2023-11-28T06:41:26.528 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.533232.log.gz 2023-11-28T06:41:26.529 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.649436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512730.log 2023-11-28T06:41:26.530 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.98907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473643.log 2023-11-28T06:41:26.531 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.572241.log.gz 2023-11-28T06:41:26.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.512730.log: gzip 89.8% -- replaced with /var/log/ceph/ceph-client.admin.649436.log.gz 2023-11-28T06:41:26.532 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.658122.log 2023-11-28T06:41:26.532 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473643.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.509571.log.gz 2023-11-28T06:41:26.534 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 79.9% -- replaced with /var/log/ceph/ceph-client.admin.588754.log.gz 2023-11-28T06:41:26.534 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.650291.log 2023-11-28T06:41:26.535 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.594716.log.gz 2023-11-28T06:41:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.658122.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.480156.log.gz 2023-11-28T06:41:26.535 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254770.log 2023-11-28T06:41:26.535 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.658122.log.gz 2023-11-28T06:41:26.535 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.299027.log.gz 2023-11-28T06:41:26.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.650291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527322.log 2023-11-28T06:41:26.536 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.254770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474060.log 2023-11-28T06:41:26.537 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.527322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632922.log 2023-11-28T06:41:26.538 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.650291.log.gz 2023-11-28T06:41:26.538 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.501439.log.gz 2023-11-28T06:41:26.538 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600406.log 2023-11-28T06:41:26.539 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.632922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201594.log 2023-11-28T06:41:26.540 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.600406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326834.log 2023-11-28T06:41:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628761.log 2023-11-28T06:41:26.543 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.637513.log.gz/var/log/ceph/ceph-client.admin.326834.log: 2023-11-28T06:41:26.543 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163911.log 2023-11-28T06:41:26.543 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.529859.log.gz 2023-11-28T06:41:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.628761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273985.log 2023-11-28T06:41:26.544 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529868.log 2023-11-28T06:41:26.546 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.273985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539657.log 2023-11-28T06:41:26.546 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.529868.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123923.log.gz 2023-11-28T06:41:26.547 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262742.log 2023-11-28T06:41:26.548 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.539657.log: 79.4% 84.1% -- replaced with /var/log/ceph/ceph-client.admin.450124.log.gz 2023-11-28T06:41:26.549 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.449618.log.gz 2023-11-28T06:41:26.550 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330834.log 2023-11-28T06:41:26.550 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.240487.log.gz 2023-11-28T06:41:26.551 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.254340.log.gz 2023-11-28T06:41:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.262742.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.531958.log.gz 2023-11-28T06:41:26.551 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.260609.log.gz 2023-11-28T06:41:26.551 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102800.log 2023-11-28T06:41:26.551 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.273985.log.gz 2023-11-28T06:41:26.551 INFO:teuthology.orchestra.run.smithi154.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.103714.log.gz 2023-11-28T06:41:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.330834.log: /var/log/ceph/ceph-client.admin.331255.log 2023-11-28T06:41:26.553 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.500983.log.gz 2023-11-28T06:41:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102800.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.232332.log.gz 2023-11-28T06:41:26.553 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- 90.1% -- replaced with /var/log/ceph/ceph-client.admin.230184.log.gz 2023-11-28T06:41:26.554 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.100138.log 2023-11-28T06:41:26.554 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3%/var/log/ceph/ceph-client.admin.331255.log: -- replaced with /var/log/ceph/ceph-client.admin.470131.log.gz 2023-11-28T06:41:26.555 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.472345.log.gz 2023-11-28T06:41:26.555 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543709.log 2023-11-28T06:41:26.555 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.473643.log.gz 2023-11-28T06:41:26.556 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3%/var/log/ceph/ceph-client.admin.100138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477934.log 2023-11-28T06:41:26.556 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.639213.log.gz 2023-11-28T06:41:26.556 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.475398.log.gz 2023-11-28T06:41:26.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.543709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509154.log 2023-11-28T06:41:26.557 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507165.log 2023-11-28T06:41:26.558 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103166.log.gz 2023-11-28T06:41:26.558 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103252.log.gz /var/log/ceph/ceph-client.admin.480637.log 2023-11-28T06:41:26.559 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.559 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.509154.log: /var/log/ceph/ceph-client.admin.507165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648781.log 2023-11-28T06:41:26.560 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.480637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479197.log 2023-11-28T06:41:26.561 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.648781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567628.log 2023-11-28T06:41:26.562 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102986.log.gz 2023-11-28T06:41:26.563 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103030.log.gz 2023-11-28T06:41:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101576.log 2023-11-28T06:41:26.563 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479197.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96223.log.gz 2023-11-28T06:41:26.564 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96903.log.gz 2023-11-28T06:41:26.564 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200743.log 2023-11-28T06:41:26.565 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1%/var/log/ceph/ceph-client.admin.567628.log: -- replaced with /var/log/ceph/ceph-client.admin.98907.log.gz 2023-11-28T06:41:26.565 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101576.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.484217.log 2023-11-28T06:41:26.565 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100138.log.gz 2023-11-28T06:41:26.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.200743.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.169510.log.gz 2023-11-28T06:41:26.567 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561534.log 84.3% 2023-11-28T06:41:26.567 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.184959.log.gz 2023-11-28T06:41:26.567 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.484217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280391.log 2023-11-28T06:41:26.569 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.561534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187054.log 2023-11-28T06:41:26.570 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.280391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329167.log 2023-11-28T06:41:26.571 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187054.log: gzip 81.8% -- replaced with /var/log/ceph/ceph-client.admin.477509.log.gz 2023-11-28T06:41:26.571 INFO:teuthology.orchestra.run.smithi154.stderr: -5 91.9% -- replaced with /var/log/ceph/ceph-client.admin.539657.log.gz 2023-11-28T06:41:26.572 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.168676.log 2023-11-28T06:41:26.574 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305187.log 2023-11-28T06:41:26.574 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.561534.log.gz 2023-11-28T06:41:26.574 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598291.log 2023-11-28T06:41:26.575 INFO:teuthology.orchestra.run.smithi154.stderr: 76.5%/var/log/ceph/ceph-client.admin.305187.log: -- replaced with /var/log/ceph/ceph-client.admin.509154.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463604.log 2023-11-28T06:41:26.575 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.576 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.235845.log.gz 2023-11-28T06:41:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.598291.log: gzip -5 77.7% -- replaced with /var/log/ceph/ceph-client.admin.330834.log.gz 2023-11-28T06:41:26.576 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.649005.log 2023-11-28T06:41:26.577 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463604.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.331255.log.gz 2023-11-28T06:41:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.649005.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.649005.log.gz 2023-11-28T06:41:26.580 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.439850.log.gz 2023-11-28T06:41:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100322.log 2023-11-28T06:41:26.580 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.453932.log.gz 2023-11-28T06:41:26.581 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.598291.log.gz 2023-11-28T06:41:26.582 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.326834.log.gz 80.6% -- replaced with /var/log/ceph/ceph-client.admin.600406.log.gz 2023-11-28T06:41:26.582 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.582 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552442.log 2023-11-28T06:41:26.582 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.511858.log.gz 2023-11-28T06:41:26.582 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.512730.log.gz 2023-11-28T06:41:26.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436488.log 2023-11-28T06:41:26.583 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.552442.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.567628.log.gz 2023-11-28T06:41:26.584 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505049.log 2023-11-28T06:41:26.584 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.248083.log.gz 2023-11-28T06:41:26.585 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204581.log 2023-11-28T06:41:26.586 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436488.log: /var/log/ceph/ceph-client.admin.505049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193526.log 81.5% 2023-11-28T06:41:26.586 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.574111.log.gz 2023-11-28T06:41:26.586 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.632922.log.gz 2023-11-28T06:41:26.587 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.204581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186636.log 2023-11-28T06:41:26.588 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277695.log 2023-11-28T06:41:26.589 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531115.log 2023-11-28T06:41:26.589 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.543709.log.gz 2023-11-28T06:41:26.590 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.277695.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.249422.log.gz 2023-11-28T06:41:26.591 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530697.log 2023-11-28T06:41:26.592 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.531115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253452.log 2023-11-28T06:41:26.594 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.530697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100526.log 2023-11-28T06:41:26.595 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.253452.log: gzip -5 --verbose -- 90.1% -- replaced with /var/log/ceph/ceph-client.admin.529868.log.gz 2023-11-28T06:41:26.595 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.330417.log 2023-11-28T06:41:26.596 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212928.log 2023-11-28T06:41:26.598 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330417.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.210177.log.gz 2023-11-28T06:41:26.598 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.280391.log.gz 2023-11-28T06:41:26.598 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637087.log 78.1% -- replaced with /var/log/ceph/ceph-client.admin.474514.log.gz 2023-11-28T06:41:26.598 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.599 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460671.log 2023-11-28T06:41:26.601 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.637087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302673.log 2023-11-28T06:41:26.602 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.460671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289913.log 2023-11-28T06:41:26.603 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.302673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182462.log 2023-11-28T06:41:26.603 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102944.log.gz 2023-11-28T06:41:26.604 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.289913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104039.log 2023-11-28T06:41:26.606 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182462.log: gzip 81.3% -- replaced with /var/log/ceph/ceph-client.admin.479197.log.gz 2023-11-28T06:41:26.606 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.478762.log.gz 2023-11-28T06:41:26.606 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.175185.log 2023-11-28T06:41:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.0.104039.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.477934.log.gz 2023-11-28T06:41:26.607 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175176.log 2023-11-28T06:41:26.608 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259361.log 2023-11-28T06:41:26.609 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327259.log 2023-11-28T06:41:26.610 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.259361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591701.log 2023-11-28T06:41:26.612 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101204.log.gz 2023-11-28T06:41:26.612 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101246.log.gz 2023-11-28T06:41:26.612 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.252114.log 2023-11-28T06:41:26.612 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.451386.log.gz 2023-11-28T06:41:26.612 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101576.log.gz 2023-11-28T06:41:26.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.591701.log: /var/log/ceph/ceph-client.admin.327259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456837.log 2023-11-28T06:41:26.613 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.252114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97099.log 2023-11-28T06:41:26.614 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648036.log 2023-11-28T06:41:26.615 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553276.log 2023-11-28T06:41:26.616 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.648036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533649.log 2023-11-28T06:41:26.617 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.553276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97141.log 2023-11-28T06:41:26.618 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.533649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251659.log 2023-11-28T06:41:26.618 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.648036.log.gz 2023-11-28T06:41:26.619 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192681.log 2023-11-28T06:41:26.620 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.251659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278168.log 2023-11-28T06:41:26.621 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661200.log 2023-11-28T06:41:26.622 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.278168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530706.log 2023-11-28T06:41:26.623 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.661200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486714.log 2023-11-28T06:41:26.624 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.530706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295571.log 2023-11-28T06:41:26.625 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.486714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592531.log 2023-11-28T06:41:26.625 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96902.log.gz 2023-11-28T06:41:26.626 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.295571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656362.log 2023-11-28T06:41:26.627 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96231.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100322.log.gz 2023-11-28T06:41:26.627 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.630 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.656362.log: /var/log/ceph/ceph-client.admin.592531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558996.log 2023-11-28T06:41:26.631 INFO:teuthology.orchestra.run.smithi154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.97729.log.gz 2023-11-28T06:41:26.631 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586171.log 2023-11-28T06:41:26.632 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.661200.log.gz/var/log/ceph/ceph-client.admin.558996.log: 2023-11-28T06:41:26.632 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648027.log 2023-11-28T06:41:26.633 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.586171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590017.log 2023-11-28T06:41:26.635 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.648027.log: gzip -5 84.6% -- replaced with /var/log/ceph/ceph-client.admin.648027.log.gz 2023-11-28T06:41:26.635 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.647192.log 2023-11-28T06:41:26.636 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.590017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95357.log 2023-11-28T06:41:26.637 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.647192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458097.log 2023-11-28T06:41:26.637 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.656362.log.gz 2023-11-28T06:41:26.638 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541348.log 2023-11-28T06:41:26.639 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458097.log: gzip -5 89.7% --verbose -- /var/log/ceph/ceph-client.admin.527730.log 2023-11-28T06:41:26.639 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.647192.log.gz 2023-11-28T06:41:26.640 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.541348.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.200743.log.gz 2023-11-28T06:41:26.641 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose 77.6% -- replaced with /var/log/ceph/ceph-client.admin.436488.log.gz 2023-11-28T06:41:26.641 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.638339.log 2023-11-28T06:41:26.641 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.439002.log.gz 2023-11-28T06:41:26.642 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.527730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464024.log 2023-11-28T06:41:26.643 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.638339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530275.log 2023-11-28T06:41:26.644 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208796.log 2023-11-28T06:41:26.645 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.530275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603955.log 2023-11-28T06:41:26.646 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.208796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99707.log 2023-11-28T06:41:26.647 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.603955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583093.log 2023-11-28T06:41:26.648 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.99707.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.522251.log 2023-11-28T06:41:26.649 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.583093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273555.log 2023-11-28T06:41:26.650 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.522251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99413.log 2023-11-28T06:41:26.651 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.273555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246736.log 2023-11-28T06:41:26.653 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255608.log 2023-11-28T06:41:26.654 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.246736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180299.log 2023-11-28T06:41:26.654 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.255608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271009.log 2023-11-28T06:41:26.655 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239029.log 2023-11-28T06:41:26.656 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.271009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524338.log 2023-11-28T06:41:26.657 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.239029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485734.log 2023-11-28T06:41:26.658 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.524338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561543.log 2023-11-28T06:41:26.659 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.485734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666478.log 2023-11-28T06:41:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.561543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.664768.log 2023-11-28T06:41:26.662 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659443.log 2023-11-28T06:41:26.662 INFO:teuthology.orchestra.run.smithi154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.666478.log.gz 2023-11-28T06:41:26.663 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.664768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643587.log 2023-11-28T06:41:26.663 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.664768.log.gz 2023-11-28T06:41:26.663 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.659443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266647.log 2023-11-28T06:41:26.664 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.659443.log.gz 2023-11-28T06:41:26.665 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.643587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447406.log 2023-11-28T06:41:26.665 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.643587.log.gz 2023-11-28T06:41:26.666 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.266647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464885.log 2023-11-28T06:41:26.667 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.447406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97477.log 2023-11-28T06:41:26.668 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586162.log 2023-11-28T06:41:26.669 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438171.log 2023-11-28T06:41:26.669 INFO:teuthology.orchestra.run.smithi194.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-28T06:41:26.670 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.586162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634592.log 2023-11-28T06:41:26.670 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.305187.log.gz 2023-11-28T06:41:26.672 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438171.log: 89.9% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.327259.log.gz 2023-11-28T06:41:26.672 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.329167.log.gz 2023-11-28T06:41:26.673 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.634592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543700.log 2023-11-28T06:41:26.673 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.586162.log.gz 2023-11-28T06:41:26.674 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667024.log 2023-11-28T06:41:26.675 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.543700.log: gzip -5 --verbose -- 89.7% -- replaced with /var/log/ceph/ceph-client.admin.578859.log.gz 2023-11-28T06:41:26.675 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.551968.log 2023-11-28T06:41:26.676 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655473.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.667024.log.gz 2023-11-28T06:41:26.677 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.677 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.262742.log.gz 2023-11-28T06:41:26.678 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.551968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253005.log 2023-11-28T06:41:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.655473.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.655473.log.gz 2023-11-28T06:41:26.679 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446552.log 2023-11-28T06:41:26.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.253005.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-28T06:41:26.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.446552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167012.log 2023-11-28T06:41:26.682 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442354.log 2023-11-28T06:41:26.684 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514639.log 2023-11-28T06:41:26.686 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose 81.2% -- replaced with /var/log/ceph/ceph-client.admin.463604.log.gz 2023-11-28T06:41:26.686 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.655042.log 2023-11-28T06:41:26.687 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442354.log: /var/log/ceph/ceph-client.admin.514639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508043.log 2023-11-28T06:41:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.655042.log: gzip -5 --verbose -- 78.1% -- replaced with /var/log/ceph/ceph-client.admin.637087.log.gz 2023-11-28T06:41:26.689 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.567220.log 2023-11-28T06:41:26.689 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.508043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267481.log 2023-11-28T06:41:26.690 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.637096.log.gz 2023-11-28T06:41:26.690 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.567220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97309.log 2023-11-28T06:41:26.692 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.267481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286727.log 2023-11-28T06:41:26.692 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1%/var/log/ceph/ceph-client.admin.97309.log: -- replaced with /var/log/ceph/ceph-client.admin.527730.log.gz 2023-11-28T06:41:26.696 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103462.log 2023-11-28T06:41:26.696 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.182462.log.gz 2023-11-28T06:41:26.696 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331676.log 89.8% 2023-11-28T06:41:26.696 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.552442.log.gz 2023-11-28T06:41:26.696 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.541348.log.gz 2023-11-28T06:41:26.697 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597865.log 2023-11-28T06:41:26.697 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.553276.log.gz 2023-11-28T06:41:26.697 INFO:teuthology.orchestra.run.smithi154.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.644513.log.gz 2023-11-28T06:41:26.697 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.591701.log.gz 2023-11-28T06:41:26.699 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521413.log 2023-11-28T06:41:26.699 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.168676.log.gz 2023-11-28T06:41:26.699 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.633757.log.gz 2023-11-28T06:41:26.700 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.597865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644050.log 2023-11-28T06:41:26.700 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.655042.log.gz 2023-11-28T06:41:26.700 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.521413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444040.log 2023-11-28T06:41:26.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.644050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101965.log 2023-11-28T06:41:26.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.444040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630822.log 2023-11-28T06:41:26.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645883.log 2023-11-28T06:41:26.702 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.630822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96220.log 2023-11-28T06:41:26.704 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.645883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568526.log 2023-11-28T06:41:26.705 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235390.log 2023-11-28T06:41:26.705 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0%/var/log/ceph/ceph-client.admin.568526.log: -- replaced with /var/log/ceph/ceph-client.admin.486714.log.gz 2023-11-28T06:41:26.706 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312037.log 2023-11-28T06:41:26.706 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.638339.log.gz 2023-11-28T06:41:26.707 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.235390.log: gzip 77.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.167012.log.gz 2023-11-28T06:41:26.707 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.476675.log 2023-11-28T06:41:26.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.312037.log: gzip -5 89.8% --verbose -- /var/log/ceph/ceph-client.admin.623379.log 2023-11-28T06:41:26.708 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.177345.log.gz 2023-11-28T06:41:26.709 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476675.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.273555.log.gz 2023-11-28T06:41:26.710 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 90.8% -- replaced with /var/log/ceph/ceph-client.admin.645883.log.gz 2023-11-28T06:41:26.710 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.190912.log 2023-11-28T06:41:26.711 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 84.7% -- replaced with /var/log/ceph/ceph-client.admin.286727.log.gz 2023-11-28T06:41:26.711 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.452681.log.gz 2023-11-28T06:41:26.711 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.235390.log.gz 2023-11-28T06:41:26.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.623379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530284.log 2023-11-28T06:41:26.712 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.273564.log.gz 2023-11-28T06:41:26.712 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.190912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651132.log 2023-11-28T06:41:26.713 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.530284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449627.log 2023-11-28T06:41:26.713 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.302673.log.gz 2023-11-28T06:41:26.714 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519269.log 2023-11-28T06:41:26.716 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.651132.log: /var/log/ceph/ceph-client.admin.449627.log: gzip -5 --verbose -- 90.2% -- replaced with /var/log/ceph/ceph-client.admin.476675.log.gz 2023-11-28T06:41:26.717 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.519269.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.651132.log.gz 2023-11-28T06:41:26.717 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.252105.log 2023-11-28T06:41:26.718 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304778.log 2023-11-28T06:41:26.719 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.252105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306867.log 2023-11-28T06:41:26.720 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579276.log 2023-11-28T06:41:26.721 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445716.log 2023-11-28T06:41:26.722 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.579276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328209.log 2023-11-28T06:41:26.723 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.445716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651550.log 2023-11-28T06:41:26.723 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.586171.log.gz 2023-11-28T06:41:26.724 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451377.log 2023-11-28T06:41:26.725 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.651550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298594.log 2023-11-28T06:41:26.726 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.451377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666323.log 2023-11-28T06:41:26.726 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100862.log.gz 2023-11-28T06:41:26.727 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100936.log.gz 2023-11-28T06:41:26.727 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.298594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229762.log 2023-11-28T06:41:26.728 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-28T06:41:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234080.log 2023-11-28T06:41:26.730 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102134.log.gz 2023-11-28T06:41:26.730 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.229762.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262733.log 2023-11-28T06:41:26.730 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.666323.log.gz 2023-11-28T06:41:26.730 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102800.log.gz 2023-11-28T06:41:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251213.log 2023-11-28T06:41:26.731 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.262733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168212.log 2023-11-28T06:41:26.733 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.251213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176484.log 2023-11-28T06:41:26.734 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.168212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319617.log 2023-11-28T06:41:26.735 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575897.log 2023-11-28T06:41:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319617.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.651550.log.gz 2023-11-28T06:41:26.737 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269749.log 2023-11-28T06:41:26.738 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.575897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193955.log 2023-11-28T06:41:26.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.269749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272730.log 2023-11-28T06:41:26.739 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288884.log 2023-11-28T06:41:26.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.272730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538387.log 2023-11-28T06:41:26.741 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208805.log 2023-11-28T06:41:26.742 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.538387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285482.log 2023-11-28T06:41:26.743 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.208805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573244.log 2023-11-28T06:41:26.744 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633331.log 2023-11-28T06:41:26.745 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.285482.log: /var/log/ceph/ceph-client.admin.573244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212256.log 2023-11-28T06:41:26.746 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.633331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510973.log 2023-11-28T06:41:26.747 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300930.log 2023-11-28T06:41:26.748 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.510973.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102050.log 2023-11-28T06:41:26.749 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300930.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.444040.log.gz 2023-11-28T06:41:26.749 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288022.log 2023-11-28T06:41:26.750 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.102050.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99455.log 2023-11-28T06:41:26.751 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498401.log 2023-11-28T06:41:26.752 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.99455.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.652869.log 2023-11-28T06:41:26.752 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.498401.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100526.log.gz 2023-11-28T06:41:26.753 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103462.log.gz 2023-11-28T06:41:26.753 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95271.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599536.log 2023-11-28T06:41:26.754 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.756 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97477.log.gz 2023-11-28T06:41:26.756 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97309.log.gzgzip 2023-11-28T06:41:26.756 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.652869.log: -- /var/log/ceph/ceph-client.admin.96567.log 2023-11-28T06:41:26.756 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.652869.log.gz 2023-11-28T06:41:26.756 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.460671.log.gz 2023-11-28T06:41:26.758 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97645.log 2023-11-28T06:41:26.761 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.599536.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.96567.log: -- /var/log/ceph/ceph-client.admin.285473.log 2023-11-28T06:41:26.761 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99455.log.gz 2023-11-28T06:41:26.761 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.461098.log.gz 2023-11-28T06:41:26.761 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.97645.log: -5 --verbose 77.7% -- replaced with /var/log/ceph/ceph-client.admin.202890.log.gz 2023-11-28T06:41:26.761 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.636679.log 2023-11-28T06:41:26.762 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.285473.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.551968.log.gz 2023-11-28T06:41:26.762 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.636679.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.176484.log.gz 2023-11-28T06:41:26.762 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.517112.log 2023-11-28T06:41:26.764 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.438171.log.gz 2023-11-28T06:41:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose 90.0% -- replaced with /var/log/ceph/ceph-client.admin.267481.log.gz 2023-11-28T06:41:26.764 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.269332.log 2023-11-28T06:41:26.764 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.328706.log.gz 2023-11-28T06:41:26.764 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.517112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102902.log 2023-11-28T06:41:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.269332.log: 89.9% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.331676.log.gz 2023-11-28T06:41:26.766 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.502937.log.gz 2023-11-28T06:41:26.766 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510494.log 2023-11-28T06:41:26.767 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102902.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.193526.log.gz 2023-11-28T06:41:26.767 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.442354.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273976.log 2023-11-28T06:41:26.767 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.768 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.510494.log: -5 89.9% -- replaced with /var/log/ceph/ceph-client.admin.508043.log.gz 2023-11-28T06:41:26.768 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.102860.log 2023-11-28T06:41:26.770 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.273976.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.521413.log.gz 2023-11-28T06:41:26.772 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 92.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.579276.log.gz 2023-11-28T06:41:26.772 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.256433.log 2023-11-28T06:41:26.772 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.506321.log.gz 2023-11-28T06:41:26.772 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.254349.log.gz 2023-11-28T06:41:26.772 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.519269.log.gz 85.3% 2023-11-28T06:41:26.773 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.540516.log.gz 2023-11-28T06:41:26.773 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103074.log 2023-11-28T06:41:26.774 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.256433.log: 81.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300085.log 2023-11-28T06:41:26.774 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.599536.log.gz 2023-11-28T06:41:26.775 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% 79.5% -- replaced with /var/log/ceph/ceph-client.admin.597865.log.gz 2023-11-28T06:41:26.775 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.517112.log.gz 2023-11-28T06:41:26.775 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103074.log: 81.3% 78.5% -- replaced with /var/log/ceph/ceph-client.admin.568526.log.gz -- replaced with /var/log/ceph/ceph-client.admin.554518.log.gz 2023-11-28T06:41:26.775 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.776 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456420.log 2023-11-28T06:41:26.776 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.516699.log.gz 2023-11-28T06:41:26.777 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578850.log 2023-11-28T06:41:26.778 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.592115.log.gz 2023-11-28T06:41:26.778 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.456420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533658.log 2023-11-28T06:41:26.778 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.590852.log.gz 2023-11-28T06:41:26.779 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.530284.log.gz 2023-11-28T06:41:26.779 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.578850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439428.log 2023-11-28T06:41:26.780 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.533658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511394.log 2023-11-28T06:41:26.781 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255599.log 2023-11-28T06:41:26.782 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.511394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311520.log 2023-11-28T06:41:26.783 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.255599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526450.log 2023-11-28T06:41:26.784 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.311520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559436.log 2023-11-28T06:41:26.785 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.526450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620514.log 2023-11-28T06:41:26.786 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.559436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585754.log 2023-11-28T06:41:26.788 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.623379.log.gz 2023-11-28T06:41:26.788 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.632913.log.gz 2023-11-28T06:41:26.788 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.620514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596122.log 2023-11-28T06:41:26.788 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103074.log.gz 2023-11-28T06:41:26.789 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.585754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596375.log 2023-11-28T06:41:26.790 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.596122.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.451377.log.gz 2023-11-28T06:41:26.791 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.596375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577269.log 2023-11-28T06:41:26.791 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.179430.log.gz 2023-11-28T06:41:26.791 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.273976.log.gz 2023-11-28T06:41:26.791 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.634592.log.gz -5 2023-11-28T06:41:26.792 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.281235.log 2023-11-28T06:41:26.792 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.238095.log.gz 2023-11-28T06:41:26.792 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.577269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165288.log 2023-11-28T06:41:26.794 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.281235.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.245426.log.gz 2023-11-28T06:41:26.794 INFO:teuthology.orchestra.run.smithi154.stderr: -5 83.0% -- replaced with /var/log/ceph/ceph-client.admin.252105.log.gz 2023-11-28T06:41:26.794 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.509163.log 2023-11-28T06:41:26.795 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165288.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.256433.log.gz 2023-11-28T06:41:26.795 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.486705.log.gz 2023-11-28T06:41:26.795 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285055.log 2023-11-28T06:41:26.796 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.509163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581842.log 2023-11-28T06:41:26.798 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.285055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662070.log 2023-11-28T06:41:26.798 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.581842.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.312037.log.gz 2023-11-28T06:41:26.802 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580595.log 2023-11-28T06:41:26.802 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1%/var/log/ceph/ceph-client.admin.662070.log: 89.1% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.101618.log.gz 2023-11-28T06:41:26.802 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100568.log.gz 2023-11-28T06:41:26.802 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96049.log.gz 84.0% -- replaced with /var/log/ceph/ceph-client.admin.662070.log.gz 2023-11-28T06:41:26.802 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94883.log.gz 2023-11-28T06:41:26.802 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.803 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96567.log.gz 2023-11-28T06:41:26.803 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101702.log 93.2% -- replaced with /var/log/ceph/ceph-client.admin.584403.log.gz 2023-11-28T06:41:26.803 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.803 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97645.log.gz 2023-11-28T06:41:26.805 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.580595.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268737.log 2023-11-28T06:41:26.805 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97687.log.gz 2023-11-28T06:41:26.805 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101702.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.99203.log.gz -5 2023-11-28T06:41:26.805 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.248966.log 2023-11-28T06:41:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.268737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276342.log 2023-11-28T06:41:26.806 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.174429.log.gz 2023-11-28T06:41:26.806 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.248966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102302.log 2023-11-28T06:41:26.807 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.276342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194377.log 2023-11-28T06:41:26.808 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283336.log 2023-11-28T06:41:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.194377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284647.log 2023-11-28T06:41:26.809 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.283336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626042.log 2023-11-28T06:41:26.811 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.284647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230597.log 2023-11-28T06:41:26.812 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.626042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438589.log 2023-11-28T06:41:26.813 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282919.log 2023-11-28T06:41:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473213.log 2023-11-28T06:41:26.816 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.282919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314541.log 2023-11-28T06:41:26.817 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201175.log 2023-11-28T06:41:26.819 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500157.log 2023-11-28T06:41:26.821 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.201175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514351.log 2023-11-28T06:41:26.821 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.500157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562369.log 2023-11-28T06:41:26.823 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.514351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476249.log 2023-11-28T06:41:26.824 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.562369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99539.log 2023-11-28T06:41:26.826 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.476249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262287.log 2023-11-28T06:41:26.827 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458949.log 2023-11-28T06:41:26.828 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.262287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554527.log 2023-11-28T06:41:26.829 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255191.log 2023-11-28T06:41:26.830 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.554527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314967.log 2023-11-28T06:41:26.831 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.255191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458527.log 2023-11-28T06:41:26.831 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.269332.log.gz 2023-11-28T06:41:26.832 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.314967.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.268737.log.gz 2023-11-28T06:41:26.832 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164795.log 2023-11-28T06:41:26.833 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167785.log 2023-11-28T06:41:26.834 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.290941.log.gz 2023-11-28T06:41:26.834 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.164795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582676.log 2023-11-28T06:41:26.835 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.167785.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-28T06:41:26.836 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.582676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97351.log 2023-11-28T06:41:26.839 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265805.log 2023-11-28T06:41:26.839 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469173.log 2023-11-28T06:41:26.839 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.265805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589591.log 2023-11-28T06:41:26.840 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263188.log 2023-11-28T06:41:26.841 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.589591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328218.log 2023-11-28T06:41:26.842 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.263188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653308.log 2023-11-28T06:41:26.843 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.328218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247637.log 2023-11-28T06:41:26.844 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.653308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662986.log 2023-11-28T06:41:26.845 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.247637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304361.log 2023-11-28T06:41:26.846 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.662986.log: gzip 89.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.101744.log 2023-11-28T06:41:26.846 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.653308.log.gz 2023-11-28T06:41:26.847 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.304361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505040.log 2023-11-28T06:41:26.849 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481052.log 2023-11-28T06:41:26.850 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.505040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.663435.log 2023-11-28T06:41:26.851 INFO:teuthology.orchestra.run.smithi154.stderr: 78.7%/var/log/ceph/ceph-client.admin.481052.log: -- replaced with /var/log/ceph/ceph-client.admin.559436.log.gz 2023-11-28T06:41:26.851 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.562369.log.gz 2023-11-28T06:41:26.853 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.505040.log.gz 2023-11-28T06:41:26.853 INFO:teuthology.orchestra.run.smithi154.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.312455.log.gz 2023-11-28T06:41:26.853 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.577269.log.gz 2023-11-28T06:41:26.853 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% 83.1% -- replaced with /var/log/ceph/ceph-client.admin.581842.log.gz 2023-11-28T06:41:26.853 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.581006.log.gz 2023-11-28T06:41:26.854 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.509163.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498823.log 2023-11-28T06:41:26.854 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.855 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.663435.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.582676.log.gz 2023-11-28T06:41:26.856 INFO:teuthology.orchestra.run.smithi154.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.663435.log.gz 2023-11-28T06:41:26.856 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.596375.log.gz 2023-11-28T06:41:26.857 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.580595.log.gz 2023-11-28T06:41:26.857 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100736.log 2023-11-28T06:41:26.857 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.456420.log.gz 2023-11-28T06:41:26.857 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.523502.log.gz 92.0% -- replaced with /var/log/ceph/ceph-client.admin.662986.log.gz 2023-11-28T06:41:26.857 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.858 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.481052.log.gz 2023-11-28T06:41:26.859 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.528166.log.gz 2023-11-28T06:41:26.859 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.582268.log.gz 2023-11-28T06:41:26.859 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.498823.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.553684.log.gz 2023-11-28T06:41:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536123.log 2023-11-28T06:41:26.862 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.585754.log.gz 2023-11-28T06:41:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100736.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.587857.log.gz 2023-11-28T06:41:26.862 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528594.log 2023-11-28T06:41:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.536123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176901.log 2023-11-28T06:41:26.863 INFO:teuthology.orchestra.run.smithi154.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.632496.log.gz 2023-11-28T06:41:26.863 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.528594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292194.log 2023-11-28T06:41:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446132.log 2023-11-28T06:41:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.292194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593875.log 2023-11-28T06:41:26.864 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.446132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523911.log 2023-11-28T06:41:26.866 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.593875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483295.log 2023-11-28T06:41:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.523911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242194.log 2023-11-28T06:41:26.867 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.483295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440267.log 2023-11-28T06:41:26.868 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.629154.log.gz 2023-11-28T06:41:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478353.log 2023-11-28T06:41:26.869 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.629988.log.gz 2023-11-28T06:41:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.440267.log: --verbose -- 89.7% /var/log/ceph/ceph-client.admin.656801.log 2023-11-28T06:41:26.870 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.629163.log.gz 2023-11-28T06:41:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.478353.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.629580.log.gz 2023-11-28T06:41:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300503.log 2023-11-28T06:41:26.871 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.630414.log.gz 2023-11-28T06:41:26.872 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103672.log.gz 2023-11-28T06:41:26.872 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.656801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667150.log 2023-11-28T06:41:26.873 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.300503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469645.log 2023-11-28T06:41:26.874 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521834.log 2023-11-28T06:41:26.875 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192264.log 2023-11-28T06:41:26.875 INFO:teuthology.orchestra.run.smithi154.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.667150.log.gz 2023-11-28T06:41:26.876 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.521834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182032.log 2023-11-28T06:41:26.877 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.192264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192255.log 2023-11-28T06:41:26.878 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632505.log 2023-11-28T06:41:26.879 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.177754.log.gz/var/log/ceph/ceph-client.admin.192255.log: 2023-11-28T06:41:26.879 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.160546.log.gz 2023-11-28T06:41:26.879 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176892.log 2023-11-28T06:41:26.881 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.632505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102674.log 2023-11-28T06:41:26.882 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.656801.log.gz 2023-11-28T06:41:26.882 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556309.log 2023-11-28T06:41:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.176892.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.448377.log.gz 2023-11-28T06:41:26.883 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552859.log 2023-11-28T06:41:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.556309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163475.log 2023-11-28T06:41:26.884 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.552859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249413.log 2023-11-28T06:41:26.886 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102674.log: /var/log/ceph/ceph-client.admin.163475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565495.log 2023-11-28T06:41:26.886 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.211118.log.gz 2023-11-28T06:41:26.887 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276790.log 2023-11-28T06:41:26.887 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.244084.log.gz 2023-11-28T06:41:26.888 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.450133.log.gz 2023-11-28T06:41:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.249413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542440.log 2023-11-28T06:41:26.889 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.510077.log.gz 2023-11-28T06:41:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.565495.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.510494.log.gz 2023-11-28T06:41:26.889 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.276790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243664.log 2023-11-28T06:41:26.889 INFO:teuthology.orchestra.run.smithi154.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.247182.log.gz 2023-11-28T06:41:26.890 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472771.log 2023-11-28T06:41:26.891 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.542440.log: /var/log/ceph/ceph-client.admin.243664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258935.log 2023-11-28T06:41:26.892 INFO:teuthology.orchestra.run.smithi154.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.285055.log.gz 2023-11-28T06:41:26.893 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.472771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162005.log 2023-11-28T06:41:26.893 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.284647.log.gz 2023-11-28T06:41:26.893 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.258935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477092.log 2023-11-28T06:41:26.895 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101104.log 2023-11-28T06:41:26.895 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%/var/log/ceph/ceph-client.admin.477092.log: -- replaced with /var/log/ceph/ceph-client.admin.478353.log.gz 2023-11-28T06:41:26.896 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297695.log 2023-11-28T06:41:26.897 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662510.log 2023-11-28T06:41:26.898 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234089.log 2023-11-28T06:41:26.899 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.662510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175612.log 2023-11-28T06:41:26.900 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.662510.log.gz 2023-11-28T06:41:26.900 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.234089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268306.log 2023-11-28T06:41:26.901 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298585.log 2023-11-28T06:41:26.902 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.268306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281226.log 2023-11-28T06:41:26.903 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.298585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306040.log 2023-11-28T06:41:26.904 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.281226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657675.log 2023-11-28T06:41:26.904 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.242194.log.gz 2023-11-28T06:41:26.905 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.306040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482878.log 2023-11-28T06:41:26.906 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.657675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256442.log 2023-11-28T06:41:26.906 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.657675.log.gz 2023-11-28T06:41:26.907 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.482878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457263.log 2023-11-28T06:41:26.908 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.256442.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.314541.log.gz 2023-11-28T06:41:26.908 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313299.log 2023-11-28T06:41:26.909 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587848.log 2023-11-28T06:41:26.910 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.457263.log: /var/log/ceph/ceph-client.admin.313299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660761.log 2023-11-28T06:41:26.911 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.587848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555817.log 2023-11-28T06:41:26.912 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.163475.log.gz 2023-11-28T06:41:26.912 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526874.log 2023-11-28T06:41:26.913 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.660761.log: /var/log/ceph/ceph-client.admin.555817.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.176892.log.gz 2023-11-28T06:41:26.914 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501430.log 2023-11-28T06:41:26.915 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.526874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101330.log 2023-11-28T06:41:26.917 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.501430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285064.log 2023-11-28T06:41:26.917 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.176039.log.gz/var/log/ceph/ceph-client.admin.101330.log: 2023-11-28T06:41:26.918 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513978.log 2023-11-28T06:41:26.919 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312873.log 2023-11-28T06:41:26.920 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 89.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.300512.log.gz -- 2023-11-28T06:41:26.920 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.478344.log 2023-11-28T06:41:26.921 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.513978.log: /var/log/ceph/ceph-client.admin.285064.log: /var/log/ceph/ceph-client.admin.312873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244543.log 2023-11-28T06:41:26.923 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.660761.log.gz 2023-11-28T06:41:26.923 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.478344.log: -- /var/log/ceph/ceph-client.admin.441101.log 2023-11-28T06:41:26.924 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.244543.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.331685.log 2023-11-28T06:41:26.926 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441101.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.498823.log.gz 2023-11-28T06:41:26.926 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100820.log 2023-11-28T06:41:26.926 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.267064.log.gz 2023-11-28T06:41:26.927 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.271000.log.gz 2023-11-28T06:41:26.927 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-28T06:41:26.928 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331685.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.100820.log: -- /var/log/ceph/ceph-client.admin.640994.log 2023-11-28T06:41:26.929 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441092.log 2023-11-28T06:41:26.930 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.281235.log.gz 2023-11-28T06:41:26.931 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.640994.log: gzip 84.1% -- replaced with /var/log/ceph/ceph-client.admin.640994.log.gz 2023-11-28T06:41:26.931 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.182453.log 82.5% 2023-11-28T06:41:26.931 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.501430.log.gz 2023-11-28T06:41:26.931 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.441092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268315.log 2023-11-28T06:41:26.932 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.182453.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.440267.log.gz 2023-11-28T06:41:26.934 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318312.log 2023-11-28T06:41:26.934 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.565495.log.gz 2023-11-28T06:41:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.268315.log: -- /var/log/ceph/ceph-client.admin.629997.log 2023-11-28T06:41:26.935 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318312.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.636670.log.gz 2023-11-28T06:41:26.937 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.528594.log.gz 2023-11-28T06:41:26.937 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.636679.log.gz 2023-11-28T06:41:26.938 INFO:teuthology.orchestra.run.smithi154.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.569791.log.gz 2023-11-28T06:41:26.938 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.555817.log.gz 2023-11-28T06:41:26.939 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261037.log 2023-11-28T06:41:26.939 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.513978.log.gz 2023-11-28T06:41:26.940 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.629997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555397.log 2023-11-28T06:41:26.940 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.556309.log.gz 2023-11-28T06:41:26.941 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.261037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588281.log 2023-11-28T06:41:26.942 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231449.log 2023-11-28T06:41:26.944 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.555397.log: /var/log/ceph/ceph-client.admin.588281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330003.log 2023-11-28T06:41:26.944 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.536123.log.gz 2023-11-28T06:41:26.945 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.231449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270166.log 2023-11-28T06:41:26.946 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.330003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570272.log 2023-11-28T06:41:26.948 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.270166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181611.log 82.0% 2023-11-28T06:41:26.948 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.243664.log.gz 2023-11-28T06:41:26.948 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.281226.log.gz 2023-11-28T06:41:26.949 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.570272.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.279983.log.gz 2023-11-28T06:41:26.949 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.185385.log 2023-11-28T06:41:26.950 INFO:teuthology.orchestra.run.smithi154.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.620514.log.gz 2023-11-28T06:41:26.951 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181611.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.256442.log.gz 2023-11-28T06:41:26.951 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.258935.log.gz 2023-11-28T06:41:26.951 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470621.log 2023-11-28T06:41:26.952 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.185385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481520.log 2023-11-28T06:41:26.954 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.470621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454348.log 84.7% -- replaced with /var/log/ceph/ceph-client.admin.471510.log.gz 2023-11-28T06:41:26.954 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.956 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.481520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528175.log 2023-11-28T06:41:26.956 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.478344.log.gz 2023-11-28T06:41:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454348.log: 87.7% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102674.log.gz 2023-11-28T06:41:26.958 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102632.log.gz 2023-11-28T06:41:26.958 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.528175.log: /var/log/ceph/ceph-client.admin.647611.log 2023-11-28T06:41:26.958 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.629997.log.gz 2023-11-28T06:41:26.959 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568943.log 2023-11-28T06:41:26.959 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97832.log.gz 2023-11-28T06:41:26.961 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99539.log.gz 2023-11-28T06:41:26.961 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.647611.log: --verbose -- /var/log/ceph/ceph-client.admin.184968.log 2023-11-28T06:41:26.962 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436497.log 2023-11-28T06:41:26.963 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.568943.log: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279566.log 2023-11-28T06:41:26.963 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.647611.log.gz 2023-11-28T06:41:26.964 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.184968.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100054.log.gz 2023-11-28T06:41:26.964 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.436497.log: -- replaced with /var/log/ceph/ceph-client.admin.243227.log.gz 2023-11-28T06:41:26.965 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193103.log 2023-11-28T06:41:26.967 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.279566.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.182032.log.gz 2023-11-28T06:41:26.967 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.182453.log.gz 2023-11-28T06:41:26.967 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.554527.log.gz 2023-11-28T06:41:26.968 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.190029.log.gz 2023-11-28T06:41:26.968 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.645874.log 2023-11-28T06:41:26.969 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.436914.log.gz 2023-11-28T06:41:26.969 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.185376.log.gz 2023-11-28T06:41:26.970 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99791.log 2023-11-28T06:41:26.970 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.185385.log.gz 2023-11-28T06:41:26.971 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.645874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479206.log 2023-11-28T06:41:26.972 INFO:teuthology.orchestra.run.smithi154.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.645874.log.gz 2023-11-28T06:41:26.972 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99791.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-28T06:41:26.973 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516690.log 2023-11-28T06:41:26.974 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582685.log 2023-11-28T06:41:26.976 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.516690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270592.log 2023-11-28T06:41:26.976 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.582685.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.300503.log.gz 2023-11-28T06:41:26.977 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.300921.log.gz 2023-11-28T06:41:26.978 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597448.log 2023-11-28T06:41:26.980 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.270592.log: gzip -5 --verbose 90.1% -- replaced with /var/log/ceph/ceph-client.admin.261037.log.gz 2023-11-28T06:41:26.980 INFO:teuthology.orchestra.run.smithi154.stderr: -- /var/log/ceph/ceph-client.admin.574963.log 2023-11-28T06:41:26.981 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.597448.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.268315.log.gz 2023-11-28T06:41:26.981 INFO:teuthology.orchestra.run.smithi154.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.167785.log.gz 2023-11-28T06:41:26.981 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.165288.log.gz 2023-11-28T06:41:26.981 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.168203.log.gz 2023-11-28T06:41:26.983 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 81.4% -- replaced with /var/log/ceph/ceph-client.admin.270166.log.gz 2023-11-28T06:41:26.983 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.590425.log 2023-11-28T06:41:26.983 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.505480.log.gz 2023-11-28T06:41:26.983 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.574963.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.441092.log.gz 2023-11-28T06:41:26.983 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257276.log 2023-11-28T06:41:26.984 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.590425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557275.log 2023-11-28T06:41:26.986 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.257276.log: gzip -5/var/log/ceph/ceph-client.admin.557275.log: --verbose -- /var/log/ceph/ceph-client.admin.321768.log 2023-11-28T06:41:26.987 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.582685.log.gz 2023-11-28T06:41:26.987 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.454348.log.gz 2023-11-28T06:41:26.989 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501857.log 2023-11-28T06:41:26.990 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.456429.log.gz 2023-11-28T06:41:26.990 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.570272.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.admin.464033.log.gz 2023-11-28T06:41:26.990 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.991 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.597457.log.gz 2023-11-28T06:41:26.991 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.568943.log.gz 2023-11-28T06:41:26.992 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.564600.log.gz 2023-11-28T06:41:26.992 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.590425.log.gz 2023-11-28T06:41:26.992 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.592124.log.gz 2023-11-28T06:41:26.994 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.321768.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.161576.log.gz 2023-11-28T06:41:26.994 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% 90.0% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.460680.log.gz 2023-11-28T06:41:26.994 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.597448.log.gz 2023-11-28T06:41:26.994 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.557275.log.gz 89.6% -- replaced with /var/log/ceph/ceph-client.admin.633340.log.gz 2023-11-28T06:41:26.994 INFO:teuthology.orchestra.run.smithi154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.487658.log.gz 2023-11-28T06:41:26.995 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:26.995 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.481520.log.gz 2023-11-28T06:41:26.995 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163484.log 2023-11-28T06:41:26.996 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.501857.log: gzip -5 --verbose -- 90.0% -- replaced with /var/log/ceph/ceph-client.admin.279566.log.gz 2023-11-28T06:41:26.996 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.293081.log 2023-11-28T06:41:26.997 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.163484.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.236700.log.gz 2023-11-28T06:41:26.998 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.260190.log.gz 2023-11-28T06:41:26.999 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293081.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.256859.log.gz 2023-11-28T06:41:26.999 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.257276.log.gz 2023-11-28T06:41:27.000 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103780.log 2023-11-28T06:41:27.000 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.283345.log.gz 2023-11-28T06:41:27.001 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 80.8% -- replaced with /var/log/ceph/ceph-client.admin.284169.log.gz 2023-11-28T06:41:27.001 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.505906.log 2023-11-28T06:41:27.002 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103780.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.321768.log.gz 2023-11-28T06:41:27.002 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504178.log 2023-11-28T06:41:27.003 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.505906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473222.log 2023-11-28T06:41:27.004 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.470621.log.gz 2023-11-28T06:41:27.005 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.229336.log.gz 2023-11-28T06:41:27.005 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.504178.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.653299.log 2023-11-28T06:41:27.006 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.473222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526865.log 2023-11-28T06:41:27.008 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.653299.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.229762.log.gz 2023-11-28T06:41:27.008 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471936.log 2023-11-28T06:41:27.008 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.653299.log.gz 2023-11-28T06:41:27.008 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.526865.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-28T06:41:27.011 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439011.log 2023-11-28T06:41:27.012 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564591.log 2023-11-28T06:41:27.014 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.439011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666281.log 2023-11-28T06:41:27.015 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.564591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559864.log 2023-11-28T06:41:27.016 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315384.log 2023-11-28T06:41:27.016 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.514411.log.gz 2023-11-28T06:41:27.017 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.559864.log: /var/log/ceph/ceph-client.admin.666281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.665204.log 2023-11-28T06:41:27.018 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.666281.log.gz 2023-11-28T06:41:27.019 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99497.log 2023-11-28T06:41:27.020 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.315384.log: /var/log/ceph/ceph-client.admin.665204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594707.log 2023-11-28T06:41:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99497.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.449627.log.gz 2023-11-28T06:41:27.021 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253890.log 2023-11-28T06:41:27.022 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.665204.log.gz 2023-11-28T06:41:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.594707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329585.log 2023-11-28T06:41:27.023 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.253890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453515.log 2023-11-28T06:41:27.024 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.329585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448785.log 2023-11-28T06:41:27.025 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.453515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283761.log 2023-11-28T06:41:27.027 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534071.log 2023-11-28T06:41:27.028 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.283761.log: /var/log/ceph/ceph-client.admin.448785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187045.log 2023-11-28T06:41:27.029 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301756.log 2023-11-28T06:41:27.030 INFO:teuthology.orchestra.run.smithi154.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.544117.log.gz 2023-11-28T06:41:27.031 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.187045.log: /var/log/ceph/ceph-client.admin.534071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464454.log 2023-11-28T06:41:27.032 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.301756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438580.log 2023-11-28T06:41:27.034 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.464454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189154.log 2023-11-28T06:41:27.034 INFO:teuthology.orchestra.run.smithi154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100736.log.gz 2023-11-28T06:41:27.035 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.438580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297278.log 2023-11-28T06:41:27.036 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.189154.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100820.log.gz 2023-11-28T06:41:27.036 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102590.log.gz 2023-11-28T06:41:27.037 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246745.log 2023-11-28T06:41:27.038 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.297278.log: --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99497.log.gz 2023-11-28T06:41:27.038 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.461934.log 2023-11-28T06:41:27.039 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.246745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557683.log 2023-11-28T06:41:27.039 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.543293.log.gz 2023-11-28T06:41:27.040 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.192255.log.gz 2023-11-28T06:41:27.041 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99791.log.gz 2023-11-28T06:41:27.041 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100012.log.gz 2023-11-28T06:41:27.041 INFO:teuthology.orchestra.run.smithi154.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.187045.log.gz 2023-11-28T06:41:27.042 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461934.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.169102.log.gz 2023-11-28T06:41:27.042 INFO:teuthology.orchestra.run.smithi154.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.644969.log.gz 2023-11-28T06:41:27.043 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.184968.log.gz 2023-11-28T06:41:27.043 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.177336.log.gz 2023-11-28T06:41:27.043 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192264.log.gz 2023-11-28T06:41:27.043 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.308546.log.gz 2023-11-28T06:41:27.044 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583558.log 2023-11-28T06:41:27.044 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.189154.log.gz 2023-11-28T06:41:27.044 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.557683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247628.log 2023-11-28T06:41:27.046 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.318312.log.gz 2023-11-28T06:41:27.046 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.583558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200752.log 2023-11-28T06:41:27.046 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.477925.log.gz 2023-11-28T06:41:27.047 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9%/var/log/ceph/ceph-client.admin.247628.log: -- replaced with /var/log/ceph/ceph-client.admin.267472.log.gz 2023-11-28T06:41:27.047 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510503.log 2023-11-28T06:41:27.048 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.200752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313716.log 2023-11-28T06:41:27.048 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.293081.log.gz 2023-11-28T06:41:27.049 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.510503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458940.log 2023-11-28T06:41:27.049 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.270592.log.gz 2023-11-28T06:41:27.050 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.313716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477518.log 2023-11-28T06:41:27.051 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.458940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259352.log 2023-11-28T06:41:27.053 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.477518.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.320035.log.gz 78.4% -- replaced with /var/log/ceph/ceph-client.admin.504178.log.gz 2023-11-28T06:41:27.053 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 90.1% -- replaced with /var/log/ceph/ceph-client.admin.510086.log.gz/var/log/ceph/ceph-client.admin.259352.log: 2023-11-28T06:41:27.056 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.275877.log 2023-11-28T06:41:27.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.505906.log.gz 2023-11-28T06:41:27.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.523920.log.gz 2023-11-28T06:41:27.057 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575414.log 2023-11-28T06:41:27.058 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598710.log 2023-11-28T06:41:27.059 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.575414.log: /var/log/ceph/ceph-client.admin.275877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606697.log 2023-11-28T06:41:27.060 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.459839.log.gz 2023-11-28T06:41:27.060 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.598710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181193.log 2023-11-28T06:41:27.062 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.606697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487649.log 2023-11-28T06:41:27.063 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513987.log 2023-11-28T06:41:27.065 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.464454.log.gz 2023-11-28T06:41:27.066 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.462359.log.gz 81.0% -- replaced with /var/log/ceph/ceph-client.admin.444031.log.gz 2023-11-28T06:41:27.066 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487649.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.564591.log.gz 2023-11-28T06:41:27.068 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.599120.log.gz 2023-11-28T06:41:27.068 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474981.log 2023-11-28T06:41:27.068 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.540941.log.gz -- replaced with /var/log/ceph/ceph-client.admin.591268.log.gz 2023-11-28T06:41:27.068 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.068 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.557683.log.gz 2023-11-28T06:41:27.069 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.598710.log.gz 2023-11-28T06:41:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228506.log 2023-11-28T06:41:27.069 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.513987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498392.log 2023-11-28T06:41:27.070 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-28T06:41:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.474981.log: /var/log/ceph/ceph-client.admin.228506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178597.log 2023-11-28T06:41:27.070 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.498392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318303.log 2023-11-28T06:41:27.071 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.178597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657233.log 2023-11-28T06:41:27.072 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.318303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293090.log 2023-11-28T06:41:27.073 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.657233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272721.log 2023-11-28T06:41:27.073 INFO:teuthology.orchestra.run.smithi154.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.657233.log.gz 2023-11-28T06:41:27.074 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.293090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103336.log 2023-11-28T06:41:27.075 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.272721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443609.log 2023-11-28T06:41:27.076 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.103336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507580.log 2023-11-28T06:41:27.077 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469164.log 2023-11-28T06:41:27.078 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.507580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285891.log 2023-11-28T06:41:27.079 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.469164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95187.log 2023-11-28T06:41:27.081 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.285891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183300.log 2023-11-28T06:41:27.081 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95965.log 2023-11-28T06:41:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.183300.log: -- /var/log/ceph/ceph-client.admin.99833.log 2023-11-28T06:41:27.082 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475407.log 2023-11-28T06:41:27.083 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.99833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229753.log 2023-11-28T06:41:27.084 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.475407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195709.log 2023-11-28T06:41:27.085 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.229753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458518.log 2023-11-28T06:41:27.086 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.195709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173493.log 2023-11-28T06:41:27.087 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.458518.log: --verbose -- /var/log/ceph/ceph-client.admin.542871.log 2023-11-28T06:41:27.088 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.173493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589600.log 2023-11-28T06:41:27.090 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.542871.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.479678.log 2023-11-28T06:41:27.091 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.589600.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.452255.log.gz 2023-11-28T06:41:27.091 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467826.log 2023-11-28T06:41:27.092 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.479678.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.282501.log.gz 2023-11-28T06:41:27.094 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569800.log 2023-11-28T06:41:27.095 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.467826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238104.log 2023-11-28T06:41:27.096 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.569800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541810.log 2023-11-28T06:41:27.097 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.238104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316627.log 2023-11-28T06:41:27.098 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.541810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257684.log 2023-11-28T06:41:27.099 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.316627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471519.log 2023-11-28T06:41:27.100 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.257684.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.244534.log.gz 2023-11-28T06:41:27.100 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.247628.log.gz 2023-11-28T06:41:27.101 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254761.log 2023-11-28T06:41:27.102 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.259352.log.gz 2023-11-28T06:41:27.102 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.288875.log.gz 2023-11-28T06:41:27.103 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.254761.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.228506.log.gz 2023-11-28T06:41:27.104 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443202.log 2023-11-28T06:41:27.105 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.471936.log.gz 2023-11-28T06:41:27.106 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.474981.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313290.log 2023-11-28T06:41:27.106 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.107 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.477101.log.gz 2023-11-28T06:41:27.107 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.443202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296023.log 2023-11-28T06:41:27.108 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.313290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310234.log 2023-11-28T06:41:27.109 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539235.log 2023-11-28T06:41:27.110 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528603.log 2023-11-28T06:41:27.112 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.539235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644041.log 2023-11-28T06:41:27.113 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.528603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538396.log 2023-11-28T06:41:27.114 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.644041.log: gzip -5 --verbose 80.5% -- /var/log/ceph/ceph-client.admin.193517.log 2023-11-28T06:41:27.115 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.644041.log.gz 2023-11-28T06:41:27.115 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.538396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532815.log 2023-11-28T06:41:27.116 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642261.log 2023-11-28T06:41:27.117 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.532815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232341.log 2023-11-28T06:41:27.119 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.642261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.666520.log 2023-11-28T06:41:27.120 INFO:teuthology.orchestra.run.smithi154.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.642261.log.gz 2023-11-28T06:41:27.120 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.232341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245881.log 2023-11-28T06:41:27.122 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655923.log 2023-11-28T06:41:27.122 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.245881.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.666520.log.gz 2023-11-28T06:41:27.123 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584856.log 2023-11-28T06:41:27.124 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.655923.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96892.log 2023-11-28T06:41:27.125 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.584856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241738.log 2023-11-28T06:41:27.127 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532824.log 2023-11-28T06:41:27.128 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.241738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463186.log 2023-11-28T06:41:27.129 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.532824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186219.log 2023-11-28T06:41:27.130 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95797.log 2023-11-28T06:41:27.132 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.186219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454339.log 2023-11-28T06:41:27.133 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.95797.log: gzip -5 --verbose -- 92.0% -- replaced with /var/log/ceph/ceph-client.admin.655923.log.gz 2023-11-28T06:41:27.133 INFO:teuthology.orchestra.run.smithi154.stderr: /var/log/ceph/ceph-client.admin.666646.log 2023-11-28T06:41:27.135 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.454339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101921.log 2023-11-28T06:41:27.136 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.666646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180784.log 2023-11-28T06:41:27.137 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461507.log 2023-11-28T06:41:27.137 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.666646.log.gz 2023-11-28T06:41:27.138 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.180784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310665.log 2023-11-28T06:41:27.139 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261865.log 2023-11-28T06:41:27.140 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.310665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271479.log 2023-11-28T06:41:27.141 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455180.log 2023-11-28T06:41:27.142 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.261865.log: /var/log/ceph/ceph-client.admin.271479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450969.log 2023-11-28T06:41:27.143 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331264.log 2023-11-28T06:41:27.144 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.450969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102092.log 2023-11-28T06:41:27.145 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.331264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596617.log 2023-11-28T06:41:27.146 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264531.log 2023-11-28T06:41:27.147 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.596617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459358.log 2023-11-28T06:41:27.148 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.264531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597031.log 2023-11-28T06:41:27.149 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161567.log 2023-11-28T06:41:27.150 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.597031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511849.log 2023-11-28T06:41:27.152 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.161567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175603.log 2023-11-28T06:41:27.153 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.511849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326825.log 2023-11-28T06:41:27.154 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.175603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181620.log 2023-11-28T06:41:27.156 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.326825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317469.log 2023-11-28T06:41:27.156 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299036.log 2023-11-28T06:41:27.158 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.317469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442776.log 2023-11-28T06:41:27.159 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.299036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636262.log 2023-11-28T06:41:27.159 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.442776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468243.log 2023-11-28T06:41:27.161 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.636262.log: /var/log/ceph/ceph-client.admin.468243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573698.log 2023-11-28T06:41:27.162 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265814.log 2023-11-28T06:41:27.163 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.573698.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.650282.log 2023-11-28T06:41:27.164 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.265814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583976.log 2023-11-28T06:41:27.165 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448794.log/var/log/ceph/ceph-client.admin.650282.log: 2023-11-28T06:41:27.166 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.583976.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.650282.log.gz 2023-11-28T06:41:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242611.log 2023-11-28T06:41:27.167 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.448794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100180.log 2023-11-28T06:41:27.168 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.242611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174438.log 2023-11-28T06:41:27.169 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442785.log 2023-11-28T06:41:27.170 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100180.log: /var/log/ceph/ceph-client.admin.174438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282093.log 2023-11-28T06:41:27.171 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652021.log/var/log/ceph/ceph-client.admin.442785.log: 2023-11-28T06:41:27.172 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.282093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202015.log 2023-11-28T06:41:27.172 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169927.log 2023-11-28T06:41:27.173 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.652021.log: /var/log/ceph/ceph-client.admin.202015.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.652021.log.gz 2023-11-28T06:41:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626033.log 2023-11-28T06:41:27.174 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212511.log 2023-11-28T06:41:27.175 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.169927.log: /var/log/ceph/ceph-client.admin.626033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486227.log 2023-11-28T06:41:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554949.log 2023-11-28T06:41:27.177 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.212511.log: /var/log/ceph/ceph-client.admin.486227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526019.log 2023-11-28T06:41:27.178 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.554949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303517.log 2023-11-28T06:41:27.179 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.526019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637921.log 2023-11-28T06:41:27.180 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313707.log 2023-11-28T06:41:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.303517.log: /var/log/ceph/ceph-client.admin.637921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264081.log 2023-11-28T06:41:27.181 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531124.log 2023-11-28T06:41:27.182 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.313707.log: /var/log/ceph/ceph-client.admin.264081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183708.log 2023-11-28T06:41:27.183 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.531124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213373.log 2023-11-28T06:41:27.184 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.183708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590434.log 2023-11-28T06:41:27.185 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.213373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574120.log 2023-11-28T06:41:27.186 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.590434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288458.log 2023-11-28T06:41:27.187 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.574120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287154.log 2023-11-28T06:41:27.188 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.288458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487195.log 2023-11-28T06:41:27.189 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.287154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296445.log 2023-11-28T06:41:27.190 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.487195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320453.log 2023-11-28T06:41:27.191 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645423.log 2023-11-28T06:41:27.192 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.320453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264948.log 2023-11-28T06:41:27.193 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.645423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275294.log 2023-11-28T06:41:27.195 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.264948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162989.log 2023-11-28T06:41:27.196 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.275294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188302.log 2023-11-28T06:41:27.197 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.162989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497970.log 2023-11-28T06:41:27.199 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.188302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230175.log 2023-11-28T06:41:27.199 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.497970.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101921.log.gz 2023-11-28T06:41:27.201 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.181193.log.gz 2023-11-28T06:41:27.201 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96892.log.gz 2023-11-28T06:41:27.201 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99581.log.gz 2023-11-28T06:41:27.202 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.194368.log.gz 2023-11-28T06:41:27.202 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% 78.8% -- replaced with /var/log/ceph/ceph-client.admin.183708.log.gz -- replaced with /var/log/ceph/ceph-client.admin.175603.log.gz 2023-11-28T06:41:27.202 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.203 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96566.log.gz 2023-11-28T06:41:27.204 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.183300.log.gz 2023-11-28T06:41:27.204 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102176.log.gz 2023-11-28T06:41:27.204 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297704.log 90.1% -- replaced with /var/log/ceph/ceph-client.admin.200752.log.gz 2023-11-28T06:41:27.204 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.205 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.180784.log.gz 2023-11-28T06:41:27.205 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.230175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459367.log 2023-11-28T06:41:27.206 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.297704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302247.log 2023-11-28T06:41:27.207 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.459367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542207.log 2023-11-28T06:41:27.208 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.302247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102716.log 2023-11-28T06:41:27.209 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.542207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520533.log 2023-11-28T06:41:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102716.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.583558.log.gz 2023-11-28T06:41:27.210 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534080.log 2023-11-28T06:41:27.211 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.520533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97561.log 2023-11-28T06:41:27.212 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.534080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258101.log 2023-11-28T06:41:27.213 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.97561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537980.log 2023-11-28T06:41:27.214 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.258101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468234.log 2023-11-28T06:41:27.215 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.537980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513570.log 2023-11-28T06:41:27.216 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.468234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273138.log 2023-11-28T06:41:27.217 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.513570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503345.log 2023-11-28T06:41:27.218 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.273138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260199.log 2023-11-28T06:41:27.219 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0%/var/log/ceph/ceph-client.admin.503345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471093.log 2023-11-28T06:41:27.220 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.315384.log.gz 2023-11-28T06:41:27.220 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.260199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181202.log 2023-11-28T06:41:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.471093.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.227666.log.gz 2023-11-28T06:41:27.221 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101062.log 2023-11-28T06:41:27.223 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.181202.log: gzip -5 81.0% -- replaced with /var/log/ceph/ceph-client.admin.479678.log.gz 2023-11-28T06:41:27.223 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.193946.log 2023-11-28T06:41:27.223 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.477518.log.gz 2023-11-28T06:41:27.224 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286318.log 2023-11-28T06:41:27.224 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.497970.log.gz 2023-11-28T06:41:27.225 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.498392.log.gz 2023-11-28T06:41:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.193946.log: 90.1% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100694.log.gz 2023-11-28T06:41:27.226 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648510.log 2023-11-28T06:41:27.226 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.497074.log.gz 2023-11-28T06:41:27.228 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.286318.log: gzip -5 90.0% -- replaced with /var/log/ceph/ceph-client.admin.442785.log.gz 2023-11-28T06:41:27.228 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.526441.log.gz 2023-11-28T06:41:27.228 INFO:teuthology.orchestra.run.smithi154.stderr: --verbose -- /var/log/ceph/ceph-client.admin.531532.log 2023-11-28T06:41:27.229 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.458518.log.gz 2023-11-28T06:41:27.229 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.443202.log.gz 2023-11-28T06:41:27.229 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280400.log 2023-11-28T06:41:27.230 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9%/var/log/ceph/ceph-client.admin.648510.log: /var/log/ceph/ceph-client.admin.531532.log: -- replaced with /var/log/ceph/ceph-client.admin.310234.log.gz 2023-11-28T06:41:27.231 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.563757.log.gz 2023-11-28T06:41:27.231 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637504.log 2023-11-28T06:41:27.232 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.280400.log: 90.2% 81.0% -- replaced with /var/log/ceph/ceph-client.admin.648510.log.gz 2023-11-28T06:41:27.232 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.309821.log.gz 2023-11-28T06:41:27.232 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292646.log 2023-11-28T06:41:27.233 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.637504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102386.log 2023-11-28T06:41:27.233 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461934.log.gz 2023-11-28T06:41:27.234 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.292646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228923.log 2023-11-28T06:41:27.235 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.102386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101786.log 2023-11-28T06:41:27.236 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.228923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540932.log 2023-11-28T06:41:27.237 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.101786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274810.log 2023-11-28T06:41:27.238 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.540932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560700.log 2023-11-28T06:41:27.239 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.274810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650711.log 2023-11-28T06:41:27.240 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.560700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165769.log 2023-11-28T06:41:27.242 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.650711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523493.log 2023-11-28T06:41:27.242 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.271479.log.gz 2023-11-28T06:41:27.243 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165769.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.480637.log.gz 2023-11-28T06:41:27.244 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.650711.log.gz 2023-11-28T06:41:27.245 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.527322.log.gz 2023-11-28T06:41:27.246 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1%/var/log/ceph/ceph-client.admin.523493.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.513570.log.gz 2023-11-28T06:41:27.246 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.287563.log 2023-11-28T06:41:27.246 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.250776.log.gz 2023-11-28T06:41:27.247 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281676.log 2023-11-28T06:41:27.248 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.287563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638784.log 2023-11-28T06:41:27.248 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.554949.log.gz 2023-11-28T06:41:27.249 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 81.2% --verbose -- /var/log/ceph/ceph-client.admin.100778.log 2023-11-28T06:41:27.249 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.297278.log.gz 2023-11-28T06:41:27.251 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.281676.log: gzip 81.3% -- replaced with /var/log/ceph/ceph-client.admin.298112.log.gz 2023-11-28T06:41:27.251 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.638784.log: -- /var/log/ceph/ceph-mds.a.log 2023-11-28T06:41:27.251 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.297704.log.gz 2023-11-28T06:41:27.252 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.100778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238528.log 2023-11-28T06:41:27.253 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.583976.log.gz 2023-11-28T06:41:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205952.log 2023-11-28T06:41:27.254 INFO:teuthology.orchestra.run.smithi154.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.487649.log.gz 2023-11-28T06:41:27.254 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.238528.log: 93.3% 83.4% -- replaced with /var/log/ceph/ceph-client.admin.637504.log.gz 2023-11-28T06:41:27.255 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.235399.log.gz 2023-11-28T06:41:27.255 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165297.log 2023-11-28T06:41:27.256 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.205952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517981.log 2023-11-28T06:41:27.256 INFO:teuthology.orchestra.run.smithi154.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.448368.log.gz 2023-11-28T06:41:27.257 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.165297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514303.log 2023-11-28T06:41:27.257 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.575414.log.gz 2023-11-28T06:41:27.258 INFO:teuthology.orchestra.run.smithi154.stderr:gzip/var/log/ceph/ceph-client.admin.517981.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.667360.log 2023-11-28T06:41:27.259 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.514303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455596.log 2023-11-28T06:41:27.260 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638348.log 2023-11-28T06:41:27.261 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.455596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227657.log 2023-11-28T06:41:27.261 INFO:teuthology.orchestra.run.smithi154.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.213373.log.gz 2023-11-28T06:41:27.262 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.667360.log.gz 2023-11-28T06:41:27.263 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.638348.log: -- replaced with /var/log/ceph/ceph-client.admin.531532.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463613.log 2023-11-28T06:41:27.263 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.264 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.313290.log.gz/var/log/ceph/ceph-client.admin.227657.log: 2023-11-28T06:41:27.264 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312882.log 2023-11-28T06:41:27.265 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.463613.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.525606.log.gz 2023-11-28T06:41:27.265 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244980.log 2023-11-28T06:41:27.266 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.312882.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.254761.log.gz 2023-11-28T06:41:27.270 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.280400.log.gz 2023-11-28T06:41:27.270 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514648.log 2023-11-28T06:41:27.270 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.230175.log.gz 2023-11-28T06:41:27.271 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.281676.log.gz 2023-11-28T06:41:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.244980.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.287563.log.gz 2023-11-28T06:41:27.271 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.471093.log.gz 2023-11-28T06:41:27.271 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.286318.log.gz 2023-11-28T06:41:27.271 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.667192.log 2023-11-28T06:41:27.272 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.514648.log: -- /var/log/ceph/ceph-client.admin.103208.log 2023-11-28T06:41:27.273 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.667192.log: 90.1% 85.2% -- replaced with /var/log/ceph/ceph-client.admin.474060.log.gz 2023-11-28T06:41:27.273 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.471519.log.gz 2023-11-28T06:41:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 87.8% --verbose -- /var/log/ceph/ceph-client.admin.485216.log 2023-11-28T06:41:27.274 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.667192.log.gz/var/log/ceph/ceph-client.admin.103208.log: 2023-11-28T06:41:27.274 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542449.log 2023-11-28T06:41:27.275 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5/var/log/ceph/ceph-client.admin.485216.log: --verbose -- /var/log/ceph/ceph-client.admin.296864.log 2023-11-28T06:41:27.276 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.296445.log.gz 2023-11-28T06:41:27.277 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.542449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658563.log 2023-11-28T06:41:27.278 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.296864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461516.log 2023-11-28T06:41:27.280 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.658563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177763.log 2023-11-28T06:41:27.280 INFO:teuthology.orchestra.run.smithi154.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.658563.log.gz 2023-11-28T06:41:27.281 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.461516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319176.log 2023-11-28T06:41:27.282 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.177763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96218.log 2023-11-28T06:41:27.283 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.319176.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102716.log.gz 2023-11-28T06:41:27.284 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103208.log.gz 2023-11-28T06:41:27.284 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.96218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95671.log 2023-11-28T06:41:27.286 INFO:teuthology.orchestra.run.smithi154.stderr:gzip 89.8% -- replaced with /var/log/ceph/ceph-client.admin.181202.log.gz 2023-11-28T06:41:27.286 INFO:teuthology.orchestra.run.smithi154.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.451803.log 2023-11-28T06:41:27.286 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.182883.log.gz 80.8% -- replaced with /var/log/ceph/ceph-client.admin.203315.log.gz 2023-11-28T06:41:27.287 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.287 INFO:teuthology.orchestra.run.smithi154.stderr: 82.0%/var/log/ceph/ceph-client.admin.95671.log: -- replaced with /var/log/ceph/ceph-client.admin.193946.log.gz 2023-11-28T06:41:27.288 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587440.log 2023-11-28T06:41:27.289 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.451803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595687.log 2023-11-28T06:41:27.289 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.542449.log.gz 2023-11-28T06:41:27.290 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574545.log 2023-11-28T06:41:27.290 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.474523.log.gz/var/log/ceph/ceph-client.admin.595687.log: 2023-11-28T06:41:27.291 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.587440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270583.log 2023-11-28T06:41:27.292 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.574545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191374.log 2023-11-28T06:41:27.299 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.270583.log: /var/log/ceph/ceph-client.admin.191374.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.201603.log.gz 2023-11-28T06:41:27.307 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.266638.log.gz 2023-11-28T06:41:27.307 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.205510.log.gz 2023-11-28T06:41:27.309 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.270583.log.gz 2023-11-28T06:41:27.311 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.292185.log.gz 2023-11-28T06:41:27.313 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.542871.log.gz 2023-11-28T06:41:27.313 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.514303.log.gz 2023-11-28T06:41:27.314 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.507165.log.gz 2023-11-28T06:41:27.314 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.537971.log.gz 2023-11-28T06:41:27.317 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.523493.log.gz 2023-11-28T06:41:27.317 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.537980.log.gz 2023-11-28T06:41:27.317 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.538396.log.gz 2023-11-28T06:41:27.317 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.312882.log.gz 2023-11-28T06:41:27.318 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.525597.log.gz 2023-11-28T06:41:27.321 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.463613.log.gz 2023-11-28T06:41:27.323 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.517981.log.gz 2023-11-28T06:41:27.324 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.205952.log.gz 2023-11-28T06:41:27.332 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.209736.log.gz 2023-11-28T06:41:27.336 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.638348.log.gz 2023-11-28T06:41:27.337 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.177763.log.gz 2023-11-28T06:41:27.346 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.452246.log.gz 2023-11-28T06:41:27.349 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.227657.log.gz 2023-11-28T06:41:27.349 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.244980.log.gz 2023-11-28T06:41:27.350 INFO:teuthology.orchestra.run.smithi154.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.251659.log.gz 2023-11-28T06:41:27.352 INFO:teuthology.orchestra.run.smithi154.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.485216.log.gz 2023-11-28T06:41:27.352 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.231449.log.gz 2023-11-28T06:41:27.352 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.259361.log.gz 2023-11-28T06:41:27.359 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.628761.log.gz 2023-11-28T06:41:27.361 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.572232.log.gz 2023-11-28T06:41:27.364 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.290911.log.gz 2023-11-28T06:41:27.371 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102466.log.gz 2023-11-28T06:41:27.374 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96218.log.gz 2023-11-28T06:41:27.374 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99665.log.gz 2023-11-28T06:41:27.383 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95839.log.gz 2023-11-28T06:41:27.385 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101062.log.gz 2023-11-28T06:41:27.386 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.186636.log.gz 2023-11-28T06:41:27.386 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.187054.log.gz 2023-11-28T06:41:27.386 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.175176.log.gz 2023-11-28T06:41:27.387 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.192681.log.gz 2023-11-28T06:41:27.387 INFO:teuthology.orchestra.run.smithi154.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.533649.log.gz 2023-11-28T06:41:27.391 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.263179.log.gz 2023-11-28T06:41:27.392 INFO:teuthology.orchestra.run.smithi154.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.271887.log.gz 2023-11-28T06:41:27.394 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.522251.log.gz 2023-11-28T06:41:27.394 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.524338.log.gz 2023-11-28T06:41:27.395 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% 77.7% -- replaced with /var/log/ceph/ceph-client.admin.162499.log.gz 2023-11-28T06:41:27.395 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.583093.log.gz 2023-11-28T06:41:27.396 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.464024.log.gz 2023-11-28T06:41:27.396 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.456837.log.gz 2023-11-28T06:41:27.397 INFO:teuthology.orchestra.run.smithi154.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.644050.log.gz 2023-11-28T06:41:27.406 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.297287.log.gz 2023-11-28T06:41:27.410 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.588272.log.gz 2023-11-28T06:41:27.411 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.590017.log.gz 2023-11-28T06:41:27.420 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.558996.log.gz 2023-11-28T06:41:27.427 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.530697.log.gz 2023-11-28T06:41:27.428 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.599545.log.gz 2023-11-28T06:41:27.429 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.530706.log.gz 2023-11-28T06:41:27.429 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.173484.log.gz 2023-11-28T06:41:27.432 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.451803.log.gz 2023-11-28T06:41:27.437 INFO:teuthology.orchestra.run.smithi154.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.286309.log.gz 2023-11-28T06:41:27.438 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.255608.log.gz 2023-11-28T06:41:27.440 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.446552.log.gz 2023-11-28T06:41:27.457 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.204581.log.gz 2023-11-28T06:41:27.478 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100778.log.gz 2023-11-28T06:41:27.480 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96231.log.gz 2023-11-28T06:41:27.480 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97141.log.gz 2023-11-28T06:41:27.481 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99059.log.gz 2023-11-28T06:41:27.481 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99413.log.gz 2023-11-28T06:41:27.484 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.185793.log.gz 2023-11-28T06:41:27.521 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.271470.log.gz 2023-11-28T06:41:27.522 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.508451.log.gz 2023-11-28T06:41:27.522 INFO:teuthology.orchestra.run.smithi154.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.328209.log.gz 2023-11-28T06:41:27.522 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.266647.log.gz 2023-11-28T06:41:27.522 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.581015.log.gz -- replaced with /var/log/ceph/ceph-client.admin.506747.log.gz 2023-11-28T06:41:27.523 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:27.523 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.581432.log.gz 2023-11-28T06:41:27.523 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.480628.log.gz 2023-11-28T06:41:27.523 INFO:teuthology.orchestra.run.smithi154.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.633331.log.gz 2023-11-28T06:41:27.553 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.458097.log.gz 2023-11-28T06:41:27.553 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.584847.log.gz 2023-11-28T06:41:27.557 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175185.log.gz 2023-11-28T06:41:27.558 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.180299.log.gz 2023-11-28T06:41:27.561 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102902.log.gz 2023-11-28T06:41:27.563 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.239029.log.gz 2023-11-28T06:41:27.563 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.245872.log.gz 2023-11-28T06:41:27.566 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.468692.log.gz 2023-11-28T06:41:27.593 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.245435.log.gz 2023-11-28T06:41:27.593 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.528175.log.gz 2023-11-28T06:41:27.596 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.274810.log.gz 2023-11-28T06:41:27.619 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.234080.log.gz 2023-11-28T06:41:27.622 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.228923.log.gz 2023-11-28T06:41:27.624 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231033.log.gz 2023-11-28T06:41:27.631 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101450.log.gz 2023-11-28T06:41:27.631 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101702.log.gz 2023-11-28T06:41:27.635 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96220.log.gz 2023-11-28T06:41:27.649 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.190912.log.gz 2023-11-28T06:41:27.649 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.306867.log.gz 2023-11-28T06:41:27.650 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.311520.log.gz 2023-11-28T06:41:27.652 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.437753.log.gz 2023-11-28T06:41:27.653 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101965.log.gz 2023-11-28T06:41:27.654 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.316636.log.gz 2023-11-28T06:41:27.654 INFO:teuthology.orchestra.run.smithi154.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.262733.log.gz 2023-11-28T06:41:27.656 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.212937.log.gz 2023-11-28T06:41:27.659 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.272730.log.gz 2023-11-28T06:41:27.662 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.291776.log.gz 2023-11-28T06:41:27.666 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.498401.log.gz 2023-11-28T06:41:27.670 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.300930.log.gz 2023-11-28T06:41:27.672 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.514639.log.gz 2023-11-28T06:41:27.672 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.510973.log.gz 2023-11-28T06:41:27.674 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.538804.log.gz 2023-11-28T06:41:27.676 INFO:teuthology.orchestra.run.smithi154.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.0.104039.log.gz 2023-11-28T06:41:27.677 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.284178.log.gz 2023-11-28T06:41:27.681 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.648781.log.gz 2023-11-28T06:41:27.682 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.239533.log.gz 2023-11-28T06:41:27.685 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.199837.log.gz 2023-11-28T06:41:27.687 INFO:teuthology.orchestra.run.smithi154.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.295562.log.gz 2023-11-28T06:41:27.689 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.445707.log.gz 2023-11-28T06:41:27.690 INFO:teuthology.orchestra.run.smithi154.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.285473.log.gz 2023-11-28T06:41:27.692 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.276342.log.gz 2023-11-28T06:41:27.693 INFO:teuthology.orchestra.run.smithi154.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.470612.log.gz 2023-11-28T06:41:27.693 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.285482.log.gz 2023-11-28T06:41:27.697 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.319617.log.gz 2023-11-28T06:41:27.702 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.481529.log.gz 2023-11-28T06:41:27.733 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95671.log.gz 2023-11-28T06:41:27.734 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100610.log.gz 2023-11-28T06:41:27.737 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.543700.log.gz 2023-11-28T06:41:27.740 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95357.log.gz 2023-11-28T06:41:27.741 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95629.log.gz 2023-11-28T06:41:27.742 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101828.log.gz 2023-11-28T06:41:27.742 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99287.log.gz 2023-11-28T06:41:27.743 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102302.log.gz 2023-11-28T06:41:27.744 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.176475.log.gz 2023-11-28T06:41:27.746 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.195292.log.gz 2023-11-28T06:41:27.752 INFO:teuthology.orchestra.run.smithi154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.439428.log.gz 2023-11-28T06:41:27.776 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.456012.log.gz 2023-11-28T06:41:27.776 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.457680.log.gz 2023-11-28T06:41:27.777 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.458949.log.gz 2023-11-28T06:41:27.783 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.263635.log.gz 2023-11-28T06:41:27.786 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.500157.log.gz 2023-11-28T06:41:27.787 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.503354.log.gz 2023-11-28T06:41:27.788 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.251222.log.gz 2023-11-28T06:41:27.790 INFO:teuthology.orchestra.run.smithi154.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.645423.log.gz 2023-11-28T06:41:27.795 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.208796.log.gz 2023-11-28T06:41:27.797 INFO:teuthology.orchestra.run.smithi154.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102860.log.gz 2023-11-28T06:41:27.797 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.208805.log.gz 2023-11-28T06:41:27.798 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.238519.log.gz 2023-11-28T06:41:27.799 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.446132.log.gz 2023-11-28T06:41:27.799 INFO:teuthology.orchestra.run.smithi154.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.248966.log.gz 2023-11-28T06:41:27.800 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.251213.log.gz 2023-11-28T06:41:27.801 INFO:teuthology.orchestra.run.smithi154.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.282919.log.gz 2023-11-28T06:41:27.801 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.283336.log.gz 2023-11-28T06:41:27.801 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.255191.log.gz 2023-11-28T06:41:27.814 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.485734.log.gz 2023-11-28T06:41:27.815 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.252559.log.gz 2023-11-28T06:41:27.886 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102050.log.gz 2023-11-28T06:41:27.886 INFO:teuthology.orchestra.run.smithi154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97351.log.gz 2023-11-28T06:41:27.889 INFO:teuthology.orchestra.run.smithi154.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97393.log.gz 2023-11-28T06:41:27.890 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99017.log.gz 2023-11-28T06:41:27.890 INFO:teuthology.orchestra.run.smithi154.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99329.log.gz 2023-11-28T06:41:27.899 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.542862.log.gz 2023-11-28T06:41:27.916 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.262287.log.gz 2023-11-28T06:41:27.918 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.304361.log.gz 2023-11-28T06:41:27.921 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.456003.log.gz 2023-11-28T06:41:27.922 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.521834.log.gz 2023-11-28T06:41:27.922 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.297695.log.gz 2023-11-28T06:41:27.923 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.457263.log.gz 2023-11-28T06:41:27.928 INFO:teuthology.orchestra.run.smithi154.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.212256.log.gz 2023-11-28T06:41:27.930 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.504627.log.gz 2023-11-28T06:41:27.930 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.558114.log.gz 2023-11-28T06:41:27.931 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.202466.log.gz 2023-11-28T06:41:27.932 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.300085.log.gz 2023-11-28T06:41:27.933 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.453099.log.gz 2023-11-28T06:41:27.935 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.313299.log.gz 2023-11-28T06:41:27.935 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.248074.log.gz 2023-11-28T06:41:27.937 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.476249.log.gz 2023-11-28T06:41:27.940 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.596122.log.gz 2023-11-28T06:41:27.962 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.477092.log.gz 2023-11-28T06:41:27.963 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.255599.log.gz 2023-11-28T06:41:27.991 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101871.log.gz 2023-11-28T06:41:27.991 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102344.log.gz 2023-11-28T06:41:27.999 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.438589.log.gz 2023-11-28T06:41:27.999 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.542440.log.gz 2023-11-28T06:41:28.013 INFO:teuthology.orchestra.run.smithi154.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.268306.log.gz 2023-11-28T06:41:28.023 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.526874.log.gz 2023-11-28T06:41:28.029 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.523911.log.gz 2023-11-28T06:41:28.030 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.457671.log.gz 2023-11-28T06:41:28.030 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.441101.log.gz 2023-11-28T06:41:28.033 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.462350.log.gz 2023-11-28T06:41:28.033 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.458527.log.gz 2023-11-28T06:41:28.034 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.519278.log.gz 2023-11-28T06:41:28.035 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462778.log.gz 2023-11-28T06:41:28.040 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.588281.log.gz 2023-11-28T06:41:28.042 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.555397.log.gz 2023-11-28T06:41:28.043 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.568054.log.gz 2023-11-28T06:41:28.046 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.505897.log.gz 2023-11-28T06:41:28.047 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.209218.log.gz 2023-11-28T06:41:28.048 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.506330.log.gz 2023-11-28T06:41:28.054 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.253890.log.gz 2023-11-28T06:41:28.055 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.173957.log.gz 2023-11-28T06:41:28.056 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.258527.log.gz 2023-11-28T06:41:28.058 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.473222.log.gz 2023-11-28T06:41:28.064 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.202475.log.gz 2023-11-28T06:41:28.064 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.484217.log.gz 2023-11-28T06:41:28.065 INFO:teuthology.orchestra.run.smithi154.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.298585.log.gz 2023-11-28T06:41:28.066 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.314958.log.gz 2023-11-28T06:41:28.093 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101534.log.gz 2023-11-28T06:41:28.104 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.438580.log.gz 2023-11-28T06:41:28.105 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.193103.log.gz 2023-11-28T06:41:28.105 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.436497.log.gz 2023-11-28T06:41:28.113 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.175612.log.gz 2023-11-28T06:41:28.122 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99623.log.gz 2023-11-28T06:41:28.128 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.300094.log.gz 2023-11-28T06:41:28.129 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.563342.log.gz 2023-11-28T06:41:28.137 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329585.log.gz 2023-11-28T06:41:28.145 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.587848.log.gz 2023-11-28T06:41:28.147 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.635417.log.gz 2023-11-28T06:41:28.147 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.589183.log.gz 2023-11-28T06:41:28.147 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.516690.log.gz 2023-11-28T06:41:28.157 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.247637.log.gz 2023-11-28T06:41:28.162 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.165760.log.gz 2023-11-28T06:41:28.163 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.179421.log.gz 2023-11-28T06:41:28.174 INFO:teuthology.orchestra.run.smithi154.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.276790.log.gz 2023-11-28T06:41:28.180 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.330003.log.gz 2023-11-28T06:41:28.182 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.327732.log.gz 2023-11-28T06:41:28.188 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.210701.log.gz 2023-11-28T06:41:28.190 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.479206.log.gz 2023-11-28T06:41:28.192 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.315375.log.gz 2023-11-28T06:41:28.255 INFO:teuthology.orchestra.run.smithi154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101330.log.gz 2023-11-28T06:41:28.256 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99833.log.gz 2023-11-28T06:41:28.268 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.629571.log.gz 2023-11-28T06:41:28.268 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.630405.log.gz 2023-11-28T06:41:28.270 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.437335.log.gz 2023-11-28T06:41:28.288 INFO:teuthology.orchestra.run.smithi154.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.272721.log.gz 2023-11-28T06:41:28.289 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.291349.log.gz 2023-11-28T06:41:28.290 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.301756.log.gz 2023-11-28T06:41:28.306 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.316209.log.gz 2023-11-28T06:41:28.306 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.316627.log.gz 2023-11-28T06:41:28.311 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.458940.log.gz 2023-11-28T06:41:28.313 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.632505.log.gz 2023-11-28T06:41:28.313 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.512276.log.gz 2023-11-28T06:41:28.318 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.635000.log.gz 2023-11-28T06:41:28.328 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.317895.log.gz 2023-11-28T06:41:28.330 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.292194.log.gz 2023-11-28T06:41:28.340 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.448785.log.gz 2023-11-28T06:41:28.344 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.285891.log.gz 2023-11-28T06:41:28.345 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.313716.log.gz 2023-11-28T06:41:28.346 INFO:teuthology.orchestra.run.smithi154.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.212247.log.gz 89.7% -- replaced with /var/log/ceph/ceph-client.admin.296023.log.gz 2023-11-28T06:41:28.346 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:28.347 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.467826.log.gz 2023-11-28T06:41:28.361 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.318729.log.gz 2023-11-28T06:41:28.362 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.453515.log.gz 2023-11-28T06:41:28.365 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.181611.log.gz 2023-11-28T06:41:28.372 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103336.log.gz 2023-11-28T06:41:28.375 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.234089.log.gz 2023-11-28T06:41:28.376 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.527746.log.gz 2023-11-28T06:41:28.432 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.295130.log.gz 2023-11-28T06:41:28.441 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.203733.log.gz 2023-11-28T06:41:28.447 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100484.log.gz 2023-11-28T06:41:28.448 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102007.log.gz 2023-11-28T06:41:28.457 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.310665.log.gz 2023-11-28T06:41:28.464 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.261865.log.gz 2023-11-28T06:41:28.465 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.317469.log.gz 2023-11-28T06:41:28.466 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.264531.log.gz 2023-11-28T06:41:28.521 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.450969.log.gz 2023-11-28T06:41:28.522 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.314550.log.gz 2023-11-28T06:41:28.532 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.257684.log.gz 2023-11-28T06:41:28.535 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.286736.log.gz 2023-11-28T06:41:28.535 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.475407.log.gz 2023-11-28T06:41:28.568 INFO:teuthology.orchestra.run.smithi194.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-28T06:41:28.596 INFO:teuthology.orchestra.run.smithi154.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.511385.log.gz 2023-11-28T06:41:28.597 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.461507.log.gz 2023-11-28T06:41:28.600 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.539235.log.gz 2023-11-28T06:41:28.602 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.454764.log.gz 2023-11-28T06:41:28.612 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.241738.log.gz 2023-11-28T06:41:28.615 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.597031.log.gz 2023-11-28T06:41:28.617 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.596617.log.gz 2023-11-28T06:41:28.618 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.318720.log.gz 2023-11-28T06:41:28.633 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.178597.log.gz 2023-11-28T06:41:28.637 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.584856.log.gz 2023-11-28T06:41:28.642 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.589600.log.gz 2023-11-28T06:41:28.697 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101408.log.gz 2023-11-28T06:41:28.722 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.265814.log.gz 2023-11-28T06:41:28.737 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.326825.log.gz 2023-11-28T06:41:28.745 INFO:teuthology.orchestra.run.smithi154.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.454339.log.gz 2023-11-28T06:41:28.768 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.328218.log.gz 2023-11-28T06:41:28.771 INFO:teuthology.orchestra.run.smithi154.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.468234.log.gz 2023-11-28T06:41:28.771 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.287154.log.gz 2023-11-28T06:41:28.776 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.307706.log.gz 2023-11-28T06:41:28.778 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.511849.log.gz 2023-11-28T06:41:28.780 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.507580.log.gz 2023-11-28T06:41:28.787 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.303517.log.gz 2023-11-28T06:41:28.789 INFO:teuthology.orchestra.run.smithi154.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.321326.log.gz 2023-11-28T06:41:28.792 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.233660.log.gz 2023-11-28T06:41:28.794 INFO:teuthology.orchestra.run.smithi154.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.637921.log.gz 2023-11-28T06:41:28.803 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.231895.log.gz 2023-11-28T06:41:28.804 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.481061.log.gz 2023-11-28T06:41:28.810 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.565924.log.gz 2023-11-28T06:41:28.889 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97561.log.gz 2023-11-28T06:41:28.922 INFO:teuthology.orchestra.run.smithi154.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.320453.log.gz 2023-11-28T06:41:28.924 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.317478.log.gz 2023-11-28T06:41:28.926 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.243673.log.gz 2023-11-28T06:41:28.927 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.502928.log.gz 2023-11-28T06:41:28.930 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.169927.log.gz 2023-11-28T06:41:28.933 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96229.log.gz 2023-11-28T06:41:28.947 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.231024.log.gz 2023-11-28T06:41:28.950 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.560700.log.gz 2023-11-28T06:41:28.952 INFO:teuthology.orchestra.run.smithi154.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.451794.log.gz 2023-11-28T06:41:28.953 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.574120.log.gz 2023-11-28T06:41:28.954 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.258101.log.gz 2023-11-28T06:41:28.956 INFO:teuthology.orchestra.run.smithi154.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.288013.log.gz 2023-11-28T06:41:28.956 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.288458.log.gz 2023-11-28T06:41:28.958 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.475833.log.gz 2023-11-28T06:41:28.959 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.455171.log.gz 2023-11-28T06:41:28.978 INFO:teuthology.orchestra.run.smithi154.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.636262.log.gz 2023-11-28T06:41:28.982 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461516.log.gz 2023-11-28T06:41:28.993 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.520533.log.gz 2023-11-28T06:41:28.995 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.510964.log.gz 2023-11-28T06:41:28.998 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95187.log.gz 2023-11-28T06:41:28.999 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95713.log.gz 2023-11-28T06:41:29.003 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.186219.log.gz 2023-11-28T06:41:29.019 INFO:teuthology.orchestra.run.smithi154.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.162989.log.gz 2023-11-28T06:41:29.057 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.169093.log.gz 2023-11-28T06:41:29.089 INFO:teuthology.orchestra.run.smithi154.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.330417.log.gz 2023-11-28T06:41:29.166 INFO:teuthology.orchestra.run.smithi154.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.296014.log.gz 2023-11-28T06:41:29.167 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.260199.log.gz 2023-11-28T06:41:29.167 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.449211.log.gz 2023-11-28T06:41:29.168 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97099.log.gz 2023-11-28T06:41:29.178 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.542207.log.gz 2023-11-28T06:41:29.181 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.538387.log.gz 2023-11-28T06:41:29.184 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.590434.log.gz 2023-11-28T06:41:29.184 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.592531.log.gz 2023-11-28T06:41:29.185 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.592540.log.gz 2023-11-28T06:41:29.187 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.574545.log.gz 2023-11-28T06:41:29.235 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.530275.log.gz 2023-11-28T06:41:29.235 INFO:teuthology.orchestra.run.smithi154.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.531115.log.gz 2023-11-28T06:41:29.256 INFO:teuthology.orchestra.run.smithi154.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.202015.log.gz 2023-11-28T06:41:29.278 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.254770.log.gz 2023-11-28T06:41:29.287 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101786.log.gz 2023-11-28T06:41:29.293 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.497979.log.gz 2023-11-28T06:41:29.295 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.455596.log.gz 2023-11-28T06:41:29.296 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.562801.log.gz 2023-11-28T06:41:29.301 INFO:teuthology.orchestra.run.smithi154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100978.log.gz 2023-11-28T06:41:29.308 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193955.log.gz 2023-11-28T06:41:29.317 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.575897.log.gz 2023-11-28T06:41:29.318 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.186210.log.gz 2023-11-28T06:41:29.322 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.269749.log.gz 2023-11-28T06:41:29.334 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.253452.log.gz 2023-11-28T06:41:29.339 INFO:teuthology.orchestra.run.smithi154.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.440258.log.gz 2023-11-28T06:41:29.340 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.514351.log.gz 2023-11-28T06:41:29.342 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.252114.log.gz 2023-11-28T06:41:29.346 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.541357.log.gz 2023-11-28T06:41:29.348 INFO:teuthology.orchestra.run.smithi154.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.461925.log.gz 2023-11-28T06:41:29.355 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.304778.log.gz 2023-11-28T06:41:29.356 INFO:teuthology.orchestra.run.smithi154.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.573244.log.gz 2023-11-28T06:41:29.356 INFO:teuthology.orchestra.run.smithi154.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.578850.log.gz 2023-11-28T06:41:29.357 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.589591.log.gz 2023-11-28T06:41:29.362 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.309812.log.gz 2023-11-28T06:41:29.364 INFO:teuthology.orchestra.run.smithi154.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103630.log.gz 2023-11-28T06:41:29.373 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.526450.log.gz 2023-11-28T06:41:29.377 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.595687.log.gz 2023-11-28T06:41:29.379 INFO:teuthology.orchestra.run.smithi154.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.283752.log.gz 2023-11-28T06:41:29.380 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.533658.log.gz 2023-11-28T06:41:29.381 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.469173.log.gz 2023-11-28T06:41:29.388 INFO:teuthology.orchestra.run.smithi154.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.230597.log.gz 2023-11-28T06:41:29.395 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.476666.log.gz 2023-11-28T06:41:29.396 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.476258.log.gz 2023-11-28T06:41:29.435 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.244093.log.gz 2023-11-28T06:41:29.438 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.505049.log.gz 2023-11-28T06:41:29.513 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.559864.log.gz 2023-11-28T06:41:29.517 INFO:teuthology.orchestra.run.smithi154.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.312873.log.gz 2023-11-28T06:41:29.566 INFO:teuthology.orchestra.run.smithi154.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.469645.log.gz 2023-11-28T06:41:29.573 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.190038.log.gz 2023-11-28T06:41:29.577 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.603946.log.gz 2023-11-28T06:41:29.580 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.263188.log.gz 2023-11-28T06:41:29.581 INFO:teuthology.orchestra.run.smithi154.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.296855.log.gz 2023-11-28T06:41:29.582 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.288022.log.gz 2023-11-28T06:41:29.589 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.306040.log.gz 2023-11-28T06:41:29.591 INFO:teuthology.orchestra.run.smithi154.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.567211.log.gz 2023-11-28T06:41:29.599 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.445716.log.gz 2023-11-28T06:41:29.629 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.442363.log.gz 2023-11-28T06:41:29.646 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.532824.log.gz 2023-11-28T06:41:29.700 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.180775.log.gz 2023-11-28T06:41:29.705 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.179852.log.gz 2023-11-28T06:41:29.717 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.269758.log.gz 2023-11-28T06:41:29.717 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.320462.log.gz 2023-11-28T06:41:29.721 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.244543.log.gz 2023-11-28T06:41:29.725 INFO:teuthology.orchestra.run.smithi154.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.534071.log.gz 2023-11-28T06:41:29.764 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.283761.log.gz 2023-11-28T06:41:29.765 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.288467.log.gz 2023-11-28T06:41:29.781 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.201175.log.gz 2023-11-28T06:41:29.789 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.485225.log.gz 2023-11-28T06:41:29.797 INFO:teuthology.orchestra.run.smithi154.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.639649.log.gz 2023-11-28T06:41:29.830 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.241330.log.gz 2023-11-28T06:41:29.836 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.569800.log.gz 2023-11-28T06:41:29.836 INFO:teuthology.orchestra.run.smithi154.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.596131.log.gz 2023-11-28T06:41:29.838 INFO:teuthology.orchestra.run.smithi154.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.255182.log.gz 2023-11-28T06:41:29.840 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.526865.log.gz 2023-11-28T06:41:29.842 INFO:teuthology.orchestra.run.smithi154.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.528603.log.gz 2023-11-28T06:41:29.843 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.541801.log.gz 2023-11-28T06:41:29.860 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101744.log.gz 2023-11-28T06:41:29.877 INFO:teuthology.orchestra.run.smithi154.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.280809.log.gz 2023-11-28T06:41:29.879 INFO:teuthology.orchestra.run.smithi154.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.212928.log.gz 2023-11-28T06:41:29.883 INFO:teuthology.orchestra.run.smithi154.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95965.log.gz 2023-11-28T06:41:29.892 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.439011.log.gz 2023-11-28T06:41:29.895 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102260.log.gz 2023-11-28T06:41:29.905 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.203742.log.gz 2023-11-28T06:41:29.918 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.246745.log.gz 2023-11-28T06:41:29.919 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.442776.log.gz 2023-11-28T06:41:29.922 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.532815.log.gz 2023-11-28T06:41:29.922 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.211952.log.gz 2023-11-28T06:41:29.925 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.593421.log.gz 2023-11-28T06:41:29.928 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.458088.log.gz 2023-11-28T06:41:29.929 INFO:teuthology.orchestra.run.smithi154.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.459830.log.gz 2023-11-28T06:41:29.938 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.448794.log.gz 2023-11-28T06:41:29.939 INFO:teuthology.orchestra.run.smithi154.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.161567.log.gz 2023-11-28T06:41:29.964 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.178171.log.gz 2023-11-28T06:41:29.978 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.573698.log.gz 2023-11-28T06:41:29.982 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.552859.log.gz 2023-11-28T06:41:30.116 INFO:teuthology.orchestra.run.smithi154.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.273138.log.gz 2023-11-28T06:41:30.121 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.292646.log.gz 2023-11-28T06:41:30.125 INFO:teuthology.orchestra.run.smithi154.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.526019.log.gz 2023-11-28T06:41:30.125 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.577278.log.gz 2023-11-28T06:41:30.127 INFO:teuthology.orchestra.run.smithi154.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.264522.log.gz 2023-11-28T06:41:30.130 INFO:teuthology.orchestra.run.smithi154.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.191374.log.gz 2023-11-28T06:41:30.142 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.248529.log.gz 2023-11-28T06:41:30.153 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.612243.log.gz 2023-11-28T06:41:34.952 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% 93.8% -- replaced with /var/log/ceph/ceph-client.admin.513987.log.gz -- replaced with /var/log/ceph/ceph-client.admin.514263.log.gz 2023-11-28T06:41:34.952 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.092 INFO:teuthology.orchestra.run.smithi154.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.275294.log.gz 2023-11-28T06:41:35.092 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.278168.log.gz 2023-11-28T06:41:35.353 INFO:teuthology.orchestra.run.smithi154.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.630822.log.gz 2023-11-28T06:41:35.353 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.287572.log.gz 2023-11-28T06:41:35.353 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.314967.log.gz 2023-11-28T06:41:35.353 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.193517.log.gz 2023-11-28T06:41:35.354 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.269341.log.gz 2023-11-28T06:41:35.354 INFO:teuthology.orchestra.run.smithi154.stderr: 81.9% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.537562.log.gz 2023-11-28T06:41:35.355 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.514312.log.gz 91.9% 2023-11-28T06:41:35.355 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.327268.log.gz 2023-11-28T06:41:35.356 INFO:teuthology.orchestra.run.smithi154.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.507156.log.gz 2023-11-28T06:41:35.356 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.541810.log.gz 2023-11-28T06:41:35.356 INFO:teuthology.orchestra.run.smithi154.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100180.log.gz 2023-11-28T06:41:35.356 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.251668.log.gz 2023-11-28T06:41:35.357 INFO:teuthology.orchestra.run.smithi154.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.196138.log.gz 2023-11-28T06:41:35.357 INFO:teuthology.orchestra.run.smithi154.stderr: 83.6% 78.4% -- replaced with /var/log/ceph/ceph-client.admin.212511.log.gz 2023-11-28T06:41:35.357 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.277695.log.gz 2023-11-28T06:41:35.357 INFO:teuthology.orchestra.run.smithi154.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.313707.log.gz 2023-11-28T06:41:35.357 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.229753.log.gz 2023-11-28T06:41:35.358 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.626033.log.gz 2023-11-28T06:41:35.358 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.594707.log.gz 2023-11-28T06:41:35.359 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% 93.6% -- replaced with /var/log/ceph/ceph-client.admin.484725.log.gz 2023-11-28T06:41:35.359 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.443618.log.gz 2023-11-28T06:41:35.359 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.194377.log.gz 2023-11-28T06:41:35.359 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.514360.log.gz 2023-11-28T06:41:35.359 INFO:teuthology.orchestra.run.smithi154.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.161150.log.gz 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.331264.log.gz 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.301339.log.gz 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.237159.log.gz 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.446561.log.gz 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 82.3% -- replaced with /var/log/ceph/ceph-client.admin.513561.log.gz -- replaced with /var/log/ceph/ceph-client.admin.529024.log.gz 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.361 INFO:teuthology.orchestra.run.smithi154.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95797.log.gz 2023-11-28T06:41:35.362 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.531124.log.gz 2023-11-28T06:41:35.362 INFO:teuthology.orchestra.run.smithi154.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.289913.log.gz 2023-11-28T06:41:35.362 INFO:teuthology.orchestra.run.smithi154.stderr: 89.8% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.486218.log.gz 2023-11-28T06:41:35.363 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% 90.5% 78.4% 90.0% 86.1% 78.0% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.229345.log.gz 2023-11-28T06:41:35.363 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.447406.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.181620.log.gz 2023-11-28T06:41:35.364 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.364 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.577707.log.gz -- replaced with /var/log/ceph/ceph-client.admin.561543.log.gz 2023-11-28T06:41:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.468243.log.gz 2023-11-28T06:41:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.309399.log.gz 2023-11-28T06:41:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.246327.log.gz 2023-11-28T06:41:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.459358.log.gz 2023-11-28T06:41:35.365 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.246736.log.gz 2023-11-28T06:41:35.366 INFO:teuthology.orchestra.run.smithi154.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.593875.log.gz 2023-11-28T06:41:35.366 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.487195.log.gz 2023-11-28T06:41:35.366 INFO:teuthology.orchestra.run.smithi154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.264948.log.gz 2023-11-28T06:41:35.367 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.542095.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.204150.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 81.0% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.469654.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.441514.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102386.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.514648.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99707.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.469164.log.gz 93.2% -- replaced with /var/log/ceph/ceph-client.admin.249867.log.gz 2023-11-28T06:41:35.369 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.370 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.319176.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.482878.log.gz 2023-11-28T06:41:35.370 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.370 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.308133.log.gz 2023-11-28T06:41:35.379 INFO:teuthology.orchestra.run.smithi154.stderr: 94.3% 84.2% -- replaced with /var/log/ceph/ceph-client.admin.520965.log.gz -- replaced with /var/log/ceph/ceph-client.admin.164786.log.gz 2023-11-28T06:41:35.379 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.379 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236291.log.gz 2023-11-28T06:41:35.379 INFO:teuthology.orchestra.run.smithi154.stderr: 80.4% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96007.log.gz 2023-11-28T06:41:35.379 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.473213.log.gz 2023-11-28T06:41:35.379 INFO:teuthology.orchestra.run.smithi154.stderr: 88.9% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.484208.log.gz 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 81.7% 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.318303.log.gz 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.524751.log.gz 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.517543.log.gz 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.571749.log.gz 84.9% -- replaced with /var/log/ceph/ceph-client.admin.188302.log.gz 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.249413.log.gz 2023-11-28T06:41:35.380 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.520125.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99245.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.503345.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.292637.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: 92.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95229.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.574963.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101104.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: 89.9% 86.1% -- replaced with /var/log/ceph/ceph-client.admin.590843.log.gz 2023-11-28T06:41:35.381 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.167794.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96763.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.540932.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95587.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.238528.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101020.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.443609.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.567220.log.gz 84.1% -- replaced with /var/log/ceph/ceph-client.admin.522242.log.gz 2023-11-28T06:41:35.382 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: 79.5% 92.8% -- replaced with /var/log/ceph/ceph-client.admin.459367.log.gz 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.201594.log.gz 82.1% -- replaced with /var/log/ceph/ceph-client.admin.609420.log.gz 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103780.log.gz 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.438162.log.gz 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.238104.log.gz 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.499694.log.gz 2023-11-28T06:41:35.383 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.483295.log.gz 90.1% -- replaced with /var/log/ceph/ceph-client.admin.296864.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.553267.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.552850.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.595678.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.596608.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.579267.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.302247.log.gz 2023-11-28T06:41:35.384 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.280818.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.285064.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.455180.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 80.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96563.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.638784.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.594300.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.583102.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.587440.log.gz 2023-11-28T06:41:35.385 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.188311.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.453923.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.638793.log.gz 80.9% -- replaced with /var/log/ceph/ceph-client.admin.265805.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: 81.7% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.450550.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.463186.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.242611.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.282093.log.gz 2023-11-28T06:41:35.386 INFO:teuthology.orchestra.run.smithi154.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102092.log.gz 2023-11-28T06:41:35.415 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.276799.log.gz 2023-11-28T06:41:35.475 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.500992.log.gz 2023-11-28T06:41:35.668 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.268746.log.gz 2023-11-28T06:41:35.926 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.248975.log.gz 2023-11-28T06:41:35.936 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.210186.log.gz 2023-11-28T06:41:35.959 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.264081.log.gz 2023-11-28T06:41:36.024 INFO:teuthology.orchestra.run.smithi154.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.460251.log.gz 2023-11-28T06:41:36.025 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.205047.log.gz 2023-11-28T06:41:36.305 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.578267.log.gz 2023-11-28T06:41:36.686 INFO:teuthology.orchestra.run.smithi154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.261874.log.gz 2023-11-28T06:41:36.739 INFO:teuthology.orchestra.run.smithi154.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.502347.log.gz 2023-11-28T06:41:36.852 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.486227.log.gz 2023-11-28T06:41:36.926 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.253899.log.gz 2023-11-28T06:41:37.068 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.164338.log.gz 2023-11-28T06:41:37.084 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.245881.log.gz 2023-11-28T06:41:37.085 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.247191.log.gz 2023-11-28T06:41:37.096 INFO:teuthology.orchestra.run.smithi154.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.160555.log.gz 2023-11-28T06:41:37.103 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.593430.log.gz 2023-11-28T06:41:37.137 INFO:teuthology.orchestra.run.smithi154.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.271009.log.gz 2023-11-28T06:41:37.706 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.253005.log.gz 2023-11-28T06:41:37.928 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.239038.log.gz 2023-11-28T06:41:39.689 INFO:teuthology.orchestra.run.smithi154.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.289922.log.gz 2023-11-28T06:41:41.740 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.162005.log.gz 2023-11-28T06:41:42.984 INFO:teuthology.orchestra.run.smithi154.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.241747.log.gz 2023-11-28T06:41:44.390 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.174438.log.gz 2023-11-28T06:41:49.100 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-28T06:41:49.402 INFO:teuthology.orchestra.run.smithi154.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.509580.log.gz 2023-11-28T06:41:52.001 INFO:teuthology.orchestra.run.smithi194.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-28T06:41:54.392 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.501857.log.gz 2023-11-28T06:41:56.261 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.191802.log.gz 2023-11-28T06:41:56.479 INFO:teuthology.orchestra.run.smithi154.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.311082.log.gz 2023-11-28T06:41:58.707 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-28T06:41:58.714 INFO:teuthology.orchestra.run.smithi154.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.275877.log.gz 2023-11-28T06:42:02.111 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.163484.log.gz 2023-11-28T06:42:04.498 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.189576.log.gz 2023-11-28T06:42:04.822 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.299036.log.gz 2023-11-28T06:42:06.133 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.278687.log.gz 2023-11-28T06:42:07.552 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.190460.log.gz 2023-11-28T06:42:07.623 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% 97.0% -- replaced with /var/log/ceph/ceph-client.admin.446983.log.gz -- replaced with /var/log/ceph/ceph-client.admin.447415.log.gz 2023-11-28T06:42:07.623 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:42:08.379 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.298121.log.gz 2023-11-28T06:42:08.554 INFO:teuthology.orchestra.run.smithi154.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.176901.log.gz 2023-11-28T06:42:09.203 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.572658.log.gz 2023-11-28T06:42:12.373 INFO:teuthology.orchestra.run.smithi154.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.173966.log.gz 2023-11-28T06:42:12.373 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.190921.log.gz 2023-11-28T06:42:12.374 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.165297.log.gz 2023-11-28T06:42:12.374 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.173493.log.gz 2023-11-28T06:42:12.729 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.168212.log.gz 2023-11-28T06:42:14.058 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.195709.log.gz 2023-11-28T06:42:14.355 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.447929.log.gz 2023-11-28T06:42:14.541 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.518826.log.gz 2023-11-28T06:42:14.719 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% 97.0% -- replaced with /var/log/ceph/ceph-client.admin.479687.log.gz -- replaced with /var/log/ceph/ceph-client.admin.472771.log.gz 2023-11-28T06:42:14.719 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T06:42:15.141 INFO:teuthology.orchestra.run.smithi154.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.163911.log.gz 2023-11-28T06:42:15.220 INFO:teuthology.orchestra.run.smithi194.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-28T06:42:15.606 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.328715.log.gz 2023-11-28T06:42:17.154 INFO:teuthology.orchestra.run.smithi154.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.298594.log.gz 2023-11-28T06:42:17.786 INFO:teuthology.orchestra.run.smithi194.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-28T06:42:21.045 INFO:teuthology.orchestra.run.smithi154.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.288884.log.gz 2023-11-28T06:42:22.541 INFO:teuthology.orchestra.run.smithi154.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.274819.log.gz 2023-11-28T06:42:22.783 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.551977.log.gz 2023-11-28T06:42:26.304 INFO:teuthology.orchestra.run.smithi154.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.508460.log.gz 2023-11-28T06:42:26.315 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.295571.log.gz 2023-11-28T06:42:27.692 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-28T06:42:33.077 INFO:teuthology.orchestra.run.smithi154.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.169936.log.gz 2023-11-28T06:42:43.675 INFO:teuthology.orchestra.run.smithi154.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.510503.log.gz 2023-11-28T06:42:47.588 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-28T06:42:57.681 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.595133.log.gz 2023-11-28T06:43:12.511 INFO:teuthology.orchestra.run.smithi154.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.293090.log.gz 2023-11-28T06:43:18.414 INFO:teuthology.orchestra.run.smithi154.stderr: 97.9% -- replaced with /var/log/ceph/ceph-client.admin.592958.log.gz 2023-11-28T06:43:32.876 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-28T06:43:32.878 INFO:teuthology.orchestra.run.smithi194.stderr: 2023-11-28T06:43:32.878 INFO:teuthology.orchestra.run.smithi194.stderr:real 2m7.458s 2023-11-28T06:43:32.878 INFO:teuthology.orchestra.run.smithi194.stderr:user 3m5.535s 2023-11-28T06:43:32.879 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m8.153s 2023-11-28T06:43:41.748 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.167022.log.gz 2023-11-28T06:44:02.567 INFO:teuthology.orchestra.run.smithi154.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.301765.log.gz 2023-11-28T06:44:11.538 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.232341.log.gz 2023-11-28T06:44:46.693 INFO:teuthology.orchestra.run.smithi154.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.464885.log.gz 2023-11-28T06:45:04.170 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.199846.log.gz 2023-11-28T06:45:14.033 INFO:teuthology.orchestra.run.smithi154.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.180308.log.gz 2023-11-28T06:45:48.411 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.232816.log.gz 2023-11-28T06:46:30.180 INFO:teuthology.orchestra.run.smithi154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.167272.log.gz 2023-11-28T06:47:24.832 INFO:teuthology.orchestra.run.smithi154.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.482382.log.gz 2023-11-28T06:47:26.787 INFO:teuthology.orchestra.run.smithi154.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.275303.log.gz 2023-11-28T06:47:36.305 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.209227.log.gz 2023-11-28T06:47:43.742 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-28T06:47:48.148 INFO:teuthology.orchestra.run.smithi154.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.194794.log.gz 2023-11-28T06:49:40.603 INFO:teuthology.orchestra.run.smithi154.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.242620.log.gz 2023-11-28T06:50:12.917 INFO:teuthology.orchestra.run.smithi154.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.162508.log.gz 2023-11-28T06:50:15.847 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.213382.log.gz 2023-11-28T06:51:46.640 INFO:teuthology.orchestra.run.smithi154.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.511394.log.gz 2023-11-28T06:52:06.378 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.164795.log.gz 2023-11-28T06:57:27.000 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.311529.log.gz 2023-11-28T06:59:00.403 INFO:teuthology.orchestra.run.smithi154.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.489099.log.gz 2023-11-28T06:59:11.526 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.162998.log.gz 2023-11-28T06:59:23.079 INFO:teuthology.orchestra.run.smithi154.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.165769.log.gz 2023-11-28T07:00:04.505 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.628770.log.gz 2023-11-28T07:01:15.114 INFO:teuthology.orchestra.run.smithi154.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-28T07:05:29.822 INFO:teuthology.orchestra.run.smithi154.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.290387.log.gz 2023-11-28T07:09:23.547 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.612253.log.gz 2023-11-28T07:09:29.578 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.603955.log.gz 2023-11-28T07:09:52.637 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.600863.log.gz 2023-11-28T07:10:08.659 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.617821.log.gz 2023-11-28T07:10:09.831 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.606697.log.gz 2023-11-28T07:10:16.352 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.615130.log.gz 2023-11-28T07:10:24.317 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.623391.log.gz 2023-11-28T07:10:58.246 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.609429.log.gz 2023-11-28T07:11:31.840 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.620523.log.gz 2023-11-28T07:11:54.757 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.626042.log.gz 2023-11-28T07:11:56.206 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-28T07:15:57.495 INFO:teuthology.orchestra.run.smithi154.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.239542.log.gz 2023-11-28T07:16:18.028 INFO:teuthology.orchestra.run.smithi154.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.544126.log.gz 2023-11-28T07:16:34.989 INFO:teuthology.orchestra.run.smithi154.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.331685.log.gz 2023-11-28T07:28:51.864 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.534080.log.gz 2023-11-28T07:28:58.613 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.536132.log.gz 2023-11-28T07:33:35.262 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-28T07:33:46.475 INFO:teuthology.orchestra.run.smithi154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.321777.log.gz 2023-11-28T07:35:45.833 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.205961.log.gz 2023-11-28T07:39:19.604 INFO:teuthology.orchestra.run.smithi154.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-28T07:48:46.281 INFO:teuthology.orchestra.run.smithi154.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.196569.log.gz 2023-11-28T08:08:48.038 INFO:teuthology.orchestra.run.smithi154.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.639658.log.gz 2023-11-28T08:08:48.061 INFO:teuthology.orchestra.run.smithi154.stderr: 2023-11-28T08:08:48.061 INFO:teuthology.orchestra.run.smithi154.stderr:real 87m22.625s 2023-11-28T08:08:48.061 INFO:teuthology.orchestra.run.smithi154.stderr:user 75m32.829s 2023-11-28T08:08:48.061 INFO:teuthology.orchestra.run.smithi154.stderr:sys 3m14.552s 2023-11-28T08:08:48.062 INFO:tasks.ceph:Archiving logs... 2023-11-28T08:08:48.065 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/remote/smithi154/log 2023-11-28T08:08:48.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T08:19:06.869 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/remote/smithi194/log 2023-11-28T08:19:06.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T08:22:20.076 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T08:22:20.087 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T08:22:20.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T08:22:20.092 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T08:22:20.270 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T08:22:20.283 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T08:22:20.285 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T08:22:20.289 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T08:22:20.307 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2023-11-28T08:22:20.322 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2023-11-28T08:22:20.323 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T08:22:20.324 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2023-11-28T08:22:20.324 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 164 +1024us[+1006us] +/- 77ms 2023-11-28T08:22:20.324 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv02.front.sepia.ceph.com 3 6 377 29 -475us[ -484us] +/- 59ms 2023-11-28T08:22:20.324 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 17 -372us[ -372us] +/- 62ms 2023-11-28T08:22:20.325 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T08:22:20.350 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T08:22:20.351 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-11-28T08:22:20.351 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +1099us[+1099us] +/- 79ms 2023-11-28T08:22:20.351 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv02.front.sepia.ceph.com 3 7 377 101 -409us[ -382us] +/- 58ms 2023-11-28T08:22:20.351 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -347us[ -347us] +/- 62ms 2023-11-28T08:22:20.351 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T08:22:20.353 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T08:22:20.366 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T08:22:20.367 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T08:22:20.394 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-28T08:22:20.587 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-28T08:22:20.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T08:22:20.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T08:22:20.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T08:22:20.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T08:22:20.907 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T08:22:20.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T08:22:20.957 INFO:teuthology.task.internal:Duration was 36063.305940 seconds 2023-11-28T08:22:20.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T08:22:20.991 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T08:22:20.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T08:22:20.995 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T08:22:21.059 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T08:22:21.167 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T08:22:21.622 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T08:22:21.623 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2023-11-28T08:22:21.623 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T08:22:21.676 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2023-11-28T08:22:21.676 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T08:22:21.708 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T08:22:21.708 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T08:22:21.712 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T08:22:21.785 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T08:22:21.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T08:22:21.789 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T08:22:23.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T08:22:23.373 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T08:22:23.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T08:22:23.448 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T08:22:23.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T08:22:23.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T08:22:23.496 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T08:22:23.580 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2023-11-28T08:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2023-11-28T08:22:23.638 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T08:22:23.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T08:22:23.675 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T08:22:23.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T08:22:23.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T08:22:23.703 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T08:22:23.705 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/remote/smithi154 2023-11-28T08:22:23.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T08:22:23.797 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210/remote/smithi194 2023-11-28T08:22:23.798 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T08:22:23.840 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T08:22:23.840 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T08:22:23.844 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T08:22:23.890 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T08:22:23.903 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T08:22:23.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T08:22:23.926 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T08:22:23.927 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T08:22:23.935 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T08:22:23.951 INFO:teuthology.orchestra.run.smithi194.stdout: 265245 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 08:22 /home/ubuntu/cephtest 2023-11-28T08:22:23.965 INFO:teuthology.orchestra.run.smithi154.stdout: 265402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 08:22 /home/ubuntu/cephtest 2023-11-28T08:22:23.967 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T08:22:23.978 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T08:22:24.043 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T08:22:24.069 DEBUG:teuthology.nuke:shortname: smithi154 2023-11-28T08:22:24.070 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T08:22:24.092 DEBUG:teuthology.nuke:shortname: smithi194 2023-11-28T08:22:24.093 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T08:22:24.098 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 22:12:58.254595', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI3HfNhlm7IIuqF5CEHRvcc3BBpPBo9YpuZPiuNXf3ohYXfRS4eI7VlKuxezkNDYzYT+bgxlIgxLgmK7fQNHKOg='} 2023-11-28T08:22:24.122 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7468210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 22:12:58.252679', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDmQXHpY+MkIvzd/jPTLJcVE7t1ZTK8x8oh64/w9Ha51Eyz3TDHENJ0yA1Iej8QqnjTaGi1GZhgrEKfI+Rx30Js='} 2023-11-28T08:22:24.186 INFO:teuthology.orchestra.console.smithi154:Power off 2023-11-28T08:22:24.186 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T08:22:24.214 INFO:teuthology.orchestra.console.smithi194:Power off 2023-11-28T08:22:24.215 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T08:22:24.239 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-11-28T08:22:24.240 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:24.251 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-11-28T08:22:24.251 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:24.283 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-11-28T08:22:24.304 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-11-28T08:22:28.284 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:28.306 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:28.395 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-11-28T08:22:28.416 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-11-28T08:22:32.398 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:32.417 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:32.509 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-11-28T08:22:32.530 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-28T08:22:32.630 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-11-28T08:22:36.511 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T08:22:36.624 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-11-28T08:22:36.725 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-11-28T08:22:36.831 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 36063.305940151215 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a15cef3b710c4a7f8c764a016c4d21e4 status: fail success: false 2023-11-28T08:22:36.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T08:22:36.916 INFO:teuthology.run:FAIL